Of course, I'm aware that random man-made things polluting the oceans is a bad thing in general, but in this specific case, if the plastic is just stuck there forever, is it still pollution in practical terms? The electronics inside the phones probably won't pass modern environmental standards (e.g. RoHS), so let's forget about the electronics for now and only focus on the plastic.
On the one hand, does the plastic release toxic chemicals in high enough concentration as it decomposes (slowly?)? On the other hand, does the container and its cargo somehow become a new shelter/habitat for certain species of marine life?