There's a Vice documentary[1] in which reporters visit the "garbage island". The "garbage island" is not how you imagine it, it's literally an ocean of tiny broken down particles of plastic[2] invisible to the naked eye (when looking at the sea) that are in everything, including the fish. There is no way to remove the plastic through harvesting, the only option would be to filter the sea water which has its own set of problems.
[1] http://www.vice.com/en_uk/toxic/toxic-garbage-island-1-of-3