It is that much waste. I suspect you underestimate the size of the fishing industry and fleets of boats. In 2004 the estimate of commercial fishing boats was over 4 million. As an example
of the impact of their waste consider the great pacific garbage patch: “the patch is 1.6 million square kilometers and has a concentration of 10-100 kg per square kilometers. They estimate there to be 80.000 metric tonnes in the patch, with 1.8 trillion plastic pieces, out of which 92% of the mass is to be found in objects larger than 0.5 centimeters.” https://en.m.wikipedia.org/wiki/Great_Pacific_garbage_patch Obviously, it is not all fishing vessel waste, the belief is that the majority is, particularly discarding fishing net creating the body that all the other waste gets trapped in.