So there is this idea that we can reduce the CO2 in the atmosphere by using iron seeding into the ocean causing a massive amount of phytoplankton production. But would the side effect of this be a drop in ocean oxygen levels?
No it would increase ocean oxygen levels. CO2 in the atmosphere would become O2 in the ocean and carbon in the phytoplankton. Until the plankton decay, of course.
It's imho always better to let the nature do the job. Just stop interfering.