We're mainly talking mustard gas. Germany did use nerve gases tabun, sarin, and soman [1]. But nerve gases degrade after a period of a few weeks to a few years. I'm not sure what they degrade into, admittedly, and I doubt it's nice.
Mustard gas lasts longer, but is also much less potent. Military use is about 1 tonne for 2.6 square kilometres [2]. So if it were just leaking into the open sea -- even one as small as the Baltic -- it wouldn't be an issue. The problem is really if something re-concentrates it -- currents, or location, or possibly going up the food chain (does that happen?)
So my initial feeling is it's not quite as catastrophic as it sounds. Would love to hear from somebody better-informed, though.
1 - https://en.wikipedia.org/wiki/Germany_and_weapons_of_mass_de...
2 - http://www.iraqwatch.org/perspectives/rangwala-powell-020503...