Learning it in school and actually speaking it are very different things though. Source: learned Swedish in school in Finland, rarely used it since, have practically forgotten all about it now.

That's stretching it a bit. Many Fins only speak very basic Swedish.