There must be some subtly in the law. Or perhaps Sweden has unusual laws about what you can photograph in/from a public space.
That being said, I wonder if an architect could claim an unusual/interesting building as a work of art, and then have it removed from google street view?