Norway was not that poor before oil. That’s a myth. Relative to some other European countries, yes. But it was still a country with a long history of trade, industry and natural resources.
Though I’m not surprised a Swede thinks of us mainly as poor farmers ;) (no bad feelings, you literally had an empire so the attitude is understandable)