I took up biking as an adult again by biking with rental bikes in Mexico City (government owned) and they are built like tanks for durability, not for riding pleasure.
When I finally got on a "real" bike, I flew. I was much faster and agile than my bike-riding friends. Because I couldn't upgrade the bike, I had to upgrade myself, and these investments are compatible with any kind of bike (or sport, actually).