Somewhat agreed. A city can want lots of things few people use. I'm sure the plenty of people don't take advantage of Central Park or Golden Gate Park yet they are paid for by the government.

Further, stadiums are often used for more than just sports. They're a venue for concerts, fireworks shows, and many other things.