You have quite a biased sample because most people are not going to suffer going to remote parts of Scotland to look for birds, so you are only seeing the more devoted birdwatchers.

Birdwatching can still be enjoyed in most places without needing to travel far. Birds are less active in bad weather so you don’t need expensive outdoor gear, and in many places there will be freely accessible nature reserves with hides in which one can sit in shelter to watch birds.

The highest quality glass is going to get pretty expensive (camera lenses can get to the region of $20k; binoculars $4k or so) but there are also much cheaper options and often these can be quite reasonable: you don’t need to take photos of birds; a superzoom point-and-shoot can work great; more expensive binoculars make a bigger difference in low light and if you’re young (older people’s pupils won’t dilate as much so bigger objectives at a lower magnification won’t be a huge help).

I feel like mostly you’re observing that rich people spend lots of money on their hobbies and not that opening your eyes to look at birds is some expensive exclusionary activity.