However, I grew up in Scotland where we have a somewhat longer history of dealing with access to land and rich people ;) The solution there is that there is a legal right to access wild land. Note this doesn't just apply to "public land" but all land public or private.
http://www.snh.org.uk/pdfs/publications/access/full%20code.p...
https://en.wikipedia.org/wiki/Freedom_to_roam
One of the rights lost when folks moved to "the land of the free", it seems.