Yeah, turtles are on every beach on the planet /s
Also, many deserts are very fragile ecosystems: https://en.wikipedia.org/wiki/Biological_soil_crust (of course there are deserts which are so inhospitable that there is virtually no life to be found, like the sand dunes in the Arabian deserts - there, offroad driving may be ok)
Beaches are populated by all sorts of life, some of which probably needs protecting.
Choose your recreation spots carefully.
I probably meant something like: stick to the designated areas, and if you're going to trailblazer just be aware of what to avoid to at least try to minimise impact.
I guess if you optimize for avoiding a specific form of harm you can succeed. But if you want to avoid all harm it seems a very narrow tightrope.