Ball games are at the park. It's a short bike ride or moderate walk away. We have a small gravel area we set up the paddling pool in, and no reason one can't wrestle in between beds (or indoors on the carpet).
It's almost like sweeping statements such as "no one should have a lawn" need modifiers. ;o)
I'd guess grass is still better environmentally than gravel; so long as you don't over tend it (and our mower was rescued from the dump).
Have fun.