Yes, it's pretty uncommon seeing people in public do it (sometimes on the floor or on ledges), but there are not many opportunities.
As a relatively big guy, I absolutely envy some of my smaller colleagues (yeah, mostly women) who can sit cross-legged in their office chairs - I'd absolutely do it, but I'm just too big, and just crossing one leg under the other often leads to numbness after a while.