Honesty, in my experience this impression is just desperate cope from people with worse work environments. My time at Google was the easiest/most relaxing of my career by far. Hell, that's why I left.
But whenever people would ask me about all the flashy perks and I'd confirm we had them, 100% of the time they'd follow up by _telling_ me (not asking): "they work you like a dog though". It was an early and dramatic lesson in how powerfully people are chained to the just-world fallacy: their emotional incontinence was severe enough that it literally prevented them from conceiving of a work environment that was simply more pleasant than theirs.
Google's perk-filled environment doesn't need to be explained by anything but golden handcuffs + productivity boosts from having recreation/convenience onsite.