As an aromantic man, I do feel more energized and motivated after a chat or a card game with my (mostly male) colleagues. I'm somewhat averse to body contact, so I wouldn't make use of a massager, but so long as it's just an extra perk like a Googly ball-bath (they have those, right?), I don't see the problem.
Not being sexually attracted to someone doesn't mean that their company won't be refreshing or even uncomfortable. I think that's much more a matter of personality, and gender is only a secondary factor in whether you'll find someone likable or not.