I imagine stories of endless parties, people switching genders, getting high and playing a myriad of amazing games, pursuing arts of any form, screwing aliens or AI avatars -- it just wouldn't make terribly interesting reading, for the most part. Hence you've gotta add tension and some nastiness to make it a fun space opera, despite such things happening to less than a billionth of your citizens. Sorta like ST:TNG - sure a lot of the universe sucks, but for the most part, life seems pretty rosy if you're not the subject of an episode. TNG also provided that positive feeling in me, apart from hating the Prime Directive.
Well, there is more to life than hedonism.
IMHO, anyway. If it works for you, that's great!
Maybe I'm just projecting how I'd live in such a universe and that's why it makes me so happy. :\