I suppose my biggest annoyance with OS X is that it doesn't let you actually have control. A perfect example is that I have SAMBA turned on in OS X to share some files to other computers on my network. For security, I have a separate user account for the share. I can't configure the shares and permissions in the GUI because it's not a "simple" setup, so I have to use the config file for samba. Every single OS update I get overwrites this file, so I have to re-create it every time. Furthermore, as of 10.5, permissions seem to just spontaneously change. I can no longer get group permissions to inherit.
Another time, I needed to quickly use TFTP. Trying to get this setup in OS X is a nightmare, and after spending a couple hours on it, I just gave up. It's installed and there, but it for some reason its configuration is just non-standard.
It's just these little things that make me glad I switched to Ubunutu, and I would never even consider using OS X again.