I use Ubuntu (and Debian before that) in production servers and can't complain. Now I am thinking about trying Ubuntu as a desktop, but didn't get a box for it to live in.
Guess it is not so bad anymore, but if you liked Ubuntu in production servers, going the route of a small window manager could be more your style (don't know if I'm stating stuff obvious to you, just in case).