Their support is unbeatable. Many times they helped me(I'm a dev. not a sys. admin.) for free where other companies would have charged me.
I agree that adding their key on the VPS without talking to you sucks but having a 100% utilisation of your CPU is a bit egoist. That means that nobody on the host machine can burst their share for a quick high-cpu job.
If you want total control over your machine, get a dedicated box. Even then, some hosters demand root access on your box.