But they have absolutely terrible support, heaven forbid if your server goes down or experiences a hardware failure - its often a battle just to get them to replace hardware. They also throttle FTP traffic.
Although, apart from the throttling and assuming your box never dies, yes OVH are good.
And their support may be pretty bad if you have a non-pro offer. That means that if you get a 200€/month box you'll have a pretty awesome, first-class support. But if you have a 20€/month box and your hard drive dies, you'll have to wait one day or two. That seems fair to me.
As for the throttling, that doesn't happen (as far as I'm aware) however they do have poor peering connections to the US so it's pretty normal to get 5kb/s there which is much worse.