Pretty bare bones no frills low cost provider: http://joesdatacenter.com/
If you don't need much hand holding and don't care if your server is unavailable for 20 minutes every few months I would recommend them. Otherwise it's probably better to go for one of the bigger (and more expensive) players.