Actually you can run virtualbox in a headless server using the VBoxManage and VBoxHeadless[1]. I have been using that for years.

[1]: http://www.virtualbox.org/manual/ch07.html