I've got Gitlab running on a DigitalOcean droplet, and even if you choose not to use their pre-built images, setting up Gitlab is very easy.