All of our machines at Paperspace https://paperspace.com have GPUs and our pricing is much more affordable (disclaimer: I'm one of the founders). Currently only Windows but Linux is coming soon :)
Pricing is interesting. As far as I understand your service is remote Desktop but the VMs can also used as dedicated server. Will there be an API?