That's right, you can install on your own GPU servers. Infiniband+RDMA transport is also supported which typically doubles the number of GPUs you can scale to.
We're adding support for other clouds, particularly ones with higher-end GPUs so feedback like this is good to know.