Why spend almost $1,000 to rent an A10 GPU? You can purchase a used 3090 outright for that much.
* Flash Attention, an efficient attention module which significantly speeds up training, only works on Ampere GPUs [1]
* Even if I bought a 3090, I would have to get a computer to go with it, along with a PSU and some cooling. Don't know where to start with that.