It sounds like you might be wanting something for GPU batch job management. Some things to check out would be gpu orchestration tools, specifically: Slurm, Run.ai, and Skypilot.
Or maybe you're kind of wanting a serverless GPU cloud - check out Runpod, Modal, Baseten, and Replicate.
Links:
https://slurm.schedmd.com/documentation.html
https://www.run.ai/ml-workflow-management
https://github.com/skypilot-org/skypilot
https://www.runpod.io/serverless-gpu