GPUlayer: Train PyTorch on every GPU you can reach-faster than PyTorch Lightning

Train PyTorch on every GPU you can reach: one Trainer, from your laptop to many machines.

The GPUlayer Trainer runs the same PyTorch script in your process, on every GPU of a machine, or across many machines: laptops, workstations, servers and cloud VMs. It picks machines and GPUs that can train the model, starts every process, and brings back logs, checkpoints and metrics.