There are a lot of papers on ‘federated training’ where different parts of the training are done on separate datasets on different computers. Also a lot of literature on doing both training and inference in ‘the edge’.
For instance a surveillance system could have an A.I. in the camera and one in the building and then another one in the cloud that oversees all the buildings.