I'm currently working with on-site hospital data and have been designing our own in-house federated library on top of Keras to train in-aggregate while leaving all data on-site.