not really what you asked exactly but this seems cool:

https://github.com/hpcaitech/ColossalAI