Is this the line of “single shared weight” work that you’re referring to?

https://weightagnostic.github.io/ https://arxiv.org/pdf/1906.04358 [PDF]