I don't directly develop the models, I played with some for fuzzing [1] and I'm working on security for them [2]. And, before joining GOSST, I was leading the OSS DevInfra team in TF. I still have the most number of commits made by a human [3] even after 2 days of leaving the team, though I see the next person only needs 4 more :)
[1]: https://security.googleblog.com/2023/08/ai-powered-fuzzing-b... [2]: https://security.googleblog.com/2023/10/increasing-transpare... [3]: https://github.com/tensorflow/tensorflow/graphs/contributors
Good luck!
To that end, focus heavily on whatever exists in the vertex of what you're good at (which did you like and excel at of those things you did?) and a growth area (example: Python, C++ and the multitudinous ways they continue to be used together in AI etc).
So you have to look at what existing leverage you have and build upon that foundation. It will be very difficult to get a role without getting some hands on experience back first, so where I'd start is, could you step down to become IC at your current job? I'd be more interested to evaluate a candidate doing Python/Kotlin that wants to move into something adjacent than someone in management who just wants to be a dev again.
For example, collecting Stackoverflow posts about GCP products, and distributing the needed subsets of them among vendors and employees in tech support to potentially answer, comment, edit, vote on, re-tag, &c, used to be all Python (and the "scale" was a few hundred or thousands of posts and people at a time -- ridiculously small "by Google `production` standards", and perfectly adequate for the much-higher-programmer-productivity Python has always afforded... I know, because I did the vast majority of that coding, including maintenance, ongoing monitoring of performance, and VERY occasional optimizations if and when monitoring showed them to be desirable).
That was the core of my job for my last several years at Google -- I won't even list the many other NON-prototyping tasks I did in previous years (decades, almost), the vast majority of them in Python. And -- the majority of my performance reviews during those 18+ years were rated "exceeds expectations", so it seems that world-class Python skill (which clearly was crucial to me getting a hiring offer back in 2004, though, alas, visa issues delayed my start to early 2005) were extremely useful for at least some of us Google engineers.
Alex
Edit: I guess I'm not sure on whether large training runs count as prod or not. They're certainly expensive and mission critical.