You're completely right that if it has merit, Google should apply it to their silicon design.

As it turns out, they do! This method has been used in TPU for multiple generations, including the most recent.