As a Galaxy Nexus owner myself, it doesn't look like Google has a choice. The original vendor of the chipset is no longer around to update drivers. You can't wring blood from a stone.
If Google wanted to, they'd figure out a way. It just isn't in their interest. They only care about the new shiny. We'll see what happens with the 2012 Nexus 7 and Nexus 4 this time next year. They'll probably be discontinued too, as none of the Nexus lines have had updates for more than 2 years.
Their top of the line Nexus 10 has issues which they are not able to fix. They are shipping a crippled version of KitKat on Nexus 10 because of a graphics driver issue!