I'm not perfectly understanding of such legalities, so correct me if I am wrong, but wouldn't this be infringing on scraping territory?
There's plenty of hypocrisy at that company but this doesn't strike me as a case of it.
I'd suggest respecting Google's robots.txt as much as Google respects our DNT settings.