Well I can't other than agree with you. When I was doing research on this particular use case I was surprised that GMail APIs are open like this.
It was my priority to ensure that we are looking just for specific filter and I touch only emails from Uber and Lyft.
GMail API developers should definitely consider adding this kind of granularity to the system. I think it would allow to build much more sophisticated and trustworthy application.