I find this extremely frustrating as well, across the various Google services I use.