http://en.wikipedia.org/wiki/PageRank#The_intentional_surfer...
> The Google toolbar sends information to Google for every page visited, and thereby provides a basis for computing PageRank based on the intentional surfer model.
For it to display a pagerank, it has to send the url to Google (otherwise, how is it going to know what to display the rank for?). Google can then send the crawler to that address later.
> If valid, I'd consider this an almost dangerous breach of privacy.
I don't believe they monitor who is going where. Just where people are going. Although it would be trivial for them to monitor who is going where ...
Also, an FYI, if you are logged in to Google and you're using their search engine, then they ARE monitoring you. Check out Google Web History.