Yep everything goes through my server (see the security and privacy sections at the bottom of the page).
It would be awesome if someone could figure out a peer-to-peer way to accomplish the same thing. I'm not familiar with it, but I think that might essentially be what Tor hidden services are.