Scaling Mastodon

I'd be very interested to see a discussion of scaling the entire Mastodon network as well. I'm seeing OSocial admins starting to mention concerns with the connections and concurrencies between servers, as well as total network traffic.