It's the opposite, actually. Servers have very good and very fast network connections to other servers. Clients have very shitty network connections, especially with wi-fi or mobile devices.
CDN's can help with this somewhat, but a server-to-server network connection will still always be better and faster.