Spotify doesn't forward the stream. When you tell it to play with another device that's running Spotify, it simply instructs that device to play the stream; unlike AirPlay it doesn't send the music to that device.
Playing a song from a phone 'pushing' to a device on a slow connection always causes troubles for me.