If you want to resize the remote terminal it might be easier to determine the size locally with an ioctl and only execute "stty cols/rows" remotely.

It might also help to export the local TERM value remotely because it's not otherwise passed through a serial port.