This must not be affecting everyone because my ssh connection from Toronto to Portland is working just fine without additional latency.

Edit:

The Ontario router seems to be dropping packets:

  $ ping gw02.wlfdle.phub.net.cable.rogers.com 
  PING gw02.wlfdle.phub.net.cable.rogers.com (66.185.86.254) 56(84) bytes of data.
  From <snip> icmp_seq=1 Packet filtered
  From <snip> icmp_seq=2 Packet filtered
  From <snip> icmp_seq=3 Packet filtered

  --- gw02.wlfdle.phub.net.cable.rogers.com ping statistics ---
  3 packets transmitted, 0 received, +3 errors, 100% packet loss, time 10206ms

Though I have no issue with routers under that sub-domain:

  $ traceroute <snip>
  traceroute to <snip> (<snip>), 30 hops max, 60 byte packets
  1  <snip> (192.168.1.1)  1.489 ms  2.038 ms  2.669 ms
  2  * * *
  3  69.63.243.69 (69.63.243.69)  17.599 ms  17.584 ms  17.339 ms
  4  so-4-0-0.gw02.wlfdle.phub.net.cable.rogers.com (66.185.82.97)  31.992 ms  31.972 ms  31.819 ms
  5  69.63.253.65 (69.63.253.65)  33.198 ms  34.687 ms  34.596 ms
  6  * * *
  7  pos-3-15-0-0-cr01.ashburn.va.ibone.comcast.net (68.86.86.25)  35.557 ms  28.952 ms  28.818 ms
  8  68.86.85.14 (68.86.85.14)  33.029 ms  42.176 ms  41.924 ms
  9  he-0-4-0-0-cr01.350ecermak.il.ibone.comcast.net (68.86.88.146)  49.244 ms  45.218 ms  44.940 ms
  10  pos-1-2-0-0-pe01.350ecermak.il.ibone.comcast.net (68.86.86.78)  37.146 ms  40.169 ms  40.372 ms

Note: so-4-0-0.gw02.wlfdle.phub.net.cable.rogers.com is having no issues. I don't know how Rogers' internal network is setup, but it seems like if there are issues they are handling them so that customers (or at least I) don't see them.