I guess you need a valid SSL certificate to do this? So it may not work well if you SSH into an IP instead of a domain -- it is not always possible to get an SSL certificate for an IP address ( https://stackoverflow.com/questions/2043617/is-it-possible-t... ).

It is probably trivial for people here to get a domain and then point it to the IP, but still, this seems a minor limitation.