I got a lot of good tips from https://observatory.mozilla.org/
It gives a clear rating, and readable, concrete advice to get you to the next level.
I also block the SSH port on the firewall level, unless I need to do some maintenance (and then I only unblock my IP address). So the SSL port is the only open port most of the time.