I have it behind an apache service which is password protected and only accepts https. As well, it uses fail2ban. If you ever ran a web server, you'll know your server will get bot scans 247. These only occur on the root domain and direct IP, so I disabled all root/direct IP access and moved it to a subdomain. I've never had issues.
I use samba as well, but that's only because this server works as my NAS as well. I setup a dedicated DAV folder on the NAS directory and give it extreme user restrictions, just incase. It's just a nice central server to keep all my devices in sync.