I ended up Tailscale for Wireguard myself. I was really worried about letting all these server software out on the wide open internet because I can't guarantee I'll be around 24/7 to monitor in case of a security problem and this way I can be lazier. :)

The added benefit is that I can force all devices to use PiHole while connected to Tailscale and have DNS-adblocking on the go!