I do this too. What are the downsides to this solution?
I don't really see any performance issue with Synology (Avoton with 16 GB RAM), just the `docker-compose up` takes a few seconds. Response time-wise, it is fine. Plus, I'm using the Synology reverse proxy, so that one takes care of a few things too.
Of course, Core-i5/i7 will beat Atom-based NAS; but HA doesn't really need that.