I'm leaning towards just paying for heroku, because it's managed.
CapRover is cool, although at least last time I looked at it, it felt more suitable for personal hosting. In a way it promoted point-and-click interactions over scriptable, CD-type deployments.
It actually offers both point-and-click and CD-type deployments (through webhooks). But yeah, not the most powerful piece if you are looking for CD/CI. Still more than good-enough IMHO.
Caprover is awesome for personal projects, but lack enterprise features.