IncusOS is amazing. Since K8s envelopes my day job, I rarely get to test out things like this. If cloud on-prem continues taking off the way it has in the last year, this sort of deployment will be ideal.
Also, I loathe Proxmox. With Proxmox, you are one bad upgrade away from disaster at every turn.
Talos is another good look. I haven’t checked incus specifically, but Talos is a beautiful immutable OS for building a k8s cluster. Subs in for ProxMox if you don’t need VMs or Pi’s on the homelab.
I think you're confusing this. Talos is kubernetes. It can only be as good or as bad as Kubernetes. This is different. A complete rethink of immutable infrastructure with a decade of additional hindsight. I switched from Talos to OKD. I honestly don't miss Talos, but would like to be done with k8s altogether.
Re-reading your comment, realize I’d missed your point. You’re right, I’ll take a look at Incus. I also appreciate the pointer to OKD - until the future arrives, it’s nice to have a more pleasant present, too.
Or is it? Talos is coming up with Talos hypervisor in December.
Thank you for this writeup, I think your setup deserves another writeup, but form the sre/gitops perspective. I've been thinking about building something similar, but using the lighthouse patter. One git repository on GitHub or gitea to prop up origin-vps(forgejo+harbor+warpgate+headscale), which will serve as the source of truth for infrastructure at any given site.
I've used Incus, but not Incus OS. Sounds pretty appealing though - immutable OS, A/B updates & very locked down.
The name “data swamp” just absolutely got me. I love it.