The real reason for this shift is that kubernetes moved to containerd which they cannot handle. Docker was much easier. Differential workloads is not correct to blame.

Also, there is a long tail of issues to be fixed if you do it with Kubernetes.

Kubernetes does not just give you scaling, it gives you many things: run on any architecture, be close to your deployment etc.