Off the top of my head of what would be required besides just cheap hardware. 1) Cloud like software to manage it or k8s native support. I don't know exactly how that would be done, but the administrative costs of using this hardware can't be so high as to make the cloud a more viable option. 2) Some options for network access. Cloud does not just provide VM's but the underlying reliable network with multiple redundant pipes. Comcast Internet access might be good enough, but some customers might require large redundant pipes. While they might NOT need to solve this themselves, they should make sure that the market does provide solutions that when taken into account, allows for cheaper than cloud solutions. 3) Physical location... same as item 2 but for physical location of the hardware.
I remember back in the day managing colos. It really sucked. It was not just hardware costs that sucked. They should just consider that.