Yes, the main factors are exactly the one's i've listed above. For example by skipping the hyperscalers where you get your bare metal you get the biggest bang for buck in cost. AWS has 80-90% margins, so you gotta rent the bare metal directly.

The second big lever is being able to place the pods on hosts with enough CPU/RAM capacity as they awake. Agentic workflows are spiky which means not everyone is going to use all of the cores and RAM all the time, which allows you to play with the placement, and then there's some minor optimizations you can do as you dive deeper.