There's also big efficiency increases when batching multiple requests, making clouds inherently more cost effective for normal use cases.

Way better utilization of expensive hardware as well ofc.