Opensource also means do it yourself and most businesses don't have time or expertise to do that, but this very issue creates a market for 3rd party providers that use open models to compete against Anthropic. So hardware and compute availability becomes somewhat of a moat.
The business feels like like web hosting before cloud computing. Web hosting in itself does not really have a moat, but than again AWS appeared with their abstractions created lock-in and network effects and disrupted the hosting industry.