Can you think of any category of software that doesn't eventually have an open source alternative? There are many open source projects orders of magnitude more complicated than a LLM. The linux kernel, Blender, Firefox, etc.
These LLMs aren't inherently complicated to implement, just expensive to train. And if the LLaMA release/leak is anything to go by we are extremely close to ChatGPT running on consumer hardware.