Just because something is probabilistic in its response doesn't mean it's not useable.

There are many probabilistic algorithms and data structures that we use daily.

Yes, we don't have developed abstractions to integrate an LLM in a programming language, but it doesn't mean no one will make one.