The idea of injecting domain knowledge into LLMs can certainly help, but they don't fix the problem entirely. There are still plenty of opportunities to hallucinate - for example, ChatGPT still regards the phrase "LLM" to refer to a law degree, and domain knowledge won't fix that unless it is explicitly spelled out in the prompt. This article is provides a similar overview: https://zilliz.com/blog/ChatGPT-VectorDB-Prompt-as-code (I work at Zilliz).