LLMs can't generate knowledge - they don't have a concept of truth.

They're very useful for research tasks, however, especially when the application is built to enforce citation behavior