I discuss this topic briefly in a post I recently made where I call it "decorative knowledge" and try to pinpoint exactly what GPT is doing and fails to do.

https://buildingbetterteams.de/profiles/brian-graham/navigat...