I relied on GPT4 to learn linear algebra. I had a text book and GPT4. One difference is the text book was sometimes wrong (and GPT4 is the one that spotted the error in the book). If it is "bullshit", it's very helpful bullshit.

When I ask GPT4 to write some code to perform a specific task, and it does so, and the code works and correctly performs the task, is that bullshit?

It's true that LLMs are not reliable enough to trust blindly, the same applies to humans.