This makes sense since it wasn't trained on the private codebase but not using existing helpers, naming, abstractions makes the results largely useless since only a minority of output is useful. Like the author mentions what these tools do with the input is a gray area and nobody wants to publicize their code through chatbots. It'd be cool if there was a selfhosted alternative out there, trainable on private codebases.
I've also tried using the bots for answering questions about tech problems I've been having. Answers are mostly off point, have a lot of nonrelated info and most importantly are generated slowly. In the time I get an answer from a chatbot I can scan through a dozen Stack Overflow pages.
As far as I'm concerned we're not there yet but never say never.