Good question! It mostly doesn’t concern me. I believe these models have a huge “latent space,” so it’s not surprising to me that other people, with the right harnesses and prompts, can get them to produce more-valuable content.
I spent a lot of time calibrating how I use these models to produce valuable, good code, right?
But as I alluded with my question above, I haven’t seen a ton of evidence that these models have human-level argumentation in that latent space. If my assumption there is wrong, then yes, I’d have to reexamine my understanding of these models.