Stack Overflow Moderators Striking to Stop Garbage AI Content from Flooding Site
vice.com
vice.com
See https://meta.stackexchange.com/a/389812/167145 for starters.
That lowered entry barriers and costs to produce and use ever more complex software. Coupled with ever increasing capacity in compute and storage, greater bandwidth, we have this clouded blob of compute. Large tracts of the working population can't and won't discover what's beyond the interfaces they need to learn to get the job done.
I think the end result is that the overall quality of information and experiences possible in this environment has peaked and will now trend down. And I hope this will lead to people craving and striving for better abstractions, mapped to underlying layers with the least amount of astonishment, as we could hope for back in the day when a local environment and a small body of relatively stable documentation (I wanna say physical book but I understand not everyone prefers that format) were quite sufficient to produce high value software.
If you set it up properly, reputation is very hard to fake. You have to build it over years and you are dependent on other people with good reputations consistently up voting and vouching for your content. Every time you post something, you stake your reputation. AI can generate a lot of content fast; and some of it might even be alright; but unless it builds a reputation over many years, you can trivially detect it as coming from a source without any meaningful reputation. It doesn't matter how good or bad the content is if you slap a giant noob sticker on their account.
All Stackoverflow needs to do is reset people's reputation to -1 if they get caught posting AI content. You don't need any fancy detection algorithms for this. And as the whole site is basically engineered around the concept of reputation, that shouldn't be too hard.
If the site is flooded with AI the content on it is worthless. Just ask ChatGPT...
The quiestion is by inspecting text can one determine if it’s written by a human or llm? Not sure how accurate that would be and we’re back to square spam, now incredibly to eye out as spam but waste good time on broken incorrect information..
With AI generated answers one must take a “don’t trust but verify” approach. And at that point, why use StackOverflow at all?