The linked article breaks it down. The measured false positive rate is essentially 0 in this small study.
I know that's what they wrote, but I heavily disagree. It got 28/30 (93%) correct, but out of the two it got "wrong":
- one was just straight up not rated because the file format was odd or something
- the other got rated as 11% AI-written, which imo is very low. I think teachers would consider this as "human-written", as when I was being evaluated with Turnitin that percentage of "plagiarism" detected would have simply been ignored.
The linked article analyzes their data into more detail. In particular, the measured false positive rate is essentially 0 in this small study.
The false positive rate is 0. The tool *never* says human writing is AI.
That cannot be true as it would be easy for a human to write in the style of AI, if they choose to. Whoever is making that claim is lying, because money...
> That cannot be true as it would be easy for a human to write in the style of AI, if they choose to.
Is that the nightmare scenario that everybody in this thread is freaking out about?
Students who go to great effort to deliberately try to make it look like they are cheating, they're the ones you're afraid of being falsely accused of cheating?
We're on our way to dystopia because people who go out of their way to look suspicious on purpose, arouse suspicion?
It is very common in academic investigations to achieve results with more than 95% accuracy, let alone 90%, when in the real world the same AI tools fail miserably.
So, yes, this is the nightmare scenario that I am afraid of where a simplistic "investigation" will be used to justify the use of unproven AI tools with real life consequences to people.
This isn't zoolander math. or is it.
I mean, the solution is just in-class-only essays, right? Or to stop with the weird obsession with testing and just focus on actually teaching.
They failing exams because they don't do the work is on them.
The better way to use ai is to get it to teach you to write the essay better and faster each time so it remains your voice and starts with how you write already and develop it from there.
Everyone generally speaks and writes different enough like a gait. Ai erases that both directly and indirectly.
People who think they’re clever with ai but won’t spend time developing any actual skills will always get exposed eventually.
Colleges are introducing rules that if they can detect AI after you graduate they will cancel your degree. Fun watches on YouTube showing it.
Have fun!