> false positive rate of 0.01%
What would be an acceptable false positive rate for something like this to be used at schools and universities?
Like, obviously 0.01% is not acceptable, but what would be?
What would be an acceptable false positive rate for something like this to be used at schools and universities?
Like, obviously 0.01% is not acceptable, but what would be?
However given that we already have professors literally failing people by just pasting and asking chatgpt, I'm not sure I'm comfortable with that.
It needs to be <= 0.01% false positive for each individual author. If it’s just that 0.01% of all tests are false positive, that leaves the possibility than a given individual might have anywhere up to 100% false positives.
You might find for every 10,000 tests you get around 151 targets. For each one individually you can say they probably did it, but cumulatively you can say that one of them is probably innocent.
Consider using two positives. Do schools and universities generate 100,000,000 essays per year? Sure would suck for that innocent person tagged as having a one in a hundred million chance of not being guilty.
No, our justice system is probably not that effective either. But that is also a problem, so why should we create more problems like that instead of fixing the ones that we already have?
TurnItIn specifically is horrible and should have never been a thing
If the tech froze at its current state, this would be useful for schools. You don't need to expel a student right away after finding a match, but it is a strong indication that something is worth looking into.
(If the goal is to make students write essays, theses, etc. without an LLM writing it for them.)
This is one of the "I don't think that this is the path that we should be taking."
When I was in school, my parents would proof read the essays to catch the spelling and grammatical errors that were in what I wrote (Bank Street Writer had a rudimentary spelling checker but that was it - https://en.wikipedia.org/wiki/Bank_Street_Writer ).
While my parents are both native English speakers and college educated, some of my classmates had less involved parents, or parents that didn't have the same degree of proficiency for writing. Did their essays suffer from a lack of parental proof reading?
In the past few months I wrote two short works of fiction as lore for a game that I play. I used ChatGPT to act as an editor for those works looking at it and occasionally prompting it to help refine a passage.
https://chat.openai.com/share/204de7f7-9cd7-4c45-aa2b-556791... for part of the editor session with it.
Having ChatGPT act as an editor (not text editor but as a critique of the text) helped refine the text that I wrote.
Working with ChatGPT as a tool (that is far beyond the red squiggles in a word processor) to help people working with the written word is a good and useful endeavor. This isn't trying to have ChatGPT supplant human creativity but rather help the person communicate more clearly.
---
I am leaving this in an unedited form, but here is this post with ChatGPT as an editor as an example of how I believe students should try to interact with it. https://chat.openai.com/share/d891f9ac-923b-47a8-8de9-ab7301...
Still, there is a reason why calculators are not used since the very first grade -> it makes sense to learn how to do basic calculations without them.