"You have a 27% 'AI' issue in here"
twitter.com
twitter.com
ChatGPT could have the exact same set of questions to ask. All students are independently taking the same exam at the same time, responding conversationally. ChatGPT asks all of them the same question, and then probes based on weaknesses in the responses. Grades the answer to that question, then moves on to the next.
Everyone got equal questions. Is there going to be inconsistency in how minor wording trips different followups? Sure. But it isn't clear that this randomness is worse than the subjective differences in how humans grade an essay response to a question.
If you give a pre-written test, you basically need to curve it because you don't really know how well the test aligns with your expectations of the class's understanding of the material. So you say "typically, about 20% of the class doesn't understand the course at all, 20% have a very good grasp..." etc, and then fit the written test results to the expected curve.
A one-on-one communication with a student allows you to directly gauge their understanding, allowing you to assign a grade. It doesn't matter how well or poorly the rest of the class understands the material, this student, sitting in front of me, has a "B" level understanding.
We should not encourage stack ranking (or a curve) as a way to stratify students because they joined the class with too many smarter people. Go read up about stack ranking, and why it's a horrific practice.
In a "grade on a curve" situation, it benefits you to drop the class if there's too many people you think smarter or more experienced than you. And it benefits you if you're smarter than them. And, thats a REALLY UGLY way to approach education.
Not the LLM part though.
Not only do you get a good sense of what they know, but you get a chance to give real individual feedback about what they need to focus on next.
Of course towards the end in order to get a qualification that a university will accept as entrance we will need to teach the kids to pass the standardised tests too.
Fight fire with fire.
I've actually tested this with a VR app (with support for mobile also), and it actually works quite well.
I dunno about that level of automation. Maybe the proctors can use it to generate a big bag of questions beforehand, that they manually review, but generating them on the fly is just asking for trouble.
Administering the preset questions and responding to the student is a much better fit.
It's bad enough that these things don't do a good job, don't basically function for the task, but what's as bad or worse is being forced to pretend you buy into it all like having to pretend to believe in some religion just to not get killed by everyone else.
I'm not a student and so far I have been free to judge all these ais as bad on a variety of fronts, and not use them (directly anyway, of course they are used behind the scenes in ways that affect me which I can't control). This would be hell.
There haven’t been technological advances in education that have overwhelmed the student teacher ratio in terms of effectiveness.
On some level we just have to accept this.
I actively remind my students this when I teach, who honestly are less active post pandemic. It is something I worry about. And though my account is "anonymous", if you ever show up to my lectures, not as a student but just sitting in (I don't take attendance, idk if you walk off the street and want to sit in), you too are welcome to participate.
(Fwiw, there aren't really "PhD level lectures" so much as graduate lectures. Generally you stop taking classes at the end of year 2 in your PhD, which is equivalent to a masters. The distinction of the PhD is that you are learning to learn on your own. This does add extra context to why grad students ask for higher pay, especially at the non-conditional and candidate levels, as they're actually taking less resources from the school. E.g. I pay the school $10k/term (big round) for research credits, which requires no involvement from anyone. There no longer is the "student" part to my "51% student, 49% employee" split)
Good on you for allowing auditing. I had only one teacher in college who allowed people to audit my classes and he even fought the administration to give me credit for the class after I sheepishly approached him and asked if he would mind letting me taking the exam to make sure I understood the material. One of the most insightful classes I took my entire time in college
(Now, I grant you, in a room of 300, interaction is severely limited. I'm lucky my classes tend to have fewer than 20 people.)
If I give a lecture that you could have just watched a video of, I fell short.
It's tough to get right. I'm still working on it.
A well designed class session can be (can be) similar in that it provides a space and guidance for you to do 60 minutes of improving your brain, that let's be honest, you would otherwise half-ass at home. (Of course, the classroom is only part of what you're paying for, there are also assignments, feedback, etc.)
Absolutely. Even in the largest lectures, people can ask clarifying questions, live, from the subject matter expert. Likewise, the professor can look at the students' body language and realize that they've lost a significant portion of the class, and stop, slow down, and maybe prompt the class for questions.
There is an art to a good lecture, and it's definitely harder the larger the class, but good lectures cannot be replaced by recordings.
1. Real life lecturer that can be asked questions
2. Peers that you can meet and discuss both study-related and unrelated topics.
3. Language. Not relevant for intros, but advanced topics can be explained in more than one way, and as a student you not necessarily will be able to map between them.
4. Schedule. Self-pacing 6 different classes for 12 weeks may be harder than it looks. Instead, you can just attend classes.
5. Advanced topics. Online resources, especially videos become scarcer as you advance in your studies, more so if you are not in hot topic (e.g., CS). I still have some notes from classes I took as undergrad as a best source for the learned topics. Good luck finding video lectures about diagrammatic approach to real time dynamics of open spin systems.
Same goes the other way around, sometimes attending class is just not worth it, even without tons of online courses. I learned my E&M by just reading the official book during the lecture time (see 4.).
I've studied in the UK and EU, and I don't think I've ever been in a class larger than 40.
Smaller schools and upper level classes generally just have fewer people.
Edit: Keep in mind that teaching is something the professor usually just puts up with, to get the resources and credibility to do the thing they are really passionate about (research or writing).
Note that the above only applies if the class is supposed to be a lecture. If it is supposed to be interactive then small classes are better. However many of the basic undergrad 1st year courses have been done so often the professor should already answer all possible questions if you keep listening. As you advance that becomes less and less true of course.
The professor hate teaching those classes, students hate attending them and as a result half the people will drop out before they get to experience the real classes.
Well that's easy: An AI will administer the oral exam and transcribe the oral answers from each person simultaneously, and possibly even grade it!
Where is everyone?
And it is going to get far, far worse.
Get used to it. The emerging model is a virtual vending machine - if what you want isn't there, tough. If the machine breaks, well, sorry about your dollar, maybe it'll work next week.
If you want to talk to a human, start by getting rich. That costs extra.
That should have freed up lots of people to handle the special cases that fall through the cracks of the automation, but they're nowhere to be found.
1. Demographic changes means more retirees, and smaller workforce. Literally less people to go around.
2. With low unemployment, everyone’s doing something else. Something harder to automate, or otherwise more valuable. It’s not like people are sitting around unemployed (except retirees).
What are they doing? It’s hard to know without combing through data in this moment, but people are surely avoiding minimum wage and low skill customer service jobs if alternatives exist in their area. Anecdotally, I hear people don’t like working in anything customer facing due to rude customers. I know someone in TX working at Amazon warehouses at an hourly rate much higher than retail workers rate. They used to work at a gym in rural California.
Until we get rising low-skill immigration to cover more of the low-wage work, expect service work to be understaffed. Or rising birth rates, or a drop in white collar workers.
You also cannot trust the Department Of Labor's official statistics by themselves since there's multiple ways that the U.S. government covers up actual unemployment numbers. For example stay at home parents aren't included in the unemployment statistic even if they worked previous to that situation. People who have been unemployed for more than a year are not included. People on disability but who are in an employable state are not included. Gig workers such as GrubHub drivers are not included. Certain methods of self-employment such as traveling musicians are are not included. They pulled this trick a decade ago and they're doing it again to try and prevent another panic. The one difference this time is that instead of people losing a single full-time job like they did in 2008, many are now working multiple part-times and thus inflating the employment statistic slightly since technically they're never unemployed.
Then there's the gap that happens for employees. If someone has a part-time job and gets scheduled from noon to nine for closing back to back for four days and then gets nothing for the next three days that means they're not getting paid the equivalent of a full-time job despite possibly working just as many if not more hours. When you have lulls like this you need a second part-time job to fill them in, leading to things like ten percent of the current counted national workforce having at least two jobs. But many part-time jobs in retail and services want to monopolize the person's time since scheduling is based on the employer's availability and not the employee's, meaning that sometimes the employee will have to purposely dedicate days of their week to waiting in case either job calls them in. If the person doesn't have a free day and are called in while working one of their two jobs, they may be fired from the other job. When enough places and people have an incongruent schedule like this places run short staffed and the person is still wasting a day or maybe more idle. Then there's the other half of that coin of scheduling abuse, the supposed part-time job that uses that flexible scheduling to transform into a full-time job. I know that Wal-Mart will schedule you for no more than thirty hours a week and will stack your shifts back to back, sometimes with as little as eight hours in-between, just so they have enough leftover hours in your schedule that they can call you back to cover someone without pushing you into full-time or paying overtime. This makes working for Wal-Mart hell because you're rushed and then all but told to be on standby, giving you very little time for things like other jobs, appointments, household chores, and even self care. The end result of being yanked between two part-times or being held hostage by a full-time masquerading as a part-time is that eventually the potential employee gets cynical and stops applying for that kind of work entirely.
Yep, let's just exclude all the people who tell the real story here.
Every gen-z in my family (and neighbors!) also have 18-21 year-olds who are doing weird shit like working for two days up to a max of two weeks, then abandoning the job. I don't know what this is about ("working" once per quarter to get the work credits for Social Security?) or how this is captured by the stats, but they are by no means employed.
A small point, but I think what you meant to say here is that there's a greater ratio of retired to employed people than there used to be, which is somewhat different than what you stated.
That said, I think this idea that we necessarily need some incredible amount of low-skill immigration to cover some drastic understaffing is bullshit propaganda put out to achieve bad wages and treatment of workers through basic supply and demand (drastically increasing the supply of labor). Technical innovations such as self-checkout lines and great security cameras and other tools of the modern age mean that you need fewer workers to do the same work.
As I think others have pointed out, the unemployment rate figures can be massaged in a lot of ways to be misleading. Actual wages should be the stat that tells you whether or not the workforce is too small. If wages are dropping or stagnant versus inflation, then claims of low unemployment should be considered laughable because otherwise wages would be increasing.
But you can do an oral exam along the lines of "explain to me how your project works" and that'll catch people who don't understand it regardless of whether or not they know the question in advance.
For how much schools talk about how useful handwriting is at memorisation and such - I seldom see anybody in the working world pulling out some paper and handwriting notes. Schools seem to care more about teaching you to pass closed-book tests than they do about teaching you useful skills like how to create high quality, organised, and searchable notes.
Having locked down thin-clients does not scale well enough to these sizes. Specially when there is usually multiple concurrent exams running at same time. On small scale it could be solution. A screen, keyboard and mouse with locked down thin client and simple editor.
An oral exam isn’t the same as reading a written exam out loud. There are a set of learning outcomes defined in the syllabus. The examiner uses the learning outcomes to ask probing questions that start a conversation - emphasis on conversation. A conversation can’t be faked. A simple follow up question can reveal a student only has a shallow understanding of material. Or, the student could remember everything they’ve been told, but fail to make connections between learning outcomes. You can’t cram for an oral exam. You have to digest the course material and think about what things mean in context.
After all, students know what to expect on standardized tests. Some still do better than others :-).
It can. An examiner questions are gonna be parsed via covert Voice recognition,processed by ai and replies played back via a e. g. small headset(a magnet inside an ear cavity, accompanied by an induction loop wire around the neck(works fine,google "микронаушник магнит" in russian, it's popular here) , and it's not as hard as you may think.
So I don't see a problem with telling "what to expect", but I do see a problem with 1 professor and one censor examining 300 students for for 30 minutes each.
It's would be funny, if it also wasn't so sad, that the point is that the students need to prove that they did the work, while shitty software can flag their work as being plagiarism or AI generated while providing no proof.
We train children and up to adulthood that encroaching on time for self is acceptable, and its absolutely not. I remember asshole teachers giving out essay homeworks during christmas breaks and similar, because "we needed to be busy".
No wonder why wage theft is the biggest retail theft we have - those utter lack of boundaries are eroded the moment we set foot in schools.
https://www.cbsnews.com/news/owed-employers-face-little-acco...
you are also missing one important aspect: work is usually 40 hours a week. full time study should be 40 hours too. but at least where i come from, you generally have less than 20 hours of lectures and TA meetings, etc. so you are absolutely expected to spend the other 20 hours in your room or in the library working on assignments. that is not encroaching on your time.
there is only a problem if you spend more time on assignments causing you to work/study more than 40 hours in a week
It was just easier to do the test honestly, and lick your wounds later.
Next week I had a dozen more missing assignments than usual, went to the professor asking "hey, why did a quarter of the class not turn in their assignments this week?", and they replied that the students had been served an ultimatum: Drop engineering, go transfer somewhere else in shame, or get hit with an academic dishonesty inquiry, which could carry much stiffer sentences.
They all took the former. The theory was that students cheat because they're either unwilling or unable to engage with the material, which means they're not cut out for engineering.
When I was a student decades ago it was when they first introduced anti-plagiarism software. We all had to submit a printed out copy of our book reports along with a floppy disk or cd-rom of our report in the latest Microsoft Word format. Almost the whole class was flagged for plagiarism. Of course the school takes plagiarism very seriously so we all had to have a one-on-one with the principal. The real truth is no one copied each others work and it was the anti-plagiarism software flagging essays because students quoted parts of the book and expanded on that. In hindsight as an adult I think the excessive principal one-on-ones was the teachers way of shoving it to him and his new software.
This teacher should have thought "hmm, well if I'm going to pull up students on this then it's probably important I do my own research to make sure that I know that the score means and how reliable it is" but nope.
"LLMs are bad cause people will use them to generate spam and fake news!" LLMs aren't the bad actor there...it's the human doing the spamming.
There is a fine line, though. For example the "guns don't kill people argument" is pretty moot, gun control saves lives. If someone grabs an LLM, tells it to "generate text telling young impressionable teens to kill themselves" and spam it on Twitter...well the human is doing bad stuff but they're still enabled by the LLM. However it's easy to enact something like gun control on a physical object. Software? Well, damn that's gonna a problem - especially when the metric by which these LLMs "do better" is how closely the text resembles a hooman.
Worksheets and exams can show how familiar you are with the material, or they can be gamed or useless in some other way. But the best they can ever do is show familiarity.
What I really want as a consumer of someone's grade or academic history is how well they WORK in the subject area, along with how well they work with other people, not just a score that may correlate with regurgitation of facts.
I feel cheated by my school years, because I was led to believe that regurgitation of facts is very important. I also feel like this previous comment will be very emotional for some people.
Lab work is probably the biggest exception, in that you tend to need to apply some practical knowledge, but even then I found TAs were very willing to hold your hand through it if you at least demonstrated you had reviewed and memorized any prep materials.
Which school is that?
I guess that's probably true of primary or middle / lower secondary school, but I don't feel like regurgitation of facts was particularly endorsed in my experience at upper secondary level, let alone at university level.
There might of course be quite a bit of variation between countries, schools and even individual teachers in this.
In my high school experience, most classes could be aced through rote regurgitation of facts.
Math class required another step - identification of which category of problem you have, and rote application of one of a few pre-calc/calc algorithms.
There were definitely people in my uni course who got worse grades, but who had a better understanding of the material.
The problem is that by the time someone gets to graduate level courses, their mode of thinking has been set.
He graded assignments and exams, out of a courtesy to those who needed a numeric style of feedback, but there was no set way to translate your total scores on assignments into your final grade in the course.
Exams would be, in a word, brutal, in that no one was expected to ace them, or even complete them. What he wanted to see was that you'd be able to apply the course material to novel situations. He'd meet with every student during the course of longer term projects, just to get some insight into their work.
Ultimately, it wouldn't have scaled well beyond the 50-odd of us were in his course, but it was certainly AI proof.
At the time, I thoroughly enjoyed it because it drove the kids who were hyper-fixated on grades and point grubbing up a wall. Looking back, it was the best teaching style I ever experienced.
This is fine--until the professor doesn't like you, personally.
You would have to give students much more flexibility to drop courses (basically up to almost the end of class) to avoid the social failure scenarios.
That’s why I really like that you included how well they work with others.
Personally, I never felt like school was about memorizing facts (maybe some history classes…), but I also had two parents with advanced degrees who repeatedly told me that school was about learning to think and learning to learn (and learning to time manage). I feel like the vocational focus a lot of people have on education really hurts some fields of study - the humanities gets a lot of hate both on HN and in the media.
Ideally, classes with projects and essays should push people to think and show understanding of the subject not facts, like you said. The infinitely mocked “why did the author say the curtains were green” tropes actually show this - understanding why authors use certain imagery requires understanding intent, historic context, deeper understanding, etc. especially when applied to new works. I think people like cut and dry fact memorization and objective grading, and this doesn’t fit that cleanly.
> how well they WORK in the subject area
I don't mean 'perform in a paid job', I mean 'take productive steps'. So even if you're just noodling around having fun with a musical instrument, you can be working, if you're improving your control and understanding. Messing around without a productive aim can still be very productive.
There's not a lot of value in using AI for targeted tasks like a school essay. Nor is there much value in getting a grade for a targeted task like an essay (not only would the grade be high-noise and low-signal, it also has a tiny or non-existent practical effect).
I wonder if these AI tools will to some extent highlight the meaningless fluff (crust?) that vestigially hangs around. If our current incarnation of task-oriented AI is really good at some particular thing, and we humans readily hand that thing over to AI without regret/loss, what are the chances that that thing really mattered in the first place?
(Note that this is not to hypothesize that all things AI does are non-important.)
I personally believe that we have a weak grasp on the things we do that don't matter. We do a lot of things because we have always done them, and some of these have not been adequately questioned in years/decades. So any indication of what's important or not is very helpful.
(I'm aware my circumstances are unique – maybe for some grades in school have had a significant influence in their lives – I personally have not witnessed this, in myself or others.)
It was rejected on my initial submission because the reviewers felt I it wasn’t written by a sophomore in HS.
My parents rewrote the entire thing in what they described as “baby talk” and it was then accepted. The irony is not lost on me to this day.
This is nothing new; it’s been happening forever and will continue to happen, we just have a new reason to drive a race to the bottom.
I hate the world we live in.
If they don't trust an Eagle candidate's attestation of authorship, they probably shouldn't have let (or been the ones to let) the candidate progress that far.
But, as the parent of an Eagle scout, I think my point still stands. Either they can, or can't, trust the Eagle to be honest.
IMHO, that trust should be a necessary condition for awarding Eagle.
And if the council isn't capable of making that call, then they're perhaps unqualified for deciding whether or not to award Eagle rank.
(I realize my position is a bit simplistic. I paired it down for brevity.)
a lot of merit badge work is based on trust. it should not be to hard to ask a few questions about the work done to be able to judge if it was really done.
most of this should be in the control of the scout masters. if they can't trust their scouts to be honest about this and work out a compromise then their troop has a real problem
As it relates to academia today, this is now happening at a larger scale with folks lacking more trust, not having to think critically about the individual, and applying a similar outcome based on this. This all goes back to critical thought, understanding your audience, and using tools/knowledge in a way it shouldn't be used; it's just now being used more often and with less control than ever.
To address your specific comment that those folks may not have been qualified to assess scouts attempting to obtain Eagle, I cannot speak to that, but at the face of it, it would absolutely seem they were definitely not exposed to enough quality writing nor did they have the wherewithal to make decisions at the level they were tasked. Working in the business world, I am continually faced with a wide swath of college-educated adults who simply are unable to write coherently, so none of it surprises me today, but it certainly did when I was 15-16 and thought adults were more capable than actually were/are.
I still hate the world.
I actually think scale is part of the problem here. In small communities there is more natural nuance and correction as there's high accountability. But with scale accountability often disappear as you disappear into the crowd. And you'll always be able to point at winners and losers to whichever noise you favor. The problem is we're not looking at things holistically and ensuring that our metrics are aligned with our desired outcomes. Instead we often pick a metric because it reasonably looks like it should align with the desired outcome (not proven, just intuited) and then just tell anyone that disagrees that it is obvious instead of acknowledging the downsides. Every metric has limitations. Ignoring them is the problem.
A scout is _____
(∩ ⌣̀_⌣́)
The joke about the pinewood derby was that you could always tell the one kid who actually built his own car (which was the whole point, after all). Because every other car had been carefully engineered, carved, machined, sanded, painted, lacquered, and weighted by a dad.
Sounds like you had the honor of being in the only scout troupe that at least tried to keep this kind of thing from happening. And your singular false positive seems to have somehow projected itself onto the world.
The only thing more mundane and unimaginative than that two pages was my teacher, who accused me of plagiarizing it.
in a way it's a compliment that your teacher thought the story was so good, that they didn't believe it was your own.
i have had this happen in sports. i was not very sportive and tended to pick easier activities when there was a choice. there was this school sports day where the whole school was doing activities outside, and one of those activities was running for half an hour, one hour or two hours. usually i'd pick the half hour to be done with it, but this one day, my brother, a few friends and me decided to run in a group and do the two hours.
doing things in a group can be a lot easier as everyone encouraged each other. we also didn't race but it was a relaxed slow jog.
at the end we would get a pass indicating that we had completed the activity. when i showed that to my teacher, he didn't believe me.
there was no consequence of that, but if necessary i would have had three witnesses.
in hindsight the disappointment was that the teacher did not understand or recognize my capacity. i don't think he knew that i had been biking for hundreds or even thousands of km during school holidays.
Isn't there a merit badge or something in Optimistic Can-Do American Spirit? :)
> My parents rewrote the entire thing in what they described as “baby talk” and it was then accepted. The irony is not lost on me to this day.
If you could do it over, would you let yourself be pressured into ironically submitting something that your parents wrote?
Also, do you think whomever rejected your initial writeup did so because they didn't think you did it yourself? Or more like they thought you did it, but they wanted a more stereotypical youth style, maybe because they thought it was more the intent of the exercise? Or maybe for optics reasons, so that it looked like the image people have of a Scout, when upper officials and donors read it?
In my country's equivalent to the UK sixth form or later US high school years (ages ~16 to ~18), I once forgot an English as a foreign language essay assignment until late in the evening before the deadline.
Being a somewhat lazy and absent-minded teenager, by then I had also completely forgotten what exactly the assignment was or what I was supposed to be writing about. So I wrote some kind of a bleeding heart piece about the prevalence of violence and war in the world or whatnot.
I was quite pleased with it. Of course it was probably naive teenager stuff, exactly the kind you'd think is pretty smart when you're in high school, but I felt good about it at the time. I also felt the English was pretty good, which of course was the point of the assignment. And I pulled it off in some kind of a flow state I conjured up at the last moment.
The teacher didn't think I had written it. She asked me if I had got the text from some IT firm or something. (This was around the dotcom boom, and I probably seemed like an obvious nerd. Those local dotcom firms had the image of being at the forefront of internationalization and anglicization. I still don't know why she'd think IT firms would make a point of writing high school English essays for nerds.)
It was my mistake, of course, and I understand her suspicion because I turned in something that didn't conform to the specific assignment at all. It's different than submitting work that is actually what was asked for and being rejected for doing it too well. But I did honestly feel a bit bitter about it nevertheless. And possibly a little proud.
Something I remember from a previous discussion around this topic was writing everything in e.g., Google Docs, where there are captured versions every few seconds. The idea being that the version log shows that one did not copy-and-paste larger chunks of the text.
Most laptops can handle this pretty effortlessly with their encode blocks.
At some level, there has to be some trust, or a system (e.g., in person proctored exams) would have to be used instead.
Just in-person exams, right?
AI detectors don't work.
If there aren't any other tools and methods that do detect AI, that genuinely stinks, it's a difficult problem. I definitely sympathize. But all the sympathizing in the world won't change the fact that AI detectors don't work. There are lots of unsolved problems in the world, and they don't justify putting weight behind non-solutions.
I don't know how to cure Alzheimer's disease, but I know that a TV healer can't cure it, and if doctors started prescribing TV healers it would be medical malpractice. Similarly, I don't know how to tell if an essay was AI written... but neither do the AI detectors, and it is unethical for professors to rely on them to make decisions about plagiarism.
When you have an unsolved problem and someone proposes a bad solution with bad consequences, what you end up with is the same unsolved problem, still unsolved, plus a newly created additional problem on top of it from your bad solution. You started with the problem of rampant plagiarism and cheating, now you have both a problem with rampant plagiarism and cheating, and a new problem with making baseless accusations of cheating against potentially honest students with no real evidence.
How do you verify these "different checkers" aren't all going to the same api or using the same software? How do you know they aren't using a similar heuristic method? What is the false positive rate of each? Have you seen the research that shows text from non-native speakers are more often falsely detected as being AI[1]?
"They don't predict the future."
"I know their predictions are statistically quite bad, so I used a magic 8 ball three times to make sure there wasn't any doubt."
----
How much allure for these products is there that a college professor can be on HN, know that the tools don't work, and still use them anyway?
And how are students supposed to combat that kind of misuse if even educating professors about the problem isn't enough to make them stop trusting the detectors? And for a professor to then to brag about it on HN that they're being responsible as if they expect to be praised for it?
It's just so frustrating to read... What do you do if you're a student in that situation, do you have to sit your professor down and not only show that the tools have problems but also explain the concept of correlated error?
I kind of feel like the only way this changes is with legal challenges to colleges until they eventually ban the tools from being used in grading. Public pushback isn't going to change it, schools aren't going to care about that. And if educating about the problems isn't going to change behavior, I can't expect students to walk every one of their professors through a stats class. I don't know what if any legal rights at all students actually have in these situations, I'm guessing most colleges have boilerplate that if they decide to randomly fail you tough luck.
But at the very least, @jccalhoun you should stop using these programs yourself; you have the individual ability to make your own classroom better, and you should.
jfc education is dead
Also plagarism and having other people do your work, or even take exams for you is as old as time. How is AI any different? Some trust is in order here. The students are the ones paying to be educated, if they cheat they are only cheating themselves anyways.
I've heard people say this a lot. It's a very old-school liberal arts perspective that doesn't fit with the modern world. In practice, for most students, education is a third-place benefit of university behind 1. the certificate and 2. networking.
The rest of us might too, if we expect "I have a degree in X from Y university" to imply some level of competence.
And yes, there are a lot of people who would like to outsource questions of competence to, "Do you have the credentials that I am looking for?" Any cynicism about the competence of people who do this is fully justified. But conversely, it isn't the worst approach to take to evaluating people when you personally lack competence.
As an example, I would never hire a programmer based on credentials. But it is often the first and only thing that I look for in a random doctor visit.
These are all things I can't personally judge competence in, because I'm not competent in medicine, psychology, engineering, etc. The most reasonable way for me to judge competence is whether an accredited school vouches for them via a degree.
If they're at another firm... Yes! My company of people who actually know the stuff the certificates say they know will run circles around them in the market.
But if we're talking someone the company just hired who is now my responsibility... Not so much.
I told my kids that a large state university is like a tiny elite academy, hidden in plain sight within a giant party school.
Don't get me wrong, I know many people had bad college experiences, and that higher education is ripe for reform.
I suspect that advanced hunter-gatherer and early agricultural societies viewed education more as purely motivated by culture: basic useful life skills can be passed on informally within communities or families (so formal education is not strictly necessary for survival), and typical tasks would unlikely to be a risk to others if done incorrectly (making certificates valueless).
However, the modern Western university could arguably originate from the Church (and Jewish institutions before that), in which the education would surely have been considered necessary to correctly interpret texts. In that context, the certificate is a reassurance to the general, uneducated public that they are being led by qualified spiritual leaders (the clergy).
Once you get to the Renaissance and towards the Enlightenment era, it seems as if the increasingly secular focus of education yet again reduces the necessity of certificates and makes broad, 'polymathematic' science and culture more important. The certificates only become important in secular life again once the apprenticeship system breaks down in the late 19th century.
Finally, the idea of a 'liberal arts' course seems to be a reaction to keep the spirit of the Enlightenment alive despite ubiquitous industrialisation, so in this light is both an old school and a new school of though, depending on how you look at it!
These are my thoughts from a very British perspective, so I would be curious to know whether that fits with views from other cultures, such as East Asian or predominantly Catholic ones.
It’s more likely in a liberal art you can fluff your way through life living a continuous con. But heres the thing - they still are cheating themselves. Because the only thing a certificate and a network based on lies gives you is hollow employment built on lies. The education is what gives you a career and a life worth living.
So, maybe that’s old school, but I’ve rarely found old school wisdom to be wrong. It has, after all, withstood the filter of time.
What a great way to respond. I couldn’t agree more.
Even on the job people can often get away with not providing much value if they have a bad/apathetic/misaligned manager.
The problem is the cheater will then enter into society and tell people "I'm a graduate of $prestigious_university".
At that point they are cheating society.
Would you want to work with people who cheated? Would you want your doctor to be someone who cheated?
If people are going to cheat themselves out of an education, and then cheat at a job... ultimately they will be 'found out' for not doing their job properly. Unless there is absolutely no objective way to evaluate, measure, or observe job performance, in which case the job is probably nonsense anyway and cheating doesn't matter.
Why would I care if I work with people who cheated at college? I work for a business that constantly cheats me, my coworkers, its customers, its suppliers, the government, and innocent people with no formal affiliation to the business at all. This is what businesses exist to do. The only people a business theoretically exists NOT to cheat is its investors, and their empirical record there is mixed at best.
I'm not in any position to evaluate if a doctor is doing a good job or not (almost nobody is, not even doctors themselves), but in principle I am not opposed to their cheating if it doesn't affect my "care" (i.e. my family doctor cheating on some exam about the esoterica of podiatry or some other specialty they would normally just refer me for).
If anything, the new generation of AI tools should reduce the false positives. As another commenter here noted, even humans weren't perfect at this task. We've never been able to reduce the false positives to zero.
Meanwhile, you owe your lawyer $350 for your initial consultation.
Does the Code of Student Conduct say that plagiarism is bad? Or does it say that some secret program will assess the paper and be the sole judge of plagiarism? I'm guessing it's not the latter.
Personally, I would stand my ground and tell the professor straight up, "I'm not writing it again, I've written it once." Leave them with the understanding of the hell to be paid for accusing me falsely.
When I didn't do the work, I accepted the bad grades -- I didn't cheat. When I do the work, they will accept it, or we'll hash it out to the end of the earth.
That isn't done by looking for plagiarism, they're building snake oil models trained on GPT output.
You can disclaim negligence, but you can’t disclaim malice or recklessness. You might find that this contract is not worth very much, depending on the facts of exactly how stupid this software is and how hard the school tried to find out whether it was stupid or not.
Anecdotes I've heard put the new "AI detecting AI-written"'s accuracy at worse than a coin flip.
A school can assign whatever score they want to an assignment, just as you can leave whatever review you want to a product.
In the real world, defamation must include communication to a third party. Schools do not communicate grades to third parties (unless you explicitly instruct them to).
If anything, leading a bad product review would be closer to "defamation" than this example.
If a class is graded on a bell curve then kids who cheat are cheating their classmates who don't.
We regularly organise in person face to face practical exams for our entire several hundred strong year group of undergraduates. It is possible to do assessment properly if the will is there.
Doing practicals seems good, and I think proctored examinations can add objectivity too.
I tried to get students to critique things, but even then you can put in the text to critique to a LLM with a long enough context, and the LLM will kick off with a passable critique, if you iterate with it enough.
So, even though they'll never get a top mark, they will still be able to get through the assessment. So I don't set essays any more.
We started a petition and asked for signatures at the on-campus cafe.
After a few days, the administrators asked us into their office for a chat. They asked us stupid questions and tried to talk us out of our petition. When it didn't work, they eventually caved and didn't do the carpet that year.
They waited for the next year. Then a couple years later, they put back the tile.
I don't know why they were so scared of our petition, but I'm sure this is another situation that could benefit from one. It sends a very clear message about the situation to people very high up in the food chain. And I'm sure it could get a ton of signatures.
I mean, why change the flooring type at all?
Why was the carpet so important to them?
Basicly, "I'm in charge" outweighs "this is dangerous".
You're absolutely right, and any participants in this market should be looking to maximize their grade per dollar spent.
(What do you think they should be maximizing?)
What happens when you have to maximize a function with more than one variable or order?
If I pay someone to check my car, and one day they tell me the windows were too dirty so they couldn't do their usual inspection from the outside... I don't clean the windows so they can continue doing their "inspection" without opening the car. I go elsewhere and report them as the risk to life and property that they are.
At that point, 70% of the hard work is done and you're just regurgitating. Liberal arts is long dead.
To clear a prerequisite requirement for the degree program which I considered a waste of time and money — the forced prerequisite that is.
Why pay to go to school if you're just regurgitating a Wikipedia page? Wikipedia's free.
As for feeling cheated, yeah I do feel cheated considering the astronomical tuition for BS make work prerequisite liberal arts classes. But the income i make nowadays covers it entirely.
And I still learned something since I had to rewrite the Wikipedia article, but believe me there isn't anything to be learned grinding away doing regurgitation research.
For the record, college liberal arts don't teach you how to think, they teach you WHAT to think and if you deviate from that you get a reduced grade.
I wouldn't have qualms cheating my way into a degree program either if the opportunity presented itself. In world of cheats, thiefs, and late stage capitalism the honest man is the fool.
I'm in philosophy and so far no AI has produced a text of interest to me. If it did, then I'd deal with it like with any arguments by colleagues.
This teacher is failing the test.
Time will tell.
Doing trivial things is often the first step in learning how to do non-trivial things. No one has ever needed a five paragraph essay. It's a completely artificial construct that, hopefully, teaches people to structure an essay.
Electronic calculators have existed for decades but we're still teaching kids arithmetic.
I remain unconvinced that it's a worthwhile use of time.
Also, I'd still want a foundation of critical thinking skills to be built inside the brain of the next generation, not outsourced to AI.
If it was completely AI generated without any human intervention, it likely would have been fairly generic / poor writing anyway. At least for the time being, AI is a new tool at our disposal but it's still just a tool, like a calculator or a hammer.
Students should be judged on the merit of the work even if some of the work is AI generated.
Example: no one cares that you wrote 5 pages on To Kill a Mocking Bird. They care that you read the book and thought critically about it. AI allows students to skip the reading and critical thinking portion, which is the most important part.
Ultimately, you could not prevent this timer from being spoofed unless you installed rootkits on the students' computers, and unfortunately (for the security and privacy of students) rootkits are what is often used.
I think the marker could also do with some improvement of their writing style.
For one thing, one AI “detector” will not necessarily return the same result as another.
No it most certainly is not.
Writers have been putting challenges to themselves since writing has existed. Minimize number of words, write without using certain letters, etc. It's fun.
This person (furry?) just chooses to give up at the slightest obstacle.
Why are talking like that to me? Are you responding to someone else?
I literally cannot comprehend how my suggestion that playing with words might be fun could be interpreted as bro-y.
EDIT: Lol I just skimmed your comment history and it's just garbage like this.
Really? You suggest experimentation with fun styles, and you're surprised by a response in a fun style? Bro...
This social media post can also be seen as an attempt to bring attention to the problem. That is not necessarily the same thing as "giving up at the slightest obstacle". It might instead be seen that you disagree with their choice of the front at which to fight.
One of the important adulthood things that many people fail to learn is that they should pick their battles.
This is not, I think, and unreasonable requirement either, we just need a few professors to be hit with large lawsuits arguing torturous interference with employment (since what most people are in college for is a better job anyway).
Fuck, I have to spell out every detail.