Show HN: LLM-Powered Infinite Test Prep for SAT, MCAT, LSAT, DMV, GMAT | Hacker News Reader

Show HN: LLM-Powered Infinite Test Prep for SAT, MCAT, LSAT, DMV, GMAT

passmytests.com

2 pointssabrina_ramonov3 comments

I ran into interesting challenges with the SAT Math test generator. For example: the probabilistic nature of LLMs. Despite explicit instructions, after many question generations, I'd occasionally get an invalid JSON output. I also didn't see much success with in-context learning. I'd get questions that were way too similar.

I wrote about my process and learnings: https://www.sabrina.dev/p/aipowered-infinite-test-prep-part-...

Open articleView on HN

Hm this seems potentially dangerous, doing MCAT practice I got:

  Which of the following is NOT a neurotransmitter in the central nervous system?

  serotonin
  glutamate
  acetylcholine
  dopamine

  Neurotransmitters in the central nervous system include serotonin, glutamate, and dopamine. Acetylcholine is a neurotransmitter in the peripheral nervous system.

However this is wrong. Acetylcholine is both a PNS and CNS neurotransmitter. The rest are also CNS neurotransmitters.

Here is an example of a real question that is similar but accurate: https://quizlet.com/explanations/questions/which-of-the-foll...

My son boosted his SAT score to the upper 1500s by linking his College Board account to Khan Academy and practicing the types of questions he missed on his first SAT attempt.

nice, I'd definitely like to add adaptive learning to this mvp so that it tracks questions you missed and generates more like it

Reply on news.ycombinator.com