It's kind of the opposite. I was a highschool dropout, highest level of math was basic algebra. I was able to change my mind about the whole education thing by buying a "prepare yourself for the SAT" book, studying it for a couple of months, doing well, and getting admitted to college. Ended up doing a math + physics dual major.

(I'm really grateful that that avenue to college existed -- I could not have written an admissions essay, done extracurricular activities, or generally been a "good boy" if my life depened on it.)