As soon as I saw “shift left” I knew I wanted to double down.
364 karma · joined November 5, 2024
Up to a certain point, a conditional fluency stores knowledge, in the sense that semantically correct sentences are more likely to be fluent… but we may have tapped out in that regard. LLMs have solved language very well, but to get beyond that has seemed, thus far, to require RLHF, with all the attendant negatives.
These things aren’t actually either/or, but when you pontificate on gender-affirming care in a country where half the population can’t afford just regular healthcare because of high deductibles… the feeling people get is exactly what you expressed.
FMA(x,y,z) ~ x += y*z
You see it all over the place in numerical computing and deep learning.