763 karma · joined December 7, 2020
In an ideal SaaS scenario, your customer can cut off a tiny percentage of your revenue.
I agree, it's greatly undervalued!
1. He's too busy building the next generation of tech that HN commenters will be arguing about in a couple months' time.
2. I think Sam Altman (who is addressing the committee) and Ilya are pretty much on the same page on what LLMs do.
1. ChatGPT knows the algorithm for adding two numbers of arbitrary magnitude.
2. It often fails to use the algorithm in point 1 and hallucinates the result.
Knowing something doesn't mean it will get it right all the time. Rather, an LLM is almost guaranteed to mess up some of the time due to the probabilistic nature of its sampling. But this alone doesn't prove that it only brute-forced task X.
Why wouldn't it? It's trained on code generated by humans and already generates code that is more readable than the output of many humans me included.
It'd be interesting if the parameter/complexity requirements are actually similar once you examine the system as a whole, meaning machine _and_ human brain.