570 karma · joined April 21, 2014
As the article states, LLMs are fantastic at writing code, and not so good at issuing tool calls.
It is also a bit weird that they are not incorporating speculative decoding, that seems like a critical performance optimization, especially for decode heavy workloads.
The LLM is a cute way to carry out this vulnerability, but in fact it's very easy to get code execution and poison a cache without LLMs, for example when executing code in the context of a unit test.
Not really the point, but an idea that springs to mind is selling fighter jets to allied countries.
https://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect#...
This is the only thing Dunning-Kruger found.
Actual performance is correlated with perceived performance, mediated by the fact that everyone thinks they are a bit above average.
Another huge benefit that we're realizing as we move some of our heaviest tables to this pattern is that it makes it really easy to index a core set of fields in Elasticsearch, along with a tag to associate it with a particular domain model. This has drastically cut down on our search-specific denormlization and let us avoid expensive index schema updates.