4,723 karma · joined August 29, 2013
AFAIK it significantly decreases the brightness. Jerry Rig Everything demonstrates this here - https://youtu.be/TRW4W7KkJXs?t=32
I have two of my own comments to add to that. First one is that there is problem alignment at play. Specifically - the benchmarks are mostly self-contained problems with well defined solutions and specific prompt language, humans tasks are open ended with messy prompts and much steerage. Second is that it would be interesting to test older models on brand new benchmarks to see how those compare.
When prices are determined by speculation it do be do like that.
Penultimate commit refactored dispatch to bootstrap reality when accessed any means. Comment on the commit is "made things deterministic by sidestepping heisenberg principle".
It's absolute bonkers amount of hardware scaling that happened since Doom was released. Yes, this is a tremendous overkill here, but the crazy part here is that this fits into an earpiece.
Full disclosure - I am a heavy codex user and I review and understand every line of code. I manually fight spurious tests it tries to add by pointing a similar one already exists and we can get coverage with +1 LOC vs +50. It's exhausting, but personal productivity is still way up.
I think the future is bright because training / fine-tuning taste, dialing down agentic frameworks, introducing adversarial agents, and increasing model context windows all seem attainable and stackable.