390 karma · joined March 3, 2009
I put together this Hammerspoon spoon with a few brew libraries and some inline Swift code.
You paste twice quickly to trigger it, and you can iterate formats with a keystroke. https://gist.github.com/thadk/8b178aa93dafcab92ca579825f8191...
Time to first token (TTFT) on 5,687 tokens, like pasting a short code block into the prompt, takes 36 seconds vs 4.7 seconds. It also breaks down the seconds for each step like KV and prefilling.
Gemma4 31B TTFT on the M5 Max 128gb with same setup is showing as 19 seconds.
An ineffable game happens that one's retreat diminishes.
https://www.econtalk.org/venkatesh-rao-on-waldenponding/ https://studio.ribbonfarm.com/p/against-waldenponding-ii
(pardon for reposting just now from off-front-page thread on https://declaude.org/watermarking/, just thought of question)
Zvi's retelling handles this better. Zvi speculates that the secret message board familiarity was carried because it had been trained into the May-and-subsequent models: https://thezvi.substack.com/p/openai-trained-its-models-for-...
https://observablehq.com/@fil/airocean-projection
The source data is down for my vector tile remix of it but here is a screenshot: https://static.observableusercontent.com/thumbnail/0fac8a928... and the code: https://observablehq.com/@thadk/reprojecting-vector-tiles
I did it as a little MapTime project in 2019 or so.
Until now, I had not thought to try to lock down the settings that lead to accidental reflows. It sounds less difficult in KOReader than I expected. I may try to stabilize it for my next ebook I can get into KOReader.
It seems to me that LLMs and particularly chatbots have already allowed for bigger scale collaboration within the LLM companies versus what was possible within the prior cohort of big platform companies.
Has the result just been taller towers, or actually a change of what is possible?
Is reconstructing the compressed knowledge in the model like reconstructing a lossy JPG or MP3 a reasonable analogy?
Open Utilities->Screenshot.app Options->Capture/Capture Format->HEIC. Note, it changes the system screenshot default away from PNG too.
At least Codex is trying to win validation on merit.
By delaying allowing others to train off Mythos, they hold their SWE-Bench Pro head start longer so among other things, the USG can't but notice Anthropic's lead when they're deliberating on whether to further substantiate the "supply chain risk".
Then from that they realized they could just run API calls more like staff, fast, not at capacity.
Then they leave the billion other people's calls at remaining capacity.
https://thezvi.substack.com/i/185423735/choose-your-fighter
> Ohqay: Do you get faster speeds on your work account?
> roon: yea it’s super fast bc im sure we’re not running internal deployment at full load