1,429 karma · joined August 20, 2016
There are no wealth extraction capabilities yet. It's a money pit. They're certainly hoping it'll surpass some breakpoint and become profitable by brute-forcing compute power, but that's very optimistic. The propaganda Schmidt is pushing envisions that future in hopes of raising current stock prices so they can afford the brute-forcing that's very unlikely to succeed.
My prediction is that we'll keep the tools we've acquired, probably refined a bit, but the LLM path is eventually a dead-end. After this, if they still try to monetize, remote models will be extremely expensive.
~7x overcompute * ~7x real cost to Anthropic * your 10-20k estimate for consumer use is my thought for actual total cost. If the honeymoon period runs out and they're still in business, this is what everyone will pay.
I don't see anything worthwhile in this Super ZSNES project yet. We were all ZSNES users back in the days.
ZSNES is popular because of legacy and nostalgia. It was very fast and came at just the right time, but the developers aren't quite coding gods. Their expertise on the SNES is no match for late/later developers like Near and Sour.
With Super ZSNES, being a Unity project, you can get a fairly clear decompile of the IR, and the code doesn't seem all that impressive. It's alpha-quality, but generally coded like the original ZSNES was. Optimization is completely missing and accuracy is still out of whack, but synchronization is improved and it's doing a little better job of counting cycles. "GPU-powered" is a big stretch. ~~They're only taking advantage of it for fixed-function perspective transform on mode 7~~ Scratch that. It borrows the line-based algorithm from bsnes-hd, including the trick to interpolate the transform variables between mins and maxes. So the only GPU feature it uses is blending for bump-mapping.
Teacher: "Photosynthesis makes energy from water, CO2 and light. The mitochondria are the power centers of the cell."
Grade-schooler: "How do they work?"
Teacher: "Um. Um..."
Modern scientist: "Quantum entanglement and tunneling. We don't really understand any of it."
Then there's stuff like this: https://github.com/hdresearch/ziggit/blob/master/src/cmd_bra...
It's just one giant function. Sometimes big functions are necessary. This one is clearly AI generated and not very readable for a human. This is just from a quick glance.
Edit And then I go their repository and read commits like this https://github.com/hdresearch/ziggit/commit/31adc1da1693e402... which confirms it wasn't even looked over by a human.
The GPUs have become much larger, so 6.8x is believable there, as is the inclusion of a matmul unit boosting AI.
The 2.x numbers are the most realistic, especially because they represent actual workloads.
Mobile devices, unless you get really close to the screen, have matched the retinal density for a while. Most people hold the device at about 8 inches, so 450 dpi is the value to hit.
Edit These measurements assume 20:20 vision, which is the average. Many people exceed that. So you'd need slightly higher values if you're feeling pedantic.
Not the best example. That snippet was in use at SGI for years and actually written by Gary Tarolli. Quake's optimization was mostly done by Michael Abrash.
The original id engines were also famously inflexible. They fit the mold of "developing an engine, not a game" to a T. What you saw them do was all they could do. Look at how much Half-Life needed to add to be viable. idtech3 also only broke out of its niche because Ritual and Infinity Ward heavily modified it and passed it around. There's a good reason the engine-based ecosystem is so prominent now.
Everybody's so worried about getting in on the ground floor of something that they don't even imagine it could be a massive flop.
If you use it like an agent and stick it in a loop and run it until it achieves a specific outcome it's not.