HNHacker News
TopNewBestAskShowJobs

mips_avatar

2,866 karma · joined June 3, 2018

Me@jonready.com

Currently working on wanderfugl.com

submissionscomments
mips_avatar··on Launch HN: RunAnywhere (YC W26) – Faster AI Inference on Apple Silicon
Have you tried any really big models on a mac studio? I'm wondering what latency is like for big qwens if there's enough memory.
mips_avatar··on Mark Zuckerberg creating new Applied AI engineering company, reorganises teams
I think the notes about Alexander I’ve heard is just how obvious his were
mips_avatar··on Mark Zuckerberg creating new Applied AI engineering company, reorganises teams
Yeah on campus apparently
mips_avatar··on Mark Zuckerberg creating new Applied AI engineering company, reorganises teams
The striking thing I heard from Meta staff is that Alexandr Wang would walk around campus with very obvious bodyguards surrounding him. Like sure maybe security is needed, but the decision to be surrounded with bouncerish guys says something about him.
mips_avatar··on Autoresearch: Agents researching on single-GPU nanochat training automatically
The key is that Andrej has really good taste. It takes a lot to make a great harness for these models.
mips_avatar··on Autoresearch: Agents researching on single-GPU nanochat training automatically
nanochat is super capable, the d34 (2.2b) variant is competitive with qwens of that size. Andrej is I assume building out the improvements in preparation for bigger training runs. We desperately need a truly open model, so i think this is incredibly important.
mips_avatar··on OsmAnd’s Faster Offline Navigation (2025)
I built a geocoder that mostly solves this https://jonready.com/blog/posts/geocoder-for-ai-agents.html. I have about 96% recall compared to google places 98% recall, but it uses an llm for query planning and ranking so it might not be a good solution for you.
mips_avatar··on How Taalas “prints” LLM onto a chip?
I imagine you could do something like a LORA
mips_avatar··on How Taalas “prints” LLM onto a chip?
The problem with groq was they only allowed LORA on llama 8b and 70b, and you had to have an enterprise contract it wasn't self service.
mips_avatar··on The path to ubiquitous AI (17k tokens/sec)
A fine tuned 1.7B model probably is still too crippled to do anything useful. But around 8b the capabilities really start to change. I’m also extremely unemployed right now so I can provide the engineering.
mips_avatar··on The path to ubiquitous AI (17k tokens/sec)
I think the thing that makes 8b sized models interesting is the ability to train unique custom domain knowledge intelligence and this is the opposite of that. Like if you could deploy any 8b sized model on it and be this fast that would be super interesting, but being stuck with llama3 8b isn't that interesting.
mips_avatar··on Show HN: Microgpt is a GPT you can visualize in the browser
Using ascii characters is a simple form of tokenization with less compression
mips_avatar··on Microgpt
This is so cool. Andrej has been single-handedly making the world of llms more interesting and democratized
mips_avatar··on FlashAttention-T: Towards Tensorized Attention
You should check out nanochat. I would personally appreciate it if someone implemented hardware optimized flash attention for my 3090
mips_avatar··on Code is cheap. Show me the talk
Well a lot of managers view their employees as doing the former, but they’re really doing the latter
mips_avatar··on If you tax them, will they leave?
All these billionaires are comparing their problem to difficulties Norwegians have managing their finances with the wealth tax there. The difference being that the wealth tax in Norway kicks in after a few hundred thousand dollars of wealth so regular people actually contend with it. Like even the most successful startup founders likely won’t ever pay the wealth tax before reaching a liquidity event.
mips_avatar··on How to turn 'sfo-jfk' into a suitable photo
Not really it’s just a photo search engine (albeit a very small one)
mips_avatar··on How to turn 'sfo-jfk' into a suitable photo
The annoying thing with Unsplash is that it sounds like a really permissive license, but the moment you try and do it at scale you're no longer in compliance with their terms. Also their definition of not building a competing service is really broad. Maybe i'm being overly cautious but I get eeked out by all that.
mips_avatar··on Amazon cuts 16k jobs
Outsourcing in the 90's/2000's failed because you didn't want to deskill engineers and reduce their scope, you wanted Jeff Dean building pagerank and building Google.
mips_avatar··on Will AIs take all our jobs and end human history, or not? (2023)
Sorry I think you're completely right, I'm frustrated that collective action here is so hard to come by. I think that we feel really isolated because we don't see ourselves as part of a larger whole and becoming less isolated involves leaving behind this identity tied to our economic output.
mips_avatar··on Will AIs take all our jobs and end human history, or not? (2023)
The tech jobs were cushy because the tech companies bribed ambitious people to keep them from starting their own companies. Like it wasn't about hiring them because you needed them it was to keep them from competing against you. Like this was always a deal with the devil, but the idea that Microsoft has more of a right to the monopoly it has over OS operating systems than their employees have access to their healthcare is wrong. Like I think a lot of people are waking up to the idea that the promises their companies made to them were like the promises the devil made in that theirs fine print and they sold the company more than they realized.

Additionally all the startups offering to automate whitecollar work are going to run into a problem when they realize the jobs never needed to be done.

mips_avatar··on Will AIs take all our jobs and end human history, or not? (2023)
That and housing, and inflation during covid. Like there's this idea that you don't really deserve anything in the United States.
mips_avatar··on Will AIs take all our jobs and end human history, or not? (2023)
Yeah but even if you believe the hype, if you're in a functioning country you don't think that your ability to house your family wrests on AI being worse at excel than you.
mips_avatar··on Will AIs take all our jobs and end human history, or not? (2023)
No you have to decenter yourself from your pay to achieve it. People accept things like cutting of medicaid because they see their job success as a moral success. There's a lot you can do to start being the good in the world that doesn't require Washington's permission.
mips_avatar··on Will AIs take all our jobs and end human history, or not? (2023)
Well I also visited Ethiopia this year and I got to hear first hand about the genocide in Tigray, I'm very aware of the horrifying atrocities that happen when social order and human rights break down.
mips_avatar··on Will AIs take all our jobs and end human history, or not? (2023)
Ok well I didn't meet everyone in Vienna or Vietnam, but those I did meet hadn't been laid off in the name of AI (yesterday three of my friends were laid off from Amazon). And if you're laid off in Vienna you still have access to healthcare, and there's a functioning safety net, and just generally a sense that you're not alone in this. In the united states my apartment has a homeless man living beneath it and every night you hear him either screaming because he doesn't have access to drugs or laughing because he does. There's a not so subtle attitude that maybe people like that deserve to die. So yes maybe people in Vienna don't like AI, but you are wrong that they fear it in the way Americans do.
mips_avatar··on Will AIs take all our jobs and end human history, or not? (2023)
Outside of America people aren't really stressed about AI. Like you go to Vietnam or Vienna they mostly just think that they will have a good life with AI. It's uniquely American to believe that your life will end when AI takes your job.

The problem isn't the AI it's that your access to basic rights is intermediated by a corporate job. American's need to decenter their self worth from their jobs. Like when I quit Microsoft I literally thought I was dying, but that's all an illusion from the corporations.

mips_avatar··on MapLibre Tile: a modern and efficient vector tile format
I just want support for globe view on maplibre native
mips_avatar··on Show HN: New 3D Mapping website - Create heli orbits and "playable" map tours.
Just seems like weird to insufficiently monetize a project
mips_avatar··on Show HN: New 3D Mapping website - Create heli orbits and "playable" map tours.
I'm kind of surprised the economics of this work out, like a google map load costs 0.7 cents and I doubt he's getting that much in ad revenue. Or is the iframe free since he's not customizing it?
← PreviousPage 5 of 25Next →