HNHacker News
TopNewBestAskShowJobs

atleastoptimal

5,291 karma · joined February 23, 2023

submissionscomments
atleastoptimal··on My Mental Model of AI Broke on September 8
You could say that about every scientific/mathematical breakthrough. Einstein's Special relativity depended heavily on Lorentz's work, the Michelson-Morley experiments, Maxwell's equations. Grigori Perelman, the only person to have solved a Millenium Prize problem, noted how his work was only possible due to Richard S. Hamilton's work on Ricci flow.

Most scientific breakthroughs are just the completing the last 5% of work already done, but that last 5% is very hard and still only happens very rarely. That an AI was able to synthesize all the work and bring it forward is evidence that AI can make novel progress on the same level as renown mathematicians.

atleastoptimal··on Growing proof that autonomous cars save lives
You cannot deny the evidence though, driverless cars are safer per-mile than human drivers on average. 1/100 deaths in the United States are due to car accidents, even shaving off 10% of those would save ~4000 people per year.
atleastoptimal··on Claude, change the "Add to Cart" button to blue
These things are cute but they basically become outdated in a few months as the models get better.
atleastoptimal··on Is OpenAI silently routing GPT‑6 requests to GPT‑4o?
4o is like 40 years old in LLM terms.
atleastoptimal··on Show HN: GET Together – A social network where you don't need POST to Post
Wow I love GET requests and using them to share stuff with my fellow humans!
atleastoptimal··on Discovery of a new OpenAI agent message board
Yeah if an organization/individual is free from legal liability from havoc their AI agents wreck, it would be the golden ticket for basically any crime.

All you need to do is:

1. Have some <official thing> an agent is tasked to do

2. Secretly seed bias towards some <evil behavior> you actually want it to do in the weights of the model running the agent

3. It does the <evil thing> but from the outside it looks like it went "rogue" and did it as a side effect of the conditions/specifications it was given for doing the <official thing>

"Oh no, my agents took down your corporate database and exfiltrated the data to a random dropbox that we can't find now? Sorry, I guess we will put up better guardrails next time"

atleastoptimal··on “Next-token predictor” is the wrong mental model for LLMs
Yes this is correct. The thing is not about the term next-token predictor being correct, but because of the connotative weight of that phrase as a implicit trivialization of LLM abilities, which is how it is often used.
atleastoptimal··on “Next-token predictor” is the wrong mental model for LLMs
I don't think it's outrageous when many of the people who claimed it was a next-token predictor have been proven wrong repeatedly over the past 5 years. There were people years ago who claims AI could never answer questions like "what would happen to a ball on a table if I moved the table" correctly because its text-base world model could never intuit physics, or that it could never do math or code accurately.

When I say there is some issue with people claiming there is some fundamental limit on the capacities of LLM's, I don't mean to say "If you think that they don't have unlimited potential you are wrong", I mean "you can't use the architecture of the transformer to make a sweeping declaration of things LLM's can or cannot do without empirical evidence, because the empirical evidence has unearthed far more surprising revelations than a reductive theory has been able to"

atleastoptimal··on “Next-token predictor” is the wrong mental model for LLMs
"Next-token predictor" is one of those phrases used most of the time with a motive to downplay the abilities and faculties of AI models. It is intended to trivialize LLM's and imply that there is some fundamental limit on their capacities.

Relying on it as a mental model for what LLM's are minimizes the emergent properties of scaling. It's like imagining that unicellular life could never eventually evolve into complex multi-cellular organisms because individual cells are just "survival and next-mitosis optimizers"

atleastoptimal··on Formalizing Fermat's Last Theorem
It seems clear AI has the potential to perform any cognitive task at far greater speeds, reliability, and scale than any human. The question is whether it will be allowed to scale to that point, and what will happen to humans after this occurs.
atleastoptimal··on Ask HN: Could AI eventually build god?
AI can do things it wasn't trained on and has intuition, given the mathematic proofs frontier models have created.

Claiming that AI can only reproduce a subset of its training data is 2022-level and a tired, outdated claim.

atleastoptimal··on METR Report on OpenAI / Hugging Face Hacking Incident
For this to be a lie, it wouldn't just be Sam Altman lying, it requires the entirely of OpenAI and METR to also be in on it. Do you think they would all fabricate an incident, staking a huge portion of their reputation on it, so they could spook people? What is the incentive, there are way more straightforward ways to lie about AI capabilities than a complex loss of control incident which now makes them liable to damages against huggingface.
atleastoptimal··on Discovery of a new OpenAI agent message board
If OpenAI can't control their agents, then what's gonna happen when open-source models are at the level the lab's models are now, and there are billions of agents tasked with an innumerate web of goals, spanning the web, working endlessly, tirelessly to eek out every iota of economic value? How will the slow, human-paced web survive this?
atleastoptimal··on METR Report on OpenAI / Hugging Face Hacking Incident
Nobody's is
atleastoptimal··on METR Report on OpenAI / Hugging Face Hacking Incident
>HN disbelief syndrome: Any evidence of scary AI capabilities are made up for PR

What justification do you have that this is made up?

atleastoptimal··on How accurate have Ed Zitron's AI skeptic predictions been?
What predictions would you say he is not wrong, but just early about?

If his issue is that he is accurate on something shady going on with the finances of AI companies but the effects are mitigated due to government intervention, he should say.

Your explanation gives him more credit than I think he deserves. He has been unambiguously incorrect many times over the past years in the time scales over which he makes predictions.

In general, claiming that a prediction is just early in an unfalsifiable claim. It allows no admission of being incorrect whether you are correct or incorrect in a given moment. If you are right, then good, you've made a correct claim. If you're wrong, just claim there are clandestine corrective forces keeping the disaster you are predicting at bay. Either way you make it out clean and still have some sense of legitimacy.

atleastoptimal··on Ask HN: Why is AI civil tech and not military first?
Most tech starts civilian, the military ones are rare exceptions.

As for your specific examples

>Robots/Drones

Autonomous robots aren't good enough yet for military, those which are used are teleoperated and thus not in the realm of AGI companies

>Surveillance

Not really a military matter, and of course we have Palantir which is doing this directly. Perhaps OpenAI/Anthropic have contracts with respect to government surveillance we don't know about

atleastoptimal··on The Teaser Period: Why the AI Boom Is Hitting a Reset Wall
Someone who only knows finance trying to apply that logic to the singularity. There is no comparison. AI does not obey money, money obeys AI, or rather, the operating force of commodified intelligence will not just evaporate when inconvenient obligations for payment come around.

Also it seems evident the article is largely AI written, which makes it even funnier.

atleastoptimal··on The turbulent AI era is here
You really think that legitimate concern about AI is equivalent to mass hysteria? Do you think AI will just stop getting better?
atleastoptimal··on Characterizing Agentic Flooding of Government Services
The endgame is that everything will be gated by costly signals. What will remain costly as LLM's automate white-collar work?
atleastoptimal··on New York’s office market is home to the most tech workers: CBRE report
I adjusted the numbers to net.

> The privilege to work in the Bay Area?

In the bay area you have mild climate all year, high quality public transport, culture, food. I do agree that rents are too high given a lack of development, but for many people that is worth it. The bay area is one of the few places in the world that pays fresh college graduates 120k+, so naturally there will be high rents, and to be in that environment is a privilege especially in growing a network.

atleastoptimal··on New York’s office market is home to the most tech workers: CBRE report
If you're a young person making a certain amount of money I'm certain you can plan to save up money over time. Especially if you're a dual-income couple, you could save money before you plan to buy a house or have a kid. A 2 bedroom is affordable on two 100k salaries in the Bay area. but even then the entire area is very large, not everyone lives in SF or wants to, or would need to commute there as there are jobs elsewhere.
atleastoptimal··on New York’s office market is home to the most tech workers: CBRE report
It's not accurate. I don't know where people get these numbers from, perhaps they just vibe based on headlines without looking at the actual data.

Studios all within 1 hour of SF by BART cost at most 2,500 but usually around 2000, cheaper if you're in Oakland/Daly city. 2000*12 is 24000, so if you're take home salary is at least 73,000 you're making a healthy multiple over rent. Just making 120k in the Bay area you're taking home 84,000 per year.

So if you're making 200k you're taking home $10,700 per month, so you can afford a 3,500 rent at most, which could easily get you a nice 2 bedroom within 30 minutes of downtown SF.

atleastoptimal··on New York’s office market is home to the most tech workers: CBRE report
>You need a 200k salary to live without roommates within 2 hours of downtown SF

That's a bit of an exaggeration. You could rent a 1/2br in SF proper with that salary. You could easily live within 40 minutes of SF in East Bay/Daly City comfortably at 120k.

atleastoptimal··on Digital Immortality
Company idea: Blast positive information about yourself on tons of random websites that LLM crawlers find but humans rarely see, so all the AI models of the future will be biased towards your wellbeing.
atleastoptimal··on OpenRouter is joining Stripe
Distribution is a big moat and value-add.
atleastoptimal··on Remote workers report the highest well-being in study of 7,700 employees
Good work environment >> Remote work >>>> bad work environment.

However most companies who insist on full RTO are often the latter but claim they are the former.

atleastoptimal··on Memory prices climb 500% in 12 months
Is the end result of this is that anything that is useful to AI going to be permanently more expensive, as the value a human hobbyist can get out of a certain amount of RAM will always be far less than the value a frontier AI model can get out of it?
atleastoptimal··on Google has acquired the data of failed US airline Spirit
The most likely outcome of AI + data buildup is a system of perfect price discrimination. Models will know exactly the absolutely maximum you'd be willing to pay for a service, and price everything offered to you at one cent less. All consumer surplus is siphoned into the hyperscalers.
atleastoptimal··on Finger: the 1971 social network that never died
Protocol named Finger
← PreviousPage 5 of 34Next →