HNHacker News
TopNewBestAskShowJobs

HarHarVeryFunny

8,340 karma · joined July 29, 2017

submissionscomments
HarHarVeryFunny··on The baffling intelligence of a single cell (2024)
It doesn't make sense to say a system isn't intelligent without defining what you mean by intelligence.

e.g. One reasonable definition of intelligence is ability to use prior experience to fruitfully guide future behavior, and if you look at the spectrum of animal intelligence it seems most useful not to have some arbitrary cutoff or mechanism attached to that. A simple animal like an insect, or a bacterium, has effectively encoded the prior experience of the species, in a relatively stable environment, into its DNA.

Animals with more complex nervous systems have ability to learn as individuals in their own lifetime, and display intelligence according to what they have individually experienced, although they too will have been born with some species-level intelligence as to how to survive & thrive in their environment.

HarHarVeryFunny··on The baffling intelligence of a single cell (2024)
AI "neurons" (ie. combination of weight layer and following activation layer) are only a very crude model of the real thing, but they do model what appears to be the core function of integrating the synaptic inputs and firing in non-linear fashion when this integrated input crosses some threshold. So, it's more than just connectionism, but a lot less than attempting to closely mimic biology.

Nobody knows how much would be gained by using a more biologically accurate model of a neuron. Much of the low level detail may be irrelevant, but the timing aspect of it, or some equivalent, might be helpful if we want to make ANNs capable of learning realtime pattern recognition and control.

HarHarVeryFunny··on Character.ai Files for Bankruptcy
I don't see any connection to Character.ai, but it's pretty obvious that Twitter is 90% bots, politically leaning heavily in same direction as Twitter's owner, whose pro-Trump interests are aligned with those of Russia.

Where all all these bots being hosted? I have no idea, but it certainly would not be surprising to find many of them coming from Russia (Yandex). Twitter must at least know the IP addressees of these bot accounts, but does nothing to stop them. Perhaps they are actually run by Musk not Putin, who makes no attempt to hide his attempt to use his position to subvert American democracy.

HarHarVeryFunny··on The gap in shared understanding of LLM capability is widening
So maybe move on from math to something of commercial relevance?

AI has made strides in programming, but mainly in web development (which nowadays is the largest market), but there are other more demanding areas like embedded development where they'd find plenty of signal.

The promised "drop-in replacement remote worker" also requires a lot more capability than these models currently have, albeit more qualitative - architecturally based - than quantitative, so out of reach for now.

It seems OpenAI are trying to promote frontier math capability as relevant to the commercial market for AI, which it is not (something like Jev, much less glamorous, is much more relevant), and most businesses not only have no use for anything remotely approaching this level of math ability, but also more generally have no need for expensive frontier models which constitute a small percentage of revenue for the AI companies.

If it's investors rather than customers that OpenAI are trying to impress with math results, then I think they are wasting their time - investors are increasingly worried about AI revenue and the financial viability of the business as currently structured, with OpenAI looking like the least connected to reality.

AI is in some ways still a technology looking for applications, at least applications with a large enough commercial market to justify the valuations these companies are seeking. The answer is not math.

HarHarVeryFunny··on The gap in shared understanding of LLM capability is widening
Yes, I failed to anticipate environment/playground-based RL-training and how much difference that would make, although I think the broader point about limitations of lack of continual learning still stands, and I can't see these simulated environments ever become complex and/or varied enough to be any substitute for the need to learn on the job.

However, gotcha acknowledged, but my point was about the jaggedness of AI, and how huge the divide in capability is between the domains where RLVR works, primarily coding, hacking and math, and everything else. The success and scale of RLVR in areas such as coding only make this gap more noticeable.

HarHarVeryFunny··on Citroen revives the 2CV for an electric age
But even Teslas are 2-3x the price of equivalent Chinese EVs.

Apparently a Tesla model 3 has about 10-15 hours of human labor in it, so higher wages can't even begin to explain the price difference.

HarHarVeryFunny··on Citroen revives the 2CV for an electric age
I never thought of the 2CV as a style icon - more a statement of practical minimalism. Make it so simple that it's cheap, there is less to break, and you may be able to fix it yourself. Picnic bench included.

I'd be very happy to buy a $15-20K modern electric minimalist equivalent, although I'd prefer boring normal Nissan Versa type styling, not 2CV quirkiness or the chopped 2+2 sub-compact car look.

HarHarVeryFunny··on Secret of Orange Cats Revealed After 60-Year Search
I'm an ex Brit, living in the US, and have an orange tabby that I like to say is orange, but his name is "Gingey".

Does that help? :)

HarHarVeryFunny··on The gap in shared understanding of LLM capability is widening
No doubt the unreleased models are better at the things that LLMs are good at (coding, hacking, math) than what's been released, but there is still zero sign of their intelligence becoming broader and more general, and knowing how these models work and are trained there is no reason to expect them to become much more general unless changes are made.

The marketing message being pushed by Anthropic (& also OpenAI) is that these narrow math/hacking/coding skills are representative of the model's intelligence, when that seems to be the exact opposite of the truth - these narrow human/super-human competencies are entirely atypical of the models more general capabilities.

HarHarVeryFunny··on The gap in shared understanding of LLM capability is widening
Sure, they fix these embarrassing things as fast as they get pointed out.

Today I gave a free tier AI a photo of a burning ship posted on Twitter, and asked it to confirm it was an oil tanker. It said no, it was a bulk grain carrier, and gave a specific ID. I pointed out that the bulk grain carrier it had identified was painted black, not red (like most liquid carriers) like the one in the photo (as well as other obvious differences).

That is just one example. The free tier models continue to make very dumb mistakes all the time. Maybe the top secret models, too dangerous for the public, are able to distinguish a black ship from a red one. Who knows.

HarHarVeryFunny··on The gap in shared understanding of LLM capability is widening
Right, if they want to sell AI as being human level, outside of a couple of narrow domains (math & coding), then how about using AI to build something that actually demonstrates that?!

It seems that every time they try to use AI to do some real world task like manage a vending machine, then it falls flat on it's face.

The first time DeepBlue beat Kasparov, or AlphaGo beat Sedol, I think everyone got it - we're got a machine that is superhuman at Chess, or at Go. We didn't need to see it beat 100 other people to get it. Yet people at OpenAI think we are so dumb that we don't get that they have built a DeepBlue for Math, and that they need to show us another 100 examples to hammer that point home.

So, next time, OpenAI or Anthropic want to try to impress us with how smart their models are, forget the math, forget the three.js animations (we get that too), and release a model that can do something more useful and not just "here's DeepBlue beating contestant #100".

HarHarVeryFunny··on The gap in shared understanding of LLM capability is widening
Because either:

1) They are knowingly lying about AI being at human replacement level rather than a useful developer tool

AND/OR

2) They think they are special, and that their software developers ("AI researchers") are doing harder stuff than those most other companies

HarHarVeryFunny··on The gap in shared understanding of LLM capability is widening
> minting zero days, running cyber attacks and defenses at machine speeds, discovering new science, advancing the frontier of mathematics

Maybe more people than Karpathy realize see exactly the above, which is what he and the privileged 5000 are seeing, except unfortunately the "discovering new science" part of it seems to be wishful thinking.

So, Anthropic and OpenaAI have built a "DeepBlue for math" that is also super-human at hacking, as well as being useful for coding.

I'm not sure what Karpathy's point is? Are we meant to be more impressed? More worried? More eager to buy it?

HarHarVeryFunny··on Scandinavia's first farmers slaughtered hunter-gatherer population, DNA suggests
I think that's something a bit different though - a later era, with some of these nomadic tribes being more inherently inclined to war and violence, and "war technology" such as horses, advanced bows, etc, playing a role.

The suggested universal dynamic of neighbors in conflict is different from that of well equipped, well trained, expansionist cultures preying on everyone.

HarHarVeryFunny··on Scandinavia's first farmers slaughtered hunter-gatherer population, DNA suggests
It makes sense as a universal dynamic.

When living in contact, hunter gatherers and farmers are in natural conflict since the most concentrated food source you could gather (or hunt) from is a farm. Raiding must have been fairly common.

In a conflict like this, it seems natural that the farming community would prevail, since they would naturally be more motivated to do so (this is their primary food source, they are the ones being attacked), and as a stationary community might be expected to build up more resources and be better prepared to defend themselves.

HarHarVeryFunny··on Does written language speed up or slow down cultural change?
Look at cultures that have/had no written language, and you will find your answer...

Australian aboriginals

Papua New Guinea tribes

Amazonian tribes

Native Americans

Eskimos

Written language is how knowledge spreads and society evolves.

HarHarVeryFunny··on Microsoft-Decision-1, our model for fast decision-making
Open weight model pricing isn't really up to the company that built them (unless they are also serving them, in which case their API price may differ). It's really up to the serving cost and/or pricing of whoever is actually serving the model.

The main market for Jev is going to be business, who may not want to deal with a low cost open weights server like Fireworks AI and are more likely to go with a provider like AWS where pricing is higher.

HarHarVeryFunny··on Microsoft-Decision-1, our model for fast decision-making
Looks like yet another non-price-competitive Jev competitor.

Microsoft only compares the price of theirs to GPT Sol(!), not GPT Terra, or GPT Luna (which is what OpenAI's Jev wannabe is based on), and certainly not Jev (4/10 the cost of Luna).

I can't remember when a new product created So many competitors so quickly. What is very clear is that everyone is saying "Doh!", slapping themselves on the forehead, and scrambling to get a slice of this obvious-in-retrospect massive pie.

What no-one appears to have done yet is to come close to Jev on pricing!

HarHarVeryFunny··on Typesafe AI raises $870M at $7.5B
A very major part of Jev is the cost and speed. Yes, classification is/will be a commodity business, just like LLMs are, and similarly there is no moat only production cost and pricing.

Yes, anyone can wrap a decisions API around an LLM, but so what? If you want to compete then you need to compete on price, and it's not clear if OpenAI and/or Anthropic are able or willing to do that without building a custom architecture, and even then is a race to the bottom on pricing really what they want to pursue?

I'm not sure if OpenAI have announced pricing for their Decisions API, but they have said it's based on Luna which costs $0.10/M input, not even remotely competitive with Jev's $0.04/M input, which I'd expect has some headroom built into it.

Assuming that the architecture behind Jev is not just an LLM, and gives them some inherent efficiency/cost and speed advantage, then the question is whether OpenAI and Anthropic really want to duplicate this and have a race to the bottom on pricing for what may be a large part of the business automation market they are addressing. Is that what they want as their IPO pitch - we're selling potatoes, and think can grow them cheaper than Typesafe ?

HarHarVeryFunny··on Yandex Takes a Second Data Center Hit in 48 Hours
In the case of Wildberries we're not talking about "dual use" items like a sleeping bag that your government fails to provide you, we're talking about specifically tagging items (1/4 million of them!!) as being for the war. It's Wildberries' business (literally) if they want to be a supplier for the war, and profit from it, but obviously that does mean they become a target.

Cutting off the enemy supply line is a classic and obvious military strategy. Ukraine didn't choose to be attacked, nor did they choose for Wildberries to become part of the supply line. They are playing the cards they were dealt, and I would say doing so with remarkable restraint.

HarHarVeryFunny··on Yandex Takes a Second Data Center Hit in 48 Hours
Russian air defense is multi layered and relatively strong, so one of Ukraine's main strategies so far has been just to overwhelm them with volume. You want mass volume cheap and cheerful, not expensive ones, unless for the occasional strategic target.

Ukraine only has limited number of more capable missiles/drones like Flamingo FP-5 and Neptune, although now the FP-7 is about to hit volume production, followed by the FP-9, as well as Europe-supplied missile and anti-missile systems, so it remains to be seen if this will change Ukraine's strategy ... I tend to doubt it - they will have firepower to retaliate much harder, and at further distance, when they want to, but I expect they don't want to unilaterally escalate.

HarHarVeryFunny··on Yandex Takes a Second Data Center Hit in 48 Hours
I think the energy facilities being hit are mostly refineries - not storage, and anyways any bulk storage is just temporary for bulk transport for export or to the front, etc, so having it in 25gal cans wouldn't be very helpful!
HarHarVeryFunny··on Yandex Takes a Second Data Center Hit in 48 Hours
Apparently Wildberries carry/carried over 1/4 million items tagged as "for SMO" (Special Military Operation), so they had become a major part of the supply chain for Putin's war, which is why they were hit.
HarHarVeryFunny··on Yandex Takes a Second Data Center Hit in 48 Hours
If you are referring to the recent UAE datacenter attacks, AFAIK Amazon's services worked as advertised, but obviously a redundant resource is only as good as the number of copies you have left, and eventually 3 of 3 datacenters were hit.

Apparently not all AWS resources/services are redundant - some are advertised as single location, and then it's up to the customer whether they choose to pay to make backups elsewhere (e.g. in a different region) or not.

HarHarVeryFunny··on Yandex Takes a Second Data Center Hit in 48 Hours
A lot of the smaller drones that Ukraine is using only do limited damage - they may start a fire that can spread, but are not going to destroy an entire larger facility (although the Flamingo can do significant damage). Many Russian energy facilities just get hit repeatedly over time - Russia will fix as fast as they can. Staggering hits seems to make sense.
HarHarVeryFunny··on Yandex Takes a Second Data Center Hit in 48 Hours
I seem to recall that this is optimal game theoretic strategy - don't initiate, but always immediately retaliate.

Whatever is happening now is payback for Putin's birthday present to himself from 2 days ago, firing a missile into a Ukrainian apartment building that killed 22 civilians (mostly women & children).

HarHarVeryFunny··on OpenAI withdraws three mathematical results
Apparently "only" needing the problem statement to be correct (i.e. expressing/rewriting a mathematical proof in Lean) isn't so simple, and if you don't get it correct then you haven't proved (or disproved) what you were intending.
HarHarVeryFunny··on Claude Haiku 5.5
The classification performance remains to be seen, but presumably we'll soon start to see classification benchmarks.

For other tasks like summaries (another suggested usage) it's good to see Haiku and Luna now competing against each other on cost.

I'd love to know how the business automation market breaks down by volume of call type though - hard to imagine that decision making (e.g. branching, triage) isn't a very large part of it, greater than these other suggested Haiku use cases.

HarHarVeryFunny··on Claude Haiku 5.5
Notable that one suggested use case for Haiku is "classification requests", i.e. Jev competitor, and the pricing matches GPT-6 Luna which is behind OpenAI's "Decisions API" Jev competitor.

For this application 100K token input is plenty.

Of course Anthropic and OpenAI, both at $0.10/M, are still 2.5x the cost of Jev's $0.04/M.

HarHarVeryFunny··on Study: Claude, ChatGPT Offer Different Shopping Prices Based on Wealth
As you note, it's going to be based on what the LLM knows about the user, and as any good predictor knows, rich people like to buy expensive stuff.

Whether or not the article has examples, it would be surprising (an LLM prediction failure) if this expected behavior did not extend to different prices for different users, e.g. recommending the rich guy the Whole Foods bananas and the poor guy the Walmart bananas.

← PreviousPage 5 of 34Next →