Hacker News Reader

Comment by notnaut | Hacker News Reader

So you think the logical patterns found in human language might also be similar enough to the logical patterns found in other systems that these LLMs have a jumpstart in figuring those out?

We already have such a poor idea of how these things seem to understand so much… it’ll be a wild day when cancer is cured and we have absolutely no idea why.

View on HN

It feels like some type of Heisenbergian deal. You can solve what you want, but you cannot know how at the same time.

IMO a sufficiently advanced AI should be able to do a full analysis of its neural architecture and explain it and break down its functionality.

There is no capability in an LLM to do this and we don't know how to build an "AI" that is not an LLM.

(Just deciding that your LLM has magic powers because you've put it in a category called "AI" and you've decided that category has said magic powers is what that guy Wittgenstein was complaining about in philosophical problems. Besides, intelligence doesn't mean all your thoughts are automatically correct!)

> Besides, intelligence doesn't mean all your thoughts are automatically correct!)

This is the true bitter lesson for HN.

That would be even more intelligent than the majority (or even all, YMMV) of humans.

You can't "cure cancer" because "cancer" is a label for different things with different causes. If your brain cells all have the wrong DNA there's no way to get different brain cells.

I was using the phrase sort of idiomatically, but fair enough!

Reply on news.ycombinator.com