HNHacker News
TopNewBestAskShowJobs

adamsmith143

701 karma · joined February 10, 2022

submissionscomments
adamsmith143··on BratGPT: The evil older sibling of ChatGPT
It's hard to explain how dystopian this is. "Haha how cute the little baby AI wants to kill us all but it's too stupid hahaha."
adamsmith143··on Sam Altman goes before US Congress to propose licenses for building AI
It's incredibly easy to show that you are wrong and the models perform at high levels on questions that are clearly not in their training data.

Unless you think OpenAI is blatantly lying about this:

"A.1 Sourcing. We sourced either the most recent publicly-available official past exams, or practice exams in published third-party 2022-2023 study material which we purchased. We cross-checked these materials against the model’s training data to determine the extent to which the training data was not contaminated with any exam questions, which we also report in this paper."

"As can be seen in tables 9 and 10, contamination overall has very little effect on the reported results."

They also report results on uncontaminated data which shows basically no statistical difference.

https://cdn.openai.com/papers/gpt-4.pdf

adamsmith143··on Sam Altman goes before US Congress to propose licenses for building AI
This is demonstrably wrong. It can clearly generate unique text not from it's training corpus and can successfully answer logic based questions that were also not in it's training corpus.

Another paper not from Msft showing emergent task capabilities across a variety of LLMs as scale increases.

https://arxiv.org/pdf/2206.07682.pdf

You can hem and haw all you want but the reality is these models have internal representations of the world that can be probed via prompts. They are not stochastic parrots no matter how much you shout in the wind that they are.

adamsmith143··on Sam Altman goes before US Congress to propose licenses for building AI
Actually OP is clearly, ironically, parroting the stochastic parrot idea that LLMs are incapable of anything other than basic token prediction and dismissing any of their other emergent abilities.
adamsmith143··on Sam Altman goes before US Congress to propose licenses for building AI
>Why is it so hard to hear this perspective?

Because it's wrong and smart people know that.

adamsmith143··on Sam Altman goes before US Congress to propose licenses for building AI
Please explain how Stochastic Parrots can perform chain of reasoning and answer out of distribution questions from exams like the GRE or Bar.
adamsmith143··on Sam Altman goes before US Congress to propose licenses for building AI
You've never had a tool that is potentially better than you or better than all humans at all tasks. If you can't see why that is different then idk what to say.
adamsmith143··on Sam Altman goes before US Congress to propose licenses for building AI
"It's just a stochastic parrot" is one of the dumbest takes on LLM's of all time.
adamsmith143··on Anthropic's 100k context is now available in the web UI
Adobe isn't an AI company so it stands to reason that the AI product they put out is crap. Photoshop and their other products while not "Crap" are certainly overpriced relative to opensource competitors.
adamsmith143··on Don’t use sugar substitutes for weight loss, World Health Organization advises
This is probably impossible but also inadvisable since you likely can't eat any fruits or vegetable.
adamsmith143··on Anthropic's 100k context is now available in the web UI
Of course Adobe put out crap but Claude is a real product, not vaporware...
adamsmith143··on Imgur Updates TOS, Banning NSFW Content
Despite the fact that the Victorian era was quite conservative? So your point doesn't make a lot of sense to me. We're moving to a neo-victorian(more conservative/prude) era that is also shutting down Conservative speech?
adamsmith143··on Imgur Updates TOS, Banning NSFW Content
Genuine question, what does deplatforming conservatives have to do with Victorianism?
adamsmith143··on Imgur Updates TOS, Banning NSFW Content
I wonder how the upvote ratio would look on HN if someone posted about wanting to decrease taxes on entrepreneurs?

That;s a pretty standard Conservative position that I think would be well received here.

adamsmith143··on Anthropic’s $5B, 4-year plan to take on OpenAI
>The only reality in which Anthropic will take on OpenAI (et. al.), would be if someone involved possess some sacred knowledge regarding how to build an AGI system that is radically off the path that the current market is charging down (i.e. ever-larger GPU farms and transformer-style models).

Train on More tokens with More GPUs isn't exactly rocket science. I assume the RLHF loop is complex but training the base model itself is pretty well understood.

adamsmith143··on Anthropic’s $5B, 4-year plan to take on OpenAI
With the recent scaling law papers that have come out you can evidently predict with pretty high accuracy how good your model will be by plotting out the scaling curves. So performance @ X Flops and Y tokens can be reasonably well known ahead of time.
adamsmith143··on Anthropic’s $5B, 4-year plan to take on OpenAI
To be fair I think he had the same realization that they had at OpenAI. Sam Altman has gone on the record saying it's basically impossible to raise significant amounts of money as a pure nonprofit and you aren't going to train cutting edge foundation models without a lot of cash. Anthropic is saying they literally need to spend $1B over 18 months to train their next Claude version.
adamsmith143··on GPT-4 Is a Reasoning Engine
If you can't understand my position from my counter question then I don't think it's worth continuing. You believe human brains are special meat with super powers and silicon can't possibly think because it doesn't have a soul or some other new age BS.
adamsmith143··on What it’s like to fall into the deadly Australian plant, gympie-gympie
Is it any better in the US where corporations, cars, trucks, alligators, wolves, bears, rattlesnakes, and most of all other people all want to kill you?
adamsmith143··on ‘Alien calculus’ could save particle physics from infinities
Seems mostly solved with prompting. I.e. "Rewrite this essay in the style of John Steinbeck." Works quite well.
adamsmith143··on GPT-4 Is a Reasoning Engine
If I throw a ball at you and you attempt to catch it do you think the brain is NOT doing unconscious math to predict the likely trajectory of the ball so you know where to place your hand to catch it? What processes outside of Physics and Math and Probability is the brain using to interact with the world?
adamsmith143··on Bob Lee, former CTO of Square, has died after being stabbed in San Francisco
Anon goes into daylight. "This German guy looked directly at me, he was probably about to stab me." "Europe is so dangerous omg."
adamsmith143··on Bob Lee, former CTO of Square, has died after being stabbed in San Francisco
Gonna go out on a limb and say that a US vs Europe comparison on crime rates is not going to show the US in a good light either.
adamsmith143··on Bob Lee, former CTO of Square, has died after being stabbed in San Francisco
This might be shocking but if you legalize a crime i.e. shoplifting, you shouldn't be surprised this increases the rate of that thing occurring.
adamsmith143··on Bob Lee, former CTO of Square, has died after being stabbed in San Francisco
Apparently Murder is the only crime relevant to SF residents? The fact that SF is top 5 in Property crime per capita in the entire nation is irrelevant?
adamsmith143··on Bob Lee, former CTO of Square, has died after being stabbed in San Francisco
4th highest property crime rate in the entire nation. Middle of the pack for violent crime. Many have left for Austin, Texas which has half as much property crime and almost half as much violent crime per capita. So yeah significantly safer.
adamsmith143··on We need a more sophisticated debate about AI
>specifically they believe that long term considerations must include billions/trillions of future unborn AI minds that require as much humanity and care, even starting now, in proportion to current/future smaller numbers of physical beings. a lot of wacky thought comes out of these foundations

This is a clear strawman and not representative of what actual longtermists believe.

adamsmith143··on GPT-4 Is a Reasoning Engine
>Whether that specific question was in the training corpus or not, there are enough words in the sentence to suggest a positive association, including, significantly, "worthwhile." That alone possibly serves to narrow the answers down to A or B, with a preference for B, because it's more likely that "worthwhile" and "letter to x mother" are associated with "enamored" in general English-language text.

This is reasoning, what you've described is reasoning.

adamsmith143··on GPT-4 Is a Reasoning Engine
> These are tests which require reasoning in humans. A human can't reasonably be expected to pass Quant or Verbal tests without reasoning about the information given, but--and I can't stress this enough--large language models are not humans.

A tale as old as time: "It is illustrated by the success of chess computers. In the 60s, it was said that computers will never beat people at chess, because that requires intelligence and computers aren't capable of intelligent thought.

When computers regularly started winning matches in the 80s, it was claimed that playing chess wasn't a test of real intelligence because computers could do it."

>Whether that specific question was in the training corpus or not, there are enough words in the sentence to suggest a positive association, including, significantly, "worthwhile." That alone possibly serves to narrow the answers down to A or B, with a preference for B, because it's more likely that "worthwhile" and "letter to x mother" are associated with "enamored" in general English-language text.

Yes, this is called reasoning so in other words the LLM is reasoning about language.

>Look, the whole point of these models is that its not easy or even possible to trace the path any given input takes on its way to output, but we know the principles used in development, so I think it's rather more of a burden to explain how the clearly-explained principles in LLMs result in something other than the obvious.

The inscrutability of the Matrices tells you nothing about it's reasoning ability. Given the correct prompt the LLM will also provide you with a step by step solution to the question it answered. There are also explicit reasoning prompts that these models are able to deal with.

I think it's pretty simple, if these questions are not explicitly in the training data it cannot have answered them correctly at such a high success rate with anything other than reasoning. You haven't given any alternative answer to how it does this either.

adamsmith143··on GPT-4 Is a Reasoning Engine
GPT4 scores quite well on a whole slew of Academic Tests which require reasoning. These scores are on simulated exams that were not present in it's training data. How do you think it's possible to pass the Bar exam or score in the 80th and 99th percentile on the GRE Q and V sections respectively without any reasoning ability?
← PreviousPage 4 of 31Next →