andy99

Yeah, I don’t understand why people have a problem with this. I think it should basically always be true between peer nations that there is free movement and trade.

I just read the first part and if I understand he thinks we shouldn’t be allowed to train LLMs to act like they are conscious because then people will think they are and give them rights? Seems more an education problem than a problem needing rules about what persona you can fine tune in. People who want to will find ridiculous misinterpretations no matter what you do.

Openrouter lets you pick your provider and see their policy re retention and training. You can pick US providers e.g. digitalocean that don’t retain or train on your data. Openrouter is also now owned by stripe, so I don’t see any reason why using them with a trusted provider is riskier than using the big two (especially in light of some of the whole Navier Stokes thing)

If it’s really sensitive then don’t use a cloud provider.

I’m not super familiar with the options, but isn’t there O-1 for anyone who’s world class commanding a million dollar salary? The impression I have (mostly from online discussion) is that H-1B is basically only for (comparatively) low skill workers to come work for lower salaries. Are there cases where globally competitive people would come on a H-1B?

The public discourse was very different then. Misinformation, bias, etc. Those in power were much more concerned about an LLM saying something unapproved.

See also the 2023 call to “ pause for at least 6 months the training of AI systems more powerful than GPT-4.” https://futureoflife.org/open-letter/pause-giant-ai-experime...

Signed by Benjio, Musk, Woz, etc

So I first read this comment and thought is looked like AI and thought I’d give the benefit of the doubt. Then I saw this where there is no doubt: https://news.ycombinator.com/item?id=49687774

I thought, I wonder if it’s the same guy? Sure enough.

Stop it.

How much of the “danger” is from better models vs the harness?

Isn’t the current risk due to how AI is configured, like giving it a full set of tools and internet access and a goal to hack stuff?

If we think we need laws or gate keeping, why isn’t it at this level? I already can’t ddos someone or fuzz their server or whatever right, I imagine if I threw equivalent compute at old school hacking I’d just get arrested.

The quality of the “frontier” model doesn’t really matter, they just generate transcripts, they can take no action.

If this was real they’d be calling on people to stop hooking them in to “dangerous” harnesses as opposed to pausing research. But it’s not.

Wouldn’t it most likely mean their progress is slowing and they want to make it appear as a deliberate decision for the good of humanity instead of admitting growth follows a logistic curve in advance of their IPOs?

Is there any indication stretching leads to improved health outcomes like resistance training does per the article?

Everything I’ve seen indicates it’s a “nice to have” if one has unlimited time but if you’ve only got an hour a day or whatever for a workout you’re better off spending it all on resistance training.

I work out at home with dumbells, the one thing I miss vs a gym is some way to do lat pull downs. I can’t do a chin up and don’t feel like I’ve got a good way to work up to it.

I also don’t work legs super seriously, I have 2x75lb dumbells I use for squats and deadlifts, I could do more if I had heavier weights but that’s not a priority.

  Erlich Bachman: Jian-Yang, what're you doing? This is Palo Alto. People are lunatics about smoking here. We don't enjoy all the freedoms that you have in China.

Anyway, when the talk of age verification first came out, I moved off of Claude and use either local or Chinese frontier models via open router (which probably isn’t safe for long now that they’ve been acquired). I’d almost forgotten why, this is a good reminder.

With HF bought as well, I wouldn’t be surprised to see them try to gate open models by age too. Going to have to sign up for modelscope

When I saw the 192GB I first thought they might have beat Framework to market with a Gorgon Halo machine with unified RAM that Framework has teased. This is just a GPU workstation.

Funny how they include nvidia, micron, and AMD revenue as “AI revenue” and that it represents that majority of industry revenue but presumably a big chunk of everyone else’s spend. Almost might as well include electric utility revenue as AI Revenue by that metric

Interesting, thanks. Looks like also guilty of assuming the first place I saw it was the definitive source.

Found it really funny to see this attributed to a Slashdot meme

Is there a specific concern you have, and what kind of performance penalty is it worth to you on say coding tasks?

Conceptually, sure I understand, but in practice it currently seems like it amounts to just using a worse model without getting anything in return. And if some hypothetical alignment to European values is important, it seems like putting the necessary effort into building a model that’s actually competitive but has this alignment is the solution, rather than accepting an inferior one.

Agree benchmarks don’t tell the whole story. A better and easier evaluation of capability is whether anyone is using it for anything.

Does Mistral have material market share for any application, including anything that would fall under item 2 above?

What’s the point of having “sovereign” weights that are worse than publicly available ones? Wouldn’t Europe be better off just keeping up-to-date on the Chinese releases? In the event of some schism requiring sovereign capability, or even if the Chinese pulled ahead and stopped releasing the weights, why would Europe be better off because of Mistral? (Or any country’s inferior sovereign effort make them better off?)

I think I understand the incentives that cause this to exist (it would be politically worse to say we’re just going to use Chinese models) but they are misguided. If sovereigns want to have valuable models, they should insist on world class, relevant ones like the Chinese have. Instead they embrace mediocrity in the name of sovereignty.

This misunderstands what it means to be better at writing. Root cause here is that writing is how humans communicate ideas. An LLM written thing isn’t doing that, it’s something equivalent to copy/pasting a Wikipedia article. Even if the writing gets better, it will still be necessarily empty when expanding anything that isn’t completely specified.

LLMs seem already to be pretty good at translating, where you already have something fully written and are changing the language. It’s when they get rough ideas and fill in the gaps you get the empty prose they are known for.

So many people seem completely blind to LLM writing, they are fine sharing it on social media or at work. I think it’s people who are “not details people” and are used to judging something without reading it based on superficial cues which is what LLMs are optimized for.

And of course anyone who actually reads stuff is disgusted by it, so we quickly end up with a situation where content is piling up and nobody is consuming it which is basically dead internet theory.

On LinkedIn specifically I went from reading it regularly to almost never touching it, previously the nonsense (“the interviewer was the dog”) was still tolerable enough to flip through for updates and I found the platform useful for business leads. Now it’s just a feed of pure slop, when I do open it I just close again after reading a post is two when I remember how bad it is.

It’s funny, it’s obviously understandable why someone would vibe code a placeholder website, we’ve all probably done it. But I’m realizing a basic unstyled html thing with minimal copy is probably a better signal at this point for startups, it makes it clear you are still working on it rather than giving up the impression you might think your vibeslop is the finished product.

“We’re looking for athletes”

I’ve been a cleaner, and watched other people clean. I had a theory that if you paid $100k (or whatever good salary) you would probably get more value than paying 5 people 20k. I think there’s lots of value in paying people well at “low skill” jobs when you actually want them to be good, but also probably lots of reasons it never gets tried. Most of the time it would be the owner of a small business doing the high value version of the low skill job I suspect.

Do you have data on the tokens or $ cost of this?

Very cool, after watching a minute it grew on me and I can see why the perspective is useful.

My immediate thought is that this is what is would be like to drive in The Spindle in Neuromancer or any similar space environment that’s spinning for artificial gravity.

It was funny to watch this discussion turn from skepticism at the top to then a bunch of proponents moving in and crowding out the rational voices. It feels a bit religious to me, at least unscientific, there are obviously no testable hypotheses about subjective descriptions, and so people seem to dig in on their sides more than if there was a real basis for comparison. I default to not believing in it until there is actual strong evidence, same as ghosts and the Loch Ness monster and whatnot.

I feel like there would be much more obvious practical differences if it was a real thing. The spectrum as described seems so different from one end to the other that we seemingly have people who can switch reality into a movie of their choosing on one side and people who can’t imagine like what a square is on the other. It seems like communication would necessarily have to be very different, books would be different depending on the authors phantasia, UI/UX would be different - it’s hard to believe everything is so homogenous if it’s really serving people with such different visual capacity.

I’ve see no evidence it’s anything but this. I have no idea if I have it or not or just describe stuff differently. I think this is logically much more likely. It’s a “what does it feel like to be conscious?” or “is my red your red” kind of question. There’s no external benchmark, no way to objectively compare, so you just get a spectrum of reports about the same thing.

> techno zaibatsu

Reminded of this discussion from a few days ago https://news.ycombinator.com/item?id=49389372

We have the techno-feudalism and dystopia but none of the cool aesthetics from cyber punk or arguably even the real Zaibatsu. Nvidia isn’t cool, there’s no interesting aesthetics or back story, it doesn’t appear to have zaibatsu ambitions, it’s just riding a meme stock bubble.

In a different world I can imagine SpaceX to be the only thing that could come close, but well...

Didn’t we just witness it? Become a critical ecosystem player then get acquired based on the value of that position.