Hacker News Reader

Comment by regularfry | Hacker News Reader

The other choice is AWS Bedrock, if it happens to have the model you're interested in. They do have GLM-5.3. They don't have DS-4 or 4.1 yet, and updates are intermittent at best, but they're already on the trusted provider list for anywhere large enough to be interesting.

View on HN

That may not be acceptable for many companies outside of the USA.

Depends on the parameters of "acceptable", but they do offer inference in non-US zones. If the company is already on AWS for meaningful workloads with sensitive data (which is not uncommon), they've already been through the hard part.

That being said it's not quite as simple as would be ideal, you do need to check whether there's an additional EULA on your specific model choice.

Acceptable as in 'does not break the law'.

For data residency reasons? You can meet data residency requirements on AWS, I'm pretty sure. Mind sharing which condition blocked it in your experience? Mostly curious because in the US there isn't that much interest in on-prem deployments because it's easier to scale up and upgrade using the cloud and it's easier to use AWS because you don't have to run a new compliance process for each part of the stack.

You could until the Trump admin decided to (attempt to) overrule the deal that was in place (the DPF).

The perceived lack of independence of the FTC is a major driver behind the exodus on this side of the Atlantic and it isn't just the smaller players that are moving. Airbus for instance.

Now the datacenters supposedly operating under at-arms-length management are no longer sufficient for compliance.

There are calls to repeal the whole thing with respect to the US.

https://noyb.eu/en/us-supreme-court-just-blew-eu-us-data-tra...

Yes, biased source and title, but the contents are pretty good.

I see. So there's a risk that the EC or CJEU make a determination against the existing system because of the non-independence ruling of the FTC. So the movement away to regional providers is because no one wants to be caught surprised if the EC/CJEU make such a determination. Interesting. It must be early stage because from what I can see the most spend is still on the big two, but this does bode well for Mistral and EU-based open model hosts. Lots of room in the 20%.

It's early stage mostly due to inertia but there is a groundswell of movement. Airbus really turned some heads.

Yeah, about that... My kid works for a very small company. Chatted the other day about in-house inference vs ZDR providers and all. His team is trying to get access to GLM on AWS Bedrock. It is a second week they are trying to schedule a simple meeting to discuss what they need. Random silence, and back and forth from a new person each time. 2 WEEKS to just schedule a meeting... And as far as I know, no luck so far.

Update: they got back to us! Scheduled meeting early next week :facepalm:

Reply on news.ycombinator.com