Hacker News Reader

Comment by raw_anon_1111 | Hacker News Reader

Yeah that’s not how Big Enterprise works…

And most startups are just doing prompt engineering that will never go anywhere. The big companies will just throw a couple of developers at the feature and add it to their existing business.

View on HN

Big enterprise with mostly private companies as their clients? Lol, yeah, that’s how they work from my personal experience. The reality is, if it’s not a tech-first enterprise and already outsource part of tech to a shop outside of NA (which is almost majority at this point), they will do absolutely everything to cut the costs.

I spent three years working in consulting mostly in public sector and education and the last two working with startups to mid size commercial interest and a couple of financial institutions.

Before that I spent 6 years working between 3 companies in health care in a tech lead role. I’m 100% sure that any of those companies would I have immediately questioned my judgment for suggesting DeepSeek if had been a thing.

Absolutely none of them would ever have touched DeepSeek.

I've worked with financial services, and insurance providers that would have done the opposite for cost saving measures. So, I'm not sure what to say here.

Financial Services are far more risk averse first than they are cost cutting, they literally have risk departments.

If you'd spent anytime working at one for swe you won't have access to popular open source frameworks, let alone Chinese LLMs. The LLM development is mostly occurring through collaborations with the regional LLM businesses or internal labs.

Regulators would have the head of any financial institution that used a Chinese model.

Why would you be presenting what AI tech you are using? You would tell them AI will come from Amazon using a variety of models.

In various sectors, you need to be able to explain why you/your-system did what it did. Exchange Act Rule 15c3-5 is probably the most relevant in financial circles:

https://www.ecfr.gov/current/title-17/chapter-II/part-240/su...

Note: I am neither a lawyer nor in financial circles, but I do have an interest in the effects of market design and regulation as we get into a more deeply automated space.

To add on, while it doesn’t work with GenAI models as far as I know. AWS has a service around explainability around ML decisions

https://docs.aws.amazon.com/sagemaker/latest/dg/clarify-mode...

You still choose your model. I’m no more going to say “I’m using Bedrock” without being more specific than I would say “I’m using RDS” without specifying the database.

Reply on news.ycombinator.com