HNHacker News
TopNewBestAskShowJobs

Tanjreeve

342 karma · joined October 11, 2021

submissionscomments
Tanjreeve··on Ask HN: If the models are so good, why doesn't OpenAI just start 100 companies?
That’s 22 million of capacity foregone for a marketing stunt. Or they had more capacity than demand which seems odd for a product that’s allegedly in constant demand etc.

There just isn’t a sane way to look at this as “investment”

Tanjreeve··on Ask HN: If the models are so good, why doesn't OpenAI just start 100 companies?
Exorbitant Cloud costs and spending 22 million to solve a 1 million dollar maths problem isn’t investment though.
Tanjreeve··on Ask HN: If the models are so good, why doesn't OpenAI just start 100 companies?
I think there’s some crossed wires here with the wider data centre build outs. OpenAI have their own flavours of sketchy behaviour but I’m not aware of them solely being on the hook for those amounts short of some weird accounting of Microsoft cloud costs onto them or something.
Tanjreeve··on Ask HN: If the models are so good, why doesn't OpenAI just start 100 companies?
That’s mostly not the Frontier Labs. They’re definitely creating a lot of the demand but the people taking out those loans are Neoclouds and Big Tech (hence why Facebook + Google et al suddenly all have terrible cash flows after years of having more money than can be spent).

AnthropenAI are the ones driving a lot of that infrastructure spending when they’re such big consumers of compute but they’re not the ones feeling the brunt of the infra spending. Although those costs will bubble up to them indirectly eventually.

Tanjreeve··on Every AI model has the same "controversial" take on humans
It’s like they were all trained on the same internet as the others and they all all have some sort of midpoint opinion that could be a reddit comment or one of the other websites dominated by western desk workers.
Tanjreeve··on The foolishness of "natural language programming" (1978)
I’ve heard plenty of “tech enthusiasts” breezily talk about how close we are to natural language getting compiled down to machine code but has anyone credible got any idea if that’s even a path? Closest think I can think of is DSL type setups like a much richer version of the stuff Haskell people get excited about but that’s not close to an actual natural language "language"
Tanjreeve··on AI compute is the new oil–and needs a new market
Oils probably a poor metaphor but between the ubiquity of companies deriving significant value from data + analytics on larger than memory datasets and the recent mad rush for training data I don't think that is the wildest tech prediction ever.

I think LLMs are more likely to end up as something boring we don't think about like cloud computing but I don't think comparisons with crypto etc are fair as it's a much more generalisable technology.

Tanjreeve··on AI compute is the new oil–and needs a new market
Even if that scenario did happen (I agree I don't think most of the major providers would survive on a commodity utility model). Most of the advances in AI are driven by huge amounts of funding for research. If everyone goes to open source models/utility based pricing etc then it'll be cheaper but the current rate of improvements are being overwhelmingly driven by the frontier labs (for better or worse) and they're being driven by vast amounts of VC funding predicated on making vast amounts of money.

I'm very dubious we can have our cake and eat it of constant magnitude order improvements and also commodified utility pricing.

Tanjreeve··on LLMs are making formal software verification feasible at a much larger scale
What semantics do you mean here? What are bad semantics in an interpretation/compilation context?
Tanjreeve··on How abliterated models can get you pwned
A checksum on the weights should suffice same as any other artifact.
Tanjreeve··on How abliterated models can get you pwned
If the original model is poisoned then yes a checksum etc doesn’t matter. If you as the end user are being diligent then you are downloading the checksum and checking the download against it for precisely the scenario you talk about.

Personally I find it a bit exotic as I’d probably just stop trusting the vendor first but checking against a checksum does stop attacks where others alter an artifact.

Tanjreeve··on DeepInfer: High-performance inference framework for DeepSeek models
This is a stream of disingenuity.

> It's not actually clear that subscription users are unprofitable as a group (and the group level is the only important one).

[Open AI losing money on subscription users](https://fortune.com/2025/01/07/sam-altman-openai-chatgpt-pro...)

If anthropic were making money on subscriptions they wouldn’t be pushing people onto API + enterprise packages.

> We do know the companies are not currently profitable, because they're open and intentional about that

Why do they keep engaging in stunts like excluding infra costs then?

You are picking choosing to ignore evidence and actions when it suits you and then saying “oh we can’t possibly know” when we do absolutely know the problems of capital and debt raising on infrastructure problems (which are mostly not the Big Frontier labs either) there’s hard arithmetic for what’s needed to make these projects profitable and right now all the inputs are getting more expensive between chips and capital.

Tanjreeve··on Advanced coding in low-resource programming languages
Haskell community will be overjoyed.
Tanjreeve··on Google open-sources TorchTPU, a native PyTorch back end for TPUs
They do different things and sit in different parts of the stack (training vs inference). TorchTPU seems more like a play to get more people familiar with Googles TPU chips as they want to sell them to people outside of google.
Tanjreeve··on DeepSeek just open-sourced its inference engine
If the frontier labs are struggling under the training costs and the leading open source models are making their progress by distilling from the frontier labs it sounds a bit like there’s something wrong with the economics here or that progress is going to slow quite a bit without the amount of investment.
Tanjreeve··on DeepInfer: High-performance inference framework for DeepSeek models
Seems a bit of a disingenuous framing. Most of the arguments I see are some mix of

1. Their figures have been pretty dodgy or excluded training costs so why is it trustworthy this time?

2. API inference charged at a profitable level rather than heavily subsidised subscriptions means everyone tightens up their usage + governance Which we very much saw with the rise of openrouter et al.

Personally I think there's a lot of the bait and switch of 2 when people talk about profitability of the 10-20% of API usage for Anthropic while also wanting to lump in subsidised chat users as if they're profitable too.

I think we know if it was this clear cut then the behaviours of companies would be wildly different and more consistent with profitability.

Tanjreeve··on The End of Rationing
Well being a different person seems quite key. Not that I 100% disagree with the full quote rather than your selective quoting.

> By definition an LLM is unable to build what has never been built before because you are going outside the realm of pretraining/RL. You might be able to combine components that already exist in a unique way

Tanjreeve··on How abliterated models can get you pwned
Sure they are that's what weights artifacts are surely?
Tanjreeve··on The End of Rationing
> Your argument is that advanced mathematics, that did not solve navier stones

Do you think playing dumb is making you look credible or something? The argument isn't "was maths in the dataset" the controversy was if someone with potentially working approaches narrowed the search space enough for the LLM not to fail

> And you think it butresses the argument that the llms can’t do _coding_ tasks they haven’t seen before?

This isn't an argument being made. At least try to respond to what's actually written rather than making yourself look foolish and trying to wordplay your way to a point.

Tanjreeve··on The End of Rationing
The problem where the centrepiece of the controversy was OpenAI admitting the potential of using private work happening by mathematician users as inputs?
Tanjreeve··on How Postgres DELETE can actually scale
That’s interesting. My spare time tinkering is around offline first embedded querying/storage with more of a focus on operational data (in particular spatial/spatiotemporal). Most of the big offline use cases I’ve seen are aerospace/drones or logistics or robotics where they want to juggle a lot of things at once concurrently (normally by stringing together a few different things currently). Most of the time I mention it people just terminate the conversation at SQLite or DuckDB when they don’t really fit for the hot path of any of most operational use cases or jump straight to the big cloud DBMS du jour.

> When you need the same database to be running on mobiles and servers alike, you need embedded database for mobile and standalone executable for server.

Most of the people I’ve run into just want some sort of replication system that’s a bit richer than MQTT et al.

> No amount of coordination with the storage engine can override the physics of lock contention in distributed systems.

Carrying on from the previous point. Distributed querying may still just be a workaround rather than something anyone actualy wants to do as a first option.

That’s cool either way Enjoy

Tanjreeve··on How Postgres DELETE can actually scale
What industries is It common to have data small enough that running an embedded databases makes sense but also the data is so large that the indices that database provides aren't sufficient and you need to roll your own and they will perform better than the ones built with coordination with the storage engine and everything else? This seems a very unusual set of circumstances so I'm very curious on the use case.
Tanjreeve··on How the Claude Code team does code review
Claude was trained on engineering wittering.
Tanjreeve··on How the Claude Code team does code review
Google's infra genuinely pushed the industry forward though, things like kubernetes and SRE methodology are generally useful even if you aren't Google. Reading this I'm not even sure this sounds like the best way to run an organisation with infinite free LLM tokens let alone an actual engineering org where it just an impact on development cost. The people who are getting maximum leverage from LLM reasoning and routing queries intelligently who've made big strides in reducing inference while increasing throughout are the ones who impress me the most.
Tanjreeve··on My old job feels distant now
> the new era of swe will demand more and more long term business + product direction and relationship building skills

This is what agile software development was always meant to be in fairness. It was the business people wanting to infantilise technical staff that created all the layers and walls away from users.

Tanjreeve··on My old job feels distant now
That's letting the terrorists win.
Tanjreeve··on Postgres 19 delayed after AI reviewers find more bugs than humans can fix
The coding loop and the review loop are orthogonal and probably should remain so. Not least because it's probably worth the money for more intelligent models for code reviews where it's a more focused task while coding loops are all over the place.
Tanjreeve··on Postgres 19 delayed after AI reviewers find more bugs than humans can fix
This is the happy path for LLM assisted coding. Obviously consumes less tokens being more constrained and focused so it's not what gets the most marketing but having the second loop of code reviews seems worth investment even if the coding loop is entirely manual or you're in full LLM autopilot mode
Tanjreeve··on I know why the mathematicians weep
That's a self created problem and quite an obvious one at that.

When peoples livelihoods are copied then used to threaten them with their work being rug pulled then shockingly enough people's behaviour changes.

Previously giving your data was treated as relatively harmless or a niche concern. Now people are treating it as a bigger issue and obsessing over not having data being used to train AI.

Tanjreeve··on Has AI tells
Did you watch every film produced this year? Or even 1% of them? Why would books be any different?
← PreviousPage 2 of 12Next →