HNHacker News
TopNewBestAskShowJobs

_flux

1,513 karma · joined October 6, 2020

submissionscomments
_flux··on Why current LLM costs are not sustainable
So I let ChatGPT do the legwork for me, but it does seem the price difference between inference for GPT-5.5 and open-weight frontier models like DeepSeek V4 Pro and Kimi K2.6, which both are smaller models and thus cheaper to run inference on, is only 8x or so.

Sources https://openai.com/business/pricing/#api says for GPT-5.5:

  Input:$5.00 / 1M tokens Cached input:$0.50 / 1M tokens Output:$30.00 / 1M tokens
and for https://docs.fireworks.ai/serverless/pricing DeepSeek V4 Pro:

  Input: $1.74 / 1M tokens Cached input: $0.145 / 1M tokens Output: $3.48 / 
Ratios are: 2.8, 3.4, 8.6

So as these numbers seem reasonably comparable to SOTA, and the SOTA vendors have additional overhead, then I think it is fair to deem that the alternative explanation offered here is not the explanation:

> Why do you think that subscriptions are subsidized and not that enterprise tokens are sold at 3000% margin?

As it does seem like the GPT-5.5 API tokens do not have significant margin based on the overhead-free companies selling inference for smaller models at prices of the same scale, I think we can believe that the subscriptions must be heavily subsidized.

It should be noted though that DeepSeek itself sells this even cheaper, but they may also be in it for the getting market share.

_flux··on Why current LLM costs are not sustainable
So they do not train models, and in addition their models are expected to be smaller than SOTA models, although we cannot know for sure by how much.

So what's the price difference, 3000x?

_flux··on Why current LLM costs are not sustainable
I think this comes from the idea that serving these tokens without paying for training is already expensive, e.g. https://news.ycombinator.com/item?id=46613887 self-hosted solution might give you only 10-100x more affordable solution at cost.

So, given the SOTA providers with even larger models also need to continously be using considerable resources for training their next models, to fund future data centers, and make profit, the token costs are more likely reflecting the real costs, rather than the subscription costs.

_flux··on Zig's new bitCast semantics and LLVM back end improvements
You too could have it easily accessible on your keyboard by using EurKEY: https://eurkey.steffen.bruentjen.eu/
_flux··on LuaJIT 3.0 proposed syntax extensions
Surely the most likely explanation is familiary from C?

But e.g. ml-family languages (like OCaml, F#, Haskell) and Rust just have the *if* expression that has a non-void value. If your language accepts expressions as statements (most do?), then I think that should just be compatible out of the box.

_flux··on The new HTTP QUERY method explained
There is the Accept-Query header https://www.rfc-editor.org/info/rfc10008/#appendix-A.3 that tells you can use QUERY. That's a bit different.
_flux··on Steam Machine launches today
I believe that's exactly what the Steam Machine reservation does: limits to one per household, so I take that to mean the address without the name.

Although I think the language in the response dialog will be nicer than accusing of fraud.

_flux··on Writing Postcards with a 3D Printer
I've also used 3d printer to straight up print on top of a greeting card (the print was 1 layer).

The print might not fare that well though the post system, though, so maybe it wouldn't be suitable for postcards. But it can be a nice touch.

_flux··on Gribouille 0.3.0: A Grammar of Graphics for Typst
Perhaps you would enjoy the rest of the tooling, that may be useful in scientific contexts or in books discussing programming languages. Or perhaps you would also want to publish in PDF, like for an actual print book.

What kind of issues did you expect to encounter in translating Typst documents to other languages?

_flux··on Gribouille 0.3.0: A Grammar of Graphics for Typst
Typst html support is already available as an experimental feature, so e.g. EPUB probably isn't too much work in addition to that (as I understand it, it's basically zipped HTML with some metadata). It's also in the roadmap: https://typst.app/docs/roadmap/#:~:text=EPUB%20export .

If the translator has access to a service like typst.app, then I don't see too many obstacles for translating. But I don't have any experience on doing translations.

_flux··on Google Chrome update will close the door on ad blockers
I was under the impression MV3 is stricly less capable in terms of blocking ability than MV2?
_flux··on TinyWind: A pixel pirate sailing game with real wind physics (380k+ kms sailed)
Should there be sound? I think sounds would be essential for this.

Running on Linux Firefox.

_flux··on Malicious npm packages detected across Red Hat Cloud Services
I think if they did it, then attackers would be able to iterate their attack against their own project, and once it passes the filters they could deploy for real.

I guess it could work better if it was enabled for only actual attack vectors projects.

_flux··on Malicious npm packages detected across Red Hat Cloud Services
> Maybe NPM should run scanners before distributing malware?

I suspect there's always a human checking these results. If NPM straight out rejects an update due to suspected malware, they might end up rejecting correct updates as well. If they grant some "safe" patterns a special pass, they might get exploited.

So I think this only works if you have security scanners that are well-maintained and kept in secret. NPM folks could of course co-operate with some security companies to have a first stab with the releases before they are put to public access. At some point some parties might start want to have monetary compensation for such an arragnement, though.

_flux··on Rift: Better Alternative to Git Worktrees
I don't have a reflink-able filesystem in this host, but I just tested that

    echo 2 | sudo tee /proc/sys/vm/drop_caches
    time cp -rl foo bar
took 2.6 seconds for 273000 files, so I think it's highly manageable. Reflinking might be a bit slower than hardlinking, though.
_flux··on Rift: Better Alternative to Git Worktrees
How about cp --reflink? Supported by btrfs, bcachefs and zfs. It's quite not as fast as subvolumes in btrfs, but it should be plenty fast.

This should actually be a feature for git itself, if it's not already.

_flux··on MCP is dead?
So are you using MCP to do this?

I'm not saying MCP or the ways we use it cannot be extended to cover this use case, but my understanding is that nobody does it. But shell/code does, and more.

_flux··on MCP is dead?
Let's say you have a jq MCP. How do you pass data in and out to/from it without the data also being processed as tokens?

That's really my only issue with MCPs.

With shell you can pass data from one component to another directly, not only being cheaper, faster, but also preserving complete integrity. While models nowadays seem to do data echoing well, there's always the chance they might not do it exactly.

There's no reason why a shell would not be able to limit abilities of a party using it as well, by virtue of just implementing only the desired functionality. What makes it more advanced in this context is the (standard) ability to express how to connect multiple components to each other, or to/from local storage. MCP does not have this.

Providing that does not have any inherent danger any more than jq's functions have an inherent danger. Actual execution of processes or real files does not need to be involved.

_flux··on MCP is dead?
jq cannot be just an MCP, unless it's acceptable that yuo pass all data through the context. If that's not acceptable and you want to have it as tool, then you need some other way to handle the data.

I think the basic solution to this is to have a "static shell" but with modern tools for the agents, not actually executing other binaries. It could have things like jq, curl, piping and redirection to/from session files. Maybe even Python if it can be made safe. If not, then there are a lot of languages can be.

_flux··on MCP is dead?
As far as I know, the only way an MCP can provide you data that doesn't go into the context is by providing URLs to the data, and then the model uses e.g. curl to access that data for data manipulation purposes. You could also return result set ids and provide accessors to such data, but ultimately you'd need to provide powerful accessors to that result set to avoid polluting context. Things like shell with all its power already provides.

It seems like there's little point in MCP in that case. Maybe more point if it was a standard mechanism for MCP to provide additional data, in a completely compatible fashion with all other tools? You could perhaps even pass such URLs to other MCPs. You could have an MCP for jq for doing stream processing. Starts to look a lot like a shell, though.

Seems like MCPs could also be extended to store auxiliary data to your memory (or filesystem..), and then an additional extension to provide that kind of data as auxiliary data in the calls to MCP.

Well, even as is, MCP still provides a standard method of using OAuth for accessing such services. And you must use MCP if you wish to add something to the ChatGPT.com web service, so it's easy to see why OpenAI folks are seeing companies going that way.

_flux··on MCP is dead?
Hmm, indeed, so maybe I could have all this as an MCP, so I can just easily pass any imaginable data manipulation inside it, and then also have it support calling other MCPs, all inside that one MCP, to avoid filling context with intermediate data..

Sounds a lot like a shell to me.

_flux··on MCP is dead?
Not having access to the shell is a big hindrance. I have my agent access Gitlab and Jira via CLI tools and in so many cases jq or python is used to manipulate or combine the data into a more useful format, making use of pipes and temporary files. You can of course limit what an agent can do, most easily by not giving it access to things it shouldn't do. I suppose there are no existing easy gateway methods to grant fine-grained OS-level permissions to add such things back, except perhaps `sudo` and similar tools.

MCPs are impossible to combine this way: everything you feed or get from them goes though the model and consumes tokens.

_flux··on Slumber a TUI HTTP Client
Virtual terminal is surprisingly capable, it even has word delete feature! And shells have some nice history features which I'm sure would become even more familiar if one had to use them (as I suppose was the case a long time ago), such as !$ that expands to the last argument of previous entry.
_flux··on Slumber a TUI HTTP Client
But they are just convenience features, not in my opinion the defining property. They basically work just the same without them.
_flux··on Slumber a TUI HTTP Client
On the other hand, there are many elements in the user interface that are not text. In fact, I think it would be quite understandable if one even separated REPLs like bash or octave to be "text user interfaces" while applications that make use of character placement and border special characters "terminal user interfaces", because they use means beyond text stream to communicate with the user. One might even render straight up graphics to a terminal [emulator application].

Even X had a separate application called xterm 42 years ago: the complete X system was not to my knowledge called a terminal system, except perhaps when discussing the dedicated client devices, such as VT1300. Also the term "virtual terminal" as far as I know has always referred to a the kind of interface this application is making use of.

So I think we can just accept that the term is overloaded such that "terminal" refers to both of these situations, as there is no historical precedent to have it exclude the other situation, and the term "terminal-based application" is completely clear to a rational listener.

_flux··on Show HN: Hsrs – Type-Safe Haskell Bindings Generator for Rust
It would be so nice if these "well typed languages" would be able to interact better with each other. Alas, the GC will probably cause some friction, e.g. the ocaml-rs package makes this pretty visible: https://github.com/zshipko/ocaml-rs/blob/master/examples/rus... . (I have not used either of these projects.)

Maybe the GC would be less of a problem if we didn't want to have the best possible performance as well.

_flux··on Prolog Coding Horror
Many years ago Maemo (the mobile OS from Nokia) had the profile manager (day mode/night mode etc) written in Prolog. To me it seems like it's a very appropriate application for it.
_flux··on Zerostack – A Unix-inspired coding agent written in pure Rust
To me it would certainly make sense if the protocol just said "append this text to context window id/sha256", in particular as the data is cached in tensor level in the provider side, so they need to first do that lookup anyway. So I would be surprised if they don't have that.

In addition, this protocol could make it more transparent to say "oh we cannot proceed as we dropped the this cache, are you sure you want to proceed and consume a whole lot of expensive uncached tokens?". Oh, maybe that's a reason not to do it..

_flux··on Tesla Wall Connector bootloader bypasses the firmware downgrade ratchet
So, this website being called "Hacker news", means.. ?

While hacking is used to to refer to illicit activities, I do actually believe that the same activities can also be performed e.g. on your own devices, or with permission, and still be called hacking. So in my view, I do not believe legality is the defining term, but the actual things you do; oftentimes useful for illegal activities.

But I must assume there is a group of people who consider the term to be loaded with that exclusion, so I should take this into account.

However, to me "hacking your own devices" as a concept seems crystal clear, and is not a contradictory term.

_flux··on Gyroflow: Video stabilization using gyroscope data
I actually don't think that's possible, if you assume the objects in the video can also shake and the intent is to eliminate only the camera shaking.
← PreviousPage 4 of 32Next →