HNHacker News
TopNewBestAskShowJobs

gliptic

1,103 karma · joined March 22, 2009

submissionscomments
gliptic··on A (hopefully) new compression algorithm that uses binomials
Not if the counts are updated correctly.
gliptic··on A (hopefully) new compression algorithm that uses binomials
> Huffman, ANS, arithmetic coding, etc do not include the frequency counts as part of the size afaik, though of course that needs to be stored to decode, if not please link me.

They may or they may not. There are schemes doing both. Either way, you cannot compare arithmetic coding given no information to your scheme that is given the exact frequencies of every symbol.

gliptic··on A (hopefully) new compression algorithm that uses binomials
With arithmetic coding this requires 1 bit to store: the value of the first bit. The other is known with 100% probability. This is very simple to implement, especially with bit-wise arithmetic coding.

The problem is that the Shannon limit doesn't apply to your example. A fixed 1:1 ratio bit string is not I.I.D.

gliptic··on A (hopefully) new compression algorithm that uses binomials
I don't see why arithmetic coding wouldn't match this if the probabilities are suitably updated after every symbol. If you encode 8 bits, 4:4 ratio, after the first bit is encoded, either 1 or 0 has a remaining count of 3, etc. And when the count of either 0 or 1 reaches 0, the rest of the bits are known.
gliptic··on Text-to-Music Editing for Music Language Models via Instruction Tuning
500 Internal Server Error. HN hug?
gliptic··on Possible exposure of Earth to dense interstellar medium 2-3M years ago
Punctuated equilibrium is not about higher mutation rates or even faster evolution, but about long periods of _stasis_ interrupted by "normal rate" evolution due to an upset in the equilibrium such as a sudden geographic isolation of two populations.
gliptic··on Single atom defect in 2D material can hold quantum information at room temp
Decoherence is what GP means with information leakage. The quantum state of the object becomes correlated with the environment.

The article is saying this can be avoided in their system for a _microsecond_, still long enough to be potentially useful.

gliptic··on Regular expression matching can be simple and fast (2007)
NFAs are decidable. As you said, a NFA can be converted to a DFA which is decidable. Maybe you mean they are non-deterministic (that's in the name)?
gliptic··on Starting emails with "BEGIN PGP MESSAGE" will fool the filter
mIRC having a security hole with DCC SEND is exactly why some routers decided to filter it. EDIT: Perhaps I'm misremembering this. It seems it might have been due to some bugged port remapping code in the routers.
gliptic··on Show HN: An open source alternative to some of Slack AI's premium features
> I decided to open-source the version I built in September 2024.

I think this is the most impressive part!

gliptic··on The search for easier safe systems programming
Zig doesn't have anything like the safety guarantees of Rust.
gliptic··on Linux When?
IRC was what was initially called multiplayer notepad.
gliptic··on Using a LLM to compress text
llama.cpp isn't a model though.
gliptic··on LLMs can't do probability
Incorrect. The output of the decoder LLM is logits that are then divided by the temperature and passed through softmax to give the probabilities. You can't actually set temperature to 0 (division by zero), but in the limit where temperature approaches 0, softmax converges to argmax.

Temperature = 1 is where it's not pushed in either direction.

gliptic··on TypeScript: Branded Types
Yes.
gliptic··on Morton: Bit Interleaving in C/C++
https://en.wikipedia.org/wiki/Z-order_curve
gliptic··on Mixtral 8x22B
And where does it say that's the instruct model?
gliptic··on The simple beauty of XOR floating point compression
But context modelling isn't dictionary compression. Parent is correct that dictionary compression itself (e.g. LZ4) isn't very useful for floating point.
gliptic··on Towards 1-bit Machine Learning Models
But it's using larger weights during training, not just the trits.
gliptic··on Dropping GNOME's X11 session approved for Fedora 41
Lots of things running under Xwayland are unusable until the implicit/explicit sync issue between nvidia/wayland is resolved.
gliptic··on The Era of 1-bit LLMs: ternary parameters for cost-effective computing
They also trained 3B with 2 trillion tokens.

> The number of training tokens is a crucial factor for LLMs. To test the scalability of BitNet b1.58 in terms of tokens, we trained a BitNet b1.58 model with 2T tokens following the data recipe of StableLM-3B [ TBMR], which is the state-of-the-art open-source 3B model.

> [..]

> Our findings shows that BitNet b1.58 achieves a superior performance on all end tasks, indicating that 1.58-bit LLMs also have strong generalization capabilities.

gliptic··on The Era of 1-bit LLMs: ternary parameters for cost-effective computing
> Also, a quick reminder that Perplexity 12 is really terrible.

The 3B model had a perplexity of 9.91, less than LLaMa 1 in fp16.

gliptic··on Xkcd: Greenhouse Effect
After the discovery of the greenhouse effect in Earth's atmosphere of course, as per the xkcd.
gliptic··on A drone that calculates coordinates using a camera and Google Maps
The unknown part is drift caused by measurement error, which will stack up very quickly.
gliptic··on Understanding, using, and finetuning Gemma
From the repo:

> Run LLMs locally on Cloud Workstations. Uses:

> Quantized models from [Huggingface]

> llama-cpp-python's webserver

But sure, the blog post doesn't mention it.

gliptic··on Understanding, using, and finetuning Gemma
> Google also took llama.cpp and used it in one of their Github repos without giving credit. Again, not cool.

Are you talking about gemma.cpp? Then no, they didn't.

gliptic··on The Fossil Sync Protocol
It's not nearly that bad. You effectively did the sqrt twice by setting m = 2^80 when it should be 2^160.

You need 5.4e19 artifacts before the chance is 1 in a billion.

gliptic··on Japan: Moon lander Slim comes back to life and resumes mission
It = JAXA.
gliptic··on All 7 planets could fit between Earth and the Moon
It's called Cislunar space if you please.
gliptic··on Lego Mechanical Computer
Rod logic seems to fit the bill (https://anthony-zhang.me/blog/rod-logic/).
← PreviousPage 3 of 12Next →