3,738 karma · joined March 19, 2015
Twitter ------ https://twitter.com/NickFisherAU
GitHub ------ https://github.com/nmfisher
Blog ------ https://hydroxide.dev
Company ------ https://holotype.com.sg
Working On ------ https://mixreel.ai
Gumroad ------ https://nickfisher.gumroad.com/l/tvzndw
The third party package ecosystem is smaller but I think this will become less and less relevant as coding agents get better.
But if you spent any time with the older generation over the holiday break, it’s immediately obvious why it makes no difference. They sit there and scroll Facebook and Instagram advertising slop for multiple hours literally every single day.
Facebook will keep hoovering up cash until at least that generation dies off (and possibly the one after that too).
Actually in Australia, IDs usually do get scanned and stored. About the same time I was getting too old for clubs, they were starting to introduce ID scanners. You line up, hand over your driver's licence or passport, they slap it on a wall-mounted scanner, the scan goes into a database and in you go. No scan, no entry. Nowadays I think they just use phone/tablet scanners.
If I were back on the job market, I’d be demanding a big premium to go through it again. It’s very intrusive, puts significant limitations on where you can go, and adds significant job uncertainty (since your job is now tied to your clearance).
I'd be much more in favour of oral examinations. Yes, they're more resource-intensive than grading written booklets, but it's not infeasible. Separately, I also hope it might go some way to lessening the attitude of "teaching to the test".
Ask away. Best method I’ve found so far for this.
The average public investor buying pre-IPO shares, though, is a different story.
They definitely have a strong consumer brand so it’s not like they’re going to disappear, but I understand the bear case.
The blog post addresses this directly with samples from their own baseline (an autoregressive mu-law vocoder), and from WaveNet (which was similar architecture). The sound is mostly recognizable as a human voice, but it's unintelligible. The sequence length is too long and the SNR for the encoding scheme is too low for an generative/autoregressive model to learn.
This is what the neural codec is intended to address. Decoupling semantic from acoustic modelling is an important step ("how our ears interpret a sound" vs. "what we need to reconstruct the exact acoustic signal"). Mimi works at 1.1kbps, and others work at low bitrates (descript, semanticodec, etc). Encodec runs at at a higher bitrate so generally delivers better audio quality.
Now - why are neural codecs easier to model than conventional parametric codecs? I don't know. Maybe they're not, maybe it's just an artifact of the transformer architecture (since semantic tokens are generally extracted from self-supervised models like WavLM). It's definitely an interesting question.
That's why residual vector quantization is a useful technique - using multiple dictionaries to quantize a single timeslice, each conditioned on the previous residual level. You can also quantize a signal at different frequencies.
There are samples towards the end of the post of their LLM trained on their Mimi audio codec.
After being burned a few times, I think I'm going to ignore any new Cloudflare product for 12 months after stable release. If their products worked as advertised, I'd be willing to pay considerably more. I think their commitment to the free tier is hamstringing them a little bit.
I also don't think the "Sam Altman" videos were authentic/organic at all, smells much more like a coordinated astroturfing campaign.
That being said, I'm also 100% behind the effort to standardize WASM as the cross-platform compilation target of choice.
It's not necessarily manipulative but it's also not exactly an arms-length purchase of GPUs on the open market.
This is what Flutter does. It works well, but you do lose some nice things that the browser/DOM provides (accessibility, zooming, text sizing/selection, etc). There’s also a noticeable overhead when the app + renderer is initially downloaded).
Between OpenAI, Anthropic, Google, Facebook, xai, Microsoft, Mistral, Alibaba, DeepSeek, z.ai, Falcon, and many others, AI feels a lot more competitive.
I maintain an open-source Dart/Flutter package[0] which is mostly a wrapper around Filament. This makes it considerably easier to have a single UI+codebase that runs across macOS, iOS, Android, Windows, and Web.