Hacker News Reader

wrote a web-demo, runs in your browser

Nice! Strangely, "Nano" sounds a lot better than "Micro" to me.

On my iPhone 14 Pro the page crashes after 2-3 plays. I wonder if it uses too much memory?

right. happens on my 13 too. memory leak confirmed, not sure yet what's causing it

unable to fix it. latest dev ort, dispoing tensors, restarting the session/worker. nothing, crashes every time.

defaulting to wasm on ios devices now

Maybe try using https://www.npmjs.com/package/@jax-js/onnx ? It supports most ONNX ops and should be drop-in replacement, e.g., https://jax-js.com/d-fine

Disclaimer: I am the author

also, i double checked, nano is nano and micro is micro. didnt fuck that up

For me, the Micro model appears to waver in a very distracting way when it says “small voice.” The Nano model doesn’t.