https://github.com/mlc-ai/web-llm basically bringing the power of llms to web browsers via WebGPU. i think it’s useful because it’s better for privacy as nothing leaves your browser.

having that said i dont see how this is feasible yet on a widespread public scale given how computational intensive this is.