moooff

I really like the approach with WASM and the browser sandbox. That alone makes this very usable. iam also working on an agent harnes in the browser sandbox called "hermit" using a local inference endpoint. It runs Python in WASM with a virtual file system.

https://moooff.github.io/HermitUI/hermit-agent/

So this Tool comes in very handy and will try to integrate it.

I was using it in an air gapped environment vs a local inference engine running a qwen-coder-next. Installtion of harnesses on the machine and other things were ruled out because of security constraints.

There i used it to analyze an old visual basic application which creates custom pdf files. it worked surprisingly well. it took some rounds but in the end it got all requirements and scaffolded me a skeleton for a python rewrite as a web-application. Then i worked from there with it to get a prototype.

Yeah, I found a bug during model load occurring with Firefox and low VRAM machines. It is fixed now, thanks!

The 1060 is unusually slow. The Mac mini sounds about right. Have fun playing around and sharing. With the more VRAM of the mini you can also run Qwen 3.8 27b :)

I really like to showcase this to non-tech people to show what their home machines already can do WITHOUT INSTALLATION in an air-gapped scenario! And given all the recent fuss, we should not trust the big providers at all with important data.

Thank you for testing. i just checked it works with Chrome.

FireFox seems broken in the current Version i.e. i can reproduce the bug. Working on it.

Which browser do you use?

I did a WebGPU-based HTML Single-File Chat Application even for larger models. It just depends on your machine. It is cool to show people what can be done on their machines without installing anything. It also works in air-gapped environments.

https://github.com/moooff/HermitUI

This is very hard in Germany or not possible at all (beside maybe FAANG).

I have a PhD in Machine Learning (including Papers at SIGKDD / ECML / ACL etc.) as well as relevant working experiences and it is just not possible to get this numbers. I tried really hard to get something that pays this well (beside FAANG) that hire here because i can not move (family stuff).

I once talked with Google and Amazon Research (before Covid) and they told me no remote only (thats why i skipped them for now). Did this policy changed?

I am in similar position. I recently turned 40 and I’m a Development Manager but the role is moving me away from all the technical stuff I really like. I work in a classical industry position so no interesting FAANG Stuff only boring (but important) business software to keep up and running with my team.

The problem is that i originally did a PhD in Computer Science (Machine Learning / NLP) in 2010 and had papers at SIGKDD, ECML etc. So this business software thing is terrible boring for me but in Germany it was reallly hard to find interesting - well paying positions - at that time in this field.

And now i have no idea what to do next, because i fear that all my experience as a “Development Manager“ will not be accounted for if I apply somewhere in a more deep technical role like FAANG.