7,409 karma · joined November 25, 2012
Edit: never mind - I see this is a browser extension, so kind of a non-starter.
The t2d, t2a and h3 instance types have vCPU = core, and all other instance types have vCPU = thread.
That said, this seems like a really cool project that could have some real value! It still fully depends on having the full CPython runtime environment, but that means it could work correctly with most existing code and libraries (including numpy and script).
It's very interesting to browse, since it's a huge collection of (presumably) working tested example code doing mundane things using Mojo, which is extremely useful to browse when trying to figure out how to efficiently use the language. Similarly, browsing the implementation of the stdlib has helped me a lot with learning zig.
Also, is this localllm kind of like a Google competitor to some aspects of ollama?