799 karma · joined May 14, 2015
In addition to constraining output, AICI also lets you fork the generation programmatically as well as dynamically edit the prompt which is important in some scenarios.
The idea is that several LLM inference systems implement AICI as an interface, and Guidance, LMQL, etc implement AICI backend and then everyone wins.
[0] https://github.com/microsoft/aici/blob/main/controllers/aici...
int sureICanHelpYouHereIsAnExampleOfTheCodeYouWereAskingFor;
In this case however, you can just do: await aici.gen_text(regex=r"[a-zA-Z\n]+" stop_at = "\n")
Also note that there still a lot of work to figure out how it's easiest for the programmer of an LLM-enabled app to express these things - AICI is meant to make it simple to implement different surface syntaxes.The pyctrl is a just a sample controller, you can write a controller that takes any kind of grammar (eg., a yacc grammar [0] - the python code in that example is only used for glueing).
Llama.cpp grammars were quite slow in my testing (20ms per token or so, compared to 2ms for the yacc grammar referenced above).
[0] https://github.com/microsoft/aici/blob/main/controllers/pyct...
[0] https://www.ri.se/en/news/blog/generative-ai-does-not-run-on...
Gravity on surface of this planet will be 3(times heavier than earth)/(1.55(radius)^2), so 1.25g, however escape velocity also depends on planet radius so we get sqrt(1.55 * 1.25) = 1.4 earths escape velocity (so 15.7km/s). Assuming Isp specific impulse of engine of around 300s, let's compute m0/mf (initial mass of rocket / payload) = exp(vEsc/(Isp*g0)) (g0=9.8m/s^2 (on both planets)):
For earth, it's 45.
For this planet, it's 208.
So, the rocket (using our current chemical engine technology) needs 4.6 times more fuel than on earth. Much more difficult, but maybe possible...
edit: formatting
How long would it take to explain what an LLMs is doing to someone from 1800s? It is remarkably simple.
Disclaimer: worked on both.
The reason Mapy.cz has all the trails is because they also use open street maps.
So no, you're not generating tokens fast enough.
In general you use module instead of chip to save on certification. However for ESP32 the logical choice would be indeed a module from Espressif.