Sounds interesting. Can you give more details on your workflow and what tasks you use it for?

What kind of work are you doing? For example, if I have some code in the hot path and I want to do all the usual tricks to help the compiler vectorize it, such a small model is not able to do much.

What are some limitations you have found with using a smaller model like that?