Nice work! Vision on the qwen models works very good. Jev is a really neat idea. I tried replicating jev style with qwen models using max 1 token output, which works great. How does this compare to that in terms of speed?
E.g. 1 question would be 300ms but 30 questions would be 360ms total. Most of the time comes from the image decoding.