You don't really need a LLM for OCR. Hell, I suppose they just run a python script in its VM and rephrase the output.
At least that's what I would do. Perhaps the script would be a "specialist model" in a sense.
At least that's what I would do. Perhaps the script would be a "specialist model" in a sense.
[1] https://huggingface.co/spaces/opencompass/open_vlm_leaderboa...
Sometimes if you upload an image to ChatGPT and ask for OCR it will run Python code that executes Tesseract, but that's effectively a bug: GPT-4 vision works much better than that, and it will use GPT-4 vision if you tell it "don't use Python" or similar.