Hacker News Reader

I tried using BingGPT to translate simple Chinese text from screenshots. The results were complete hallucinations, different each time for the same screenshot.

I wouldn't trust these translations at all.

View on HN

That’s a completely different test. You’re using the vision multimodal ability to decipher Chinese script, essentially adding an OCR step to the process, and it’s not good at OCR of Chinese script.

Try feeding it actual Chinese characters. From what I understand, it’s somewhat competent.

No no, it hallucinated. It didn't get the OCR wrong.

Image input in Bing basically can't handle non English text. Has nothing to do with its Chinese translation ability, which is great.

Reply on news.ycombinator.com