I was skeptical about this concept when I first heard it, until I actually tried some of the latest image models.

Now, I’m fully bought in that this is correct.

There’s a model you can use on hugging face, for example, where you can feed it any PDF or image of a document, ask it a query (“What is the total of the invoice?”), and it just spits out the right answer.

Turns out decades of work trying to make universal data interoperability standards will most likely be replaced by screenshots and images! (Again, this is for inter-app data movement)