We only used the standard GPT-4 API (without visual capabilities).
I think it's okay to have a some discussion here. We employed traditional OCR, GPT-4, and some of our own algorithms to assist GPT-4 in understanding the context and relationship within the image scene (allow me to retain a bit of mystery here).
Are you doing all this work locally on the device, or are you shipping everything to OpenAI servers, or maybe other servers in some cloud?
If you're doing all processing locally on the device, I might be interested. But I don't want all that data being shipped off to some cloud for remote processing there.
For our upcoming Mac client and iPhone app, we're considering storing the screenshots on the device. However, we still need to weigh the pros and cons of cross-device syncing versus local storage. Your feedback is invaluable in guiding our final decisions for the Mac client and iPhone app. Thanks for sharing :)
Thanks!
By the way, are you more excited for the iPhone app or the Mac client?