I find all current LLMs to have pretty poor spatial awareness. It is becoming better, but still very poor. How are you dealing with that? Got any special tricks, any advice?
This is improving greatly in recent model releases
So basically you have a good enough code that’s “intuitive” for a model, screenshots, and that’s it?
Fingers crossed it comes back!
"Before working at Adam I worked at an AI Lab called Adept. We trained foundation models to do actions on a computer.
What does computer use now? The best general models. They just got good at it."
You were working for 4 months in Adept. What could you deliver or even learn in such a short period of time?
Sounds like an excuse tbh
no tricks, I'd definitely be curious to know how much screenshots help