Open sourcing code for sharing screen with vision language models like gpt-4, Llava and Bakllava.
Aim's to develop open agents that can specialize and assist with coding and using complex tools. You can try the demo here -
https://vision-agent.synth.co.in
Will be posting updates here -
https://twitter.com/suneel_matham