I heard about an online service where people can sign up to help the blind by describing visual scenes that they capture on their mobile. There must be companies out there developing a similar service entirely run on machine learning.
I heard about an online service where people can sign up to help the blind by describing visual scenes that they capture on their mobile. There must be companies out there developing a similar service entirely run on machine learning.
For anyone curious, it's called "Be My Eyes". When there's a request, it will send a notification to a batch of people. I get about one notification per month, often I'm unable to answer it right then, and when I do I occasionally get a notice that someone else answered first. Tasks I've helped people with were things like going through an unsorted stack of bills and telling them the denominations, holding up a few T shirts and asking me which is the blue one, reading a pressure valve.
Would recommend signing up. It feels good and there's no pressure to answer since it sends out the request to many people at once.
I imagine it would work similarly to how human brains do, or at least how we think they do. To notice the "big picture" first, recognize large shapes then smaller details, or faster moving things then static things.
> remove the very filters that keep us sane
Haha, yes, I know what you mean. If our brains paid attention to everything coming in through the doors of perception, our mind would be flooded with information, way too much for practical purposes. Occasionally it is helpful to access such a mode of experience, but the filters are necessary for daily life in society. We can't be going around in rapturous ecstasy of gnosis all the time.
A related problem might be too much filtering, or the wrong criteria for the filters, missing what's important.
I imagine this could be solved by a conversational interface, where the listener talks with the ambient narrator to zoom in/out and focus on details as desired.