Fingers crossed for this! I've worked on a similar problem in the past and I dreamed about a solution like this.
I guess that alternative or even non-graphical interfaces (like CLI or voice) are possible?
If someone else is interested in a less radical version of this topic, maybe you can share some insights here https://news.ycombinator.com/item?id=23737903