Please let us know if you shoot some code. It could be a good open source project, according to the interest. I'd personally go for defining a community whitepaper / wiki maybe for the concept and solutions.
What do you think? In the mean time we can build some prototypes on different platforms.
The real reason why we don't know how and if this interaction model would work in practice - is the obvious absence of implementations.