If you haven't yet, you may want to read The Humane Interface [1] (and test is working prototype Archy).
It's a description of a user interface that works exactly as you say, yet looks completely different that what you describe.
It's a description of a user interface that works exactly as you say, yet looks completely different that what you describe.