716 karma · joined November 6, 2012
I don't think there's anything wrong with displays. They offer immediate and quick insight into internal state and operation. The issues appear when you introduce modal workflow, with some features only available in some modes.
Worst offenders in category of hardware equipment are probably guitar multi-effects and synthesizer workstations. They cram so much functionality with so little thought given to flow and usability.
I'm currently building digital instruments for android phones and I refuse to add any UI elements until I figure out something that makes sense. Until then the interpreted Lua code is the user interface. I would be very interested in some new UI patterns for touchscreen that take good advantage of interaction between user actions and visual feedback.
[0] https://play.google.com/store/apps/details?id=com.castlewrat...
IMO we should ditch tabs, bookmarks and history. They all implement the same thing - a way to reach a place you've visited before. And they all require to be micromanaged in specific ways. The browser already knows which sites I've visited recently, and all the backtracking and branching I did. This information could be visualized as tree so that I can backtrack to any node and resume browsing on a new branch. The browser should also be doing memory management so that revisiting recent site is as fast as switching to another tab. And while we are at it, why not allow full text search across recently visited sites?
I've used Faust for a few months two years ago and I plan to use it again to write audio DSP apps. It's very powerful and expressive, and targeting many different systems/platforms is no problem. I have used generated C code on bare-metal ARM Cortex M4F platform, which is some distance away of original scope of Faust project. It was fairly easy to do. The documentation is also well written and comprehensive, it gives you very nice introduction into functional languages, time-domain DSP, as well as explanation of some common applications (pitch detector, panner...).
Two downsides I noticed (maybe they are fixed in the mean time?) are error messages and block composition. Because of the way Faust compiler works, error messages are long and not very meaningful. Some expressions are merged and simplified before error is triggered, so it's difficult correlate the expression in error output with your source code.
The other problem is that once you have the basic blocks and want to merge them into complex system, the syntax suddenly gets in your way. You have to introduce dummy wires in some blocks just to pass-through signal to its destination. The compiler can output graphical representation of code, but it would sometimes be much easier to use visual tool like the Simulink or LabView. Perhaps this is just tooling issue, but I found language syntax to be confusing and not scaling up properly.
[1] https://d1.awsstatic.com/product-marketing/Sumerian/sumerian...
They demonstrate basic placing of 3D objects in environment, what about UI?
Too bad about all the mythology nonsense and childish absurdism.
Edit: Also, please ask for confirmation before closing tab. It's too easy to close tab on accident and lose your work.
VR should be considered as completely new medium. 2D windows in VR should only be used as backwards-compatibility layer. Re-inventing every part of interface at the same time sounds great to me. Let's make as many competing solutions and then pick ones that work the best. This paves the way not only for rich VR experience, but also for AR.
I thought about input interface that could replace keyboard for VR and mobile devices. Brain implant would be perfect, but that's not feasible with today's technology. Voice is good contender, except for privacy issues, and it's not really usable in work environments. Keyboards are our best solution so far, but they don't evolve and to me they seem like a dead end (plus, they are not portable and require both hands to use effectively).
I was thinking about touch sensitive surface that recognizes drawn glyphs. The idea is that anyone who is literate can start using it without any training, just draw letters instead of typing them. With machine learning and some clever visual feedback, both user and machine could adapt to each other to increase the input speed (by simplifying glyphs and by defining 'snippets'). Interface could be expanded to both hands to double the speed, but it would be completely functional with just one hand. It could even be used blindly. For mobile devices, such sensitive surface could be placed on backside - virtual keyboards that take half of screen are just horrible.
Also, we need both mechanical keyboard to sense key presses and 3D tracking of finger movements? I get it, Logitech wants to keep selling keyboards, but for VR experience I would rather have tracking of facial features and eye movement.
[1] https://d201n44z4ifond.cloudfront.net/wp-content/uploads/sit...
Interactive slide elements like simulations, parametrized graphs, shells for SSH and interpreted languages.
Mobile interface served for audience so they can participate in quizzes, voting and interactive experiments.
Branching flows of presentation, so you can dive into more details on one branch, or skim through it on other branch (without running through slides franticly).
Free style presentation where some presenter zooms in and out of tree representation of our knowledge of the presentation subject.
Support for separate presenter's user interface - presenter should be able to easily cue the laughing track, or theatrically raise music volume, or see audience feedback.
Both Prezi and reveal.js and some other tools I've seen, add too much design fluff and fail to deliver any fresh approach. PowerPoint is stagnating for a looong while. Which is really the shame, because we could engage our audience so much better with right tools.
Unfortunately, both game engines' lead developers (Josh and Cadaver) have recently retired, so projects' future is uncertain at this moment.
A lot of us consider our work a craft and spend lifetime perfecting tools. Unfortunately, we neglect the most important tool we have - our mind. It turns out we can improve our focus by consistent practice (and that's only one of many benefits of meditation).
Opening chapters of this book provide a basic model of awareness & focus, which demonstrates that we are rarely in control of our thoughts. I found it fascinating. The rest of book provides a well defined path to train and improve working of mind through introspection.
Although I could find no actual credentials for author (he claims to be neuroscientist), his observations and explanations are so far very consistent and consistent with my own. Also, religion and mysticism are absent from the book, except when referencing traditional practices.
BTW I've also recently read Deep Work. It's a fantastic book and it made me change some habits, but the style turned me off. I did not enjoy cherry-picked anecdotal 'proofs' and persistent convincing.
And most importantly, they didn't take advantage of biggest feature of platform - interactivity. They are just drawing a dead fish [https://vimeo.com/64895205].
That said, aside from simple symmetry and echo effects, it would be challenging to build on top of this with a system that would adapt to changes of key, tempo and playing style. As in article, human player is always the one who is adapting to fixed algorithm.
Maybe it doesn't work just for me, but displaying "a2 + b2 = h2" in article about math is really ungraceful degradation.