334 karma · joined January 20, 2014
Those silicone "popper fidget" toys come to mind as something that are flexible, could be cheaply mass produced, and could hold a given state at the "print" head. It might be possible to embed small metal ball bearings inside that are moved between the outer & inner surface to increase tactility.
The print head just needs enough actuators to change the state of a given column of dots as the tape is rotating past, and a feed motor to move the tape.
Clockwork Pi (who make the DevTerm) is creating a sort of spiritual successor, the uConsole[2] and they've just started taking preorders. I don't know if it comes with PICO-8, but you could always load the FOSS TIC-80[3] instead. I like that they've included key caps to the buttons as the typing experience on the Pocket Chip was terrible.
1. https://en.wikipedia.org/wiki/CHIP_(computer) 2. https://www.clockworkpi.com/uconsole 3. http://tic80.com/
Environmental challenges like lighting conditions, glare, whether the user has glasses or hair obscuring their eyes need to be controlled. If the user is looking downwards towards the screen, their eye appears more closed making it hard to accurately find the iris location.
You also need an accurate measure of the position of the head/eyes relative to the camera. So dedicated hardware like a depth camera might be needed for high precision tracking. Depth cameras come with their own set of issues.
The resolution of even a high-res camera versus the change in pupil location for small eye movements means that by the time you crop out the eyes, you might only be working with a very small image (<100pixels or less). Even with subpixel hinting, there's not a lot of detail left. Small errors here and in the head tracking location can cause large errors in the screen position estimation.
There is a basic UI available for editing the tree https://github.com/BehaviorTree/Groot
I do wish it had video out as that would simplify setup & diagnostics for me, but the serial console is fine.
Are the chords all hand coded? What determines which notes are included? For example some G-shape chords (using CAGED system) are missing the low E & A strings, while some are missing the high E.
It would also be nice to see all 5 CAGED versions of the chord, rather than just 4.
I've also used my phone connected to a screen/keyboard/mouse through Samsung Dex and it was a very desktop like experience for my use case. Although it's rare that I'd have the required equipment and not be carrying a full sized laptop.
I can imagine the things you describe in a beach scene, and on the surface I feel like it's an accurate depiction of the scene. But if I try to describe it in detail it starts to fall apart and the description would be vague compared to my wife.