Funny thing, I've been scheming and plodding with seemingly identical idea. I've been approaching it with a bit more experimental angle (more declarative way to generate the ui? what approach for auto layout? etc.), so I've yet to make much progress.
Need to take a closer look if this happens to match my needs