Well, this might just replace my current Debian setup as a daily driver. I've been wanting something like this for a while but had no idea how to do it technically in a feasible way. I guess you've done it for me.

Thanks for posting this and (if you still read this) the thorough followup in this thread.