I'll be writing an article on this in the future, and you're right, the keyboard was a serious pain to build. It's one of the big reasons it took two years to bring the product to this state.
I'm using a Blackberry keyboard for my project, but that's obviously not scalable.