I've been looking for something like this all morning. The only thing I found close to making a custom browser UI is Mozilla's Chromeless SDK which is in alpha stages. http://github.com/mozilla/chromeless
Anybody knows anything else other than taking Gecko or webkit and doing it the hard way?