I suggest not taking the "no framework" approach, as you will never be able to test exhaustively across the various mobile platforms (and also the various versions in each).
I agree jQuery mobile is a bit bloated, but with better processors in phones these days, that is no longer as much of a concern as it was a year back when JQM project was launched.