This is the philosophy behind why I went with Knockout years ago - and am now helping maintain and write version 4.
Specific, narrow focus and it's served me well. Sensing the innate liability, I've never felt the allure of the full fledged framework.