> but I wonder how difficult it is.
Its not if you have some basic understanding how the code actually works.
> but I find it a bit hard to imagine doing an actual app with vanilla JS.
Try it. It will blow your mind how simple it is and how little overhead it requires.