But org-mode also has a couple additional features like time tracking and a way to generate summarised tables based on that tracking, or the agenda. Either way learning Emacs just for org-mode is probably only a good idea if you really want to use the features coming with it in one package.
Humanity made a huge number of advancements using just simple paper and ink.
Easiest way to get started with org is to start simple. Just use the indented headings and source (code) blocks. Once comfy there you can branch out into tables and todos. Then maybe use the agenda (I personally don’t).
I’ve never had to write elisp or anything other than normal vim commands.
Are you missing anything? Probably not. Depends on how in depth you want to get. But, I’ve done the transition and thought it was positive. :)