I think people coming from most other languages that have objects get very confused about prototypal inheritance. The significance of first-class functions is also not obvious to people who don't come from a functional programming background.
I think you're right insofar as it's easy to "get going" with JS and see things happen in a web page. But if you're looking to actually learn how to build non-trivial apps, a solid grounding in the language is pretty key.