https://tvtropes.org/pmwiki/pmwiki.php/Main/NintendoHard
https://en.wikipedia.org/wiki/Nintendo_hard
Much of it had to do with the technical limitations of the systems, which often led to requiring pixel-perfect accuracy to avoid hitboxes.
However, it also stems from the arcade legacy, where game plays were challenging and short, with very little handholding from the game design (i.e., throwing you in the deep end)
Replaying games like Megaman II and Ninga Gaiden on emulators, I now get a visceral distaste for the overwhelming difficult; however, back when I played them as a kid, it was just the way games were, and I would routinely finish these games in the 2-day rental period allotted.
(I assume some people have exactly the opposite reaction, pining for the days when games were merciless)
Basically, our gaming sensibilities have evolved (or devolved) as the medium has grown over time.