NT 4.0 was not for the masses, it was costly (the OS license) and needed higher specs than the almost contemporary Windows 95 (which was largely sold with license included with the new PC).
As well, Windows 2000 was a "professional" OS.
Both were way ahead in stability when compared to the Win9x/Me counterparts, but in terms of number of users, they were a fraction of the 9x ones, so it is not surprising that you can find much more nostalgic people about the latter.
XP somehow "unified" the professional and home market, bringing the (unneeded) Fisher Price look that the professionals hated and the (unneeded) complexities of authorizations/NTFS that the home users were not prepared for.
I can testify for the stability of NT 4.0, I have run a machine for some 15 years, roughly from 2001 to 2016, running NT 4.00, on 24/7, and only reboots were once a year or so for cleaning or occasionally for replacing the (failed) PSU or hard disk (not as a server, as a desktop running a specific DOS based accounting software).
I remember initially I had a few BSOD's because for some reasons there was a counter of some kind in the mouse driver that caused them, but once that was fixed, if I recall correctly by a change in the Registry, it was really rock solid.