There's not a lot of space left in a 1U server, and to get the right airflow, the airspeed has to be much much higher as what you'd get in a normal ATX case.
Can you replace it with quieter small fans, while maintaining good airflow? Sure sometimes. Is it ever going to be "quiet"? Not a chance.
More seriously: most switches will survive fine without fans if you don't use them too intensely (see eg https://www.reddit.com/r/Cisco/comments/3iu57s/home_lab_swit...)
I guess it depends on your workload and the specific hardware involved but using server hardware with quiet fans in a living room environment can certainly be achieved.
Fan diameter actually corresponds to server thickness. 1U use 4cm, 3U and 4U use 8 or 12cm. Power consumption stays the same, which means monsters like 1U Xeons come with like horizontal 8-unit array of a pair of contra-rotating 4cm 12V/0.5A(12V x 0.5A x 2 in series = 12W per unit) fans.
Noctua don’t make that kind of jet engines.