Right now, I have a silent 4U rackmount GPU server running 24/7 in my living room, cooled just fine by a 120mm Noctua fan (plus a silent consumer ATX PSU fan).
I also have a commercial 1U Atom server that I've adapted for living room. The Atom and mirrored HDDs are passively-cooled (though you can also get Xeons in the same chassis). The Flex-ATX PSU was loud, but I opened it up and soldered in an effectively silent Noctua.
The noise-no-object jet engine servers are a problem, especially full-depth 1U ones with a phalanx of jet engine fans. But people have had some luck removing fans and replacing some of them with quieter fans, or liquid cooling.
Some of the older dual Xeon servers on eBay were tempting, but the noise/power draw made it a non-starter.