I used a Raspberry Pi for this for a long time and did fry a couple of SD cards along the way. A few years ago, the last time the SD card died, I decided that instead of buying a USB SSD for it I’d get a used Lenovo Thinkcentre “Tiny”, which has been great.

They are readily available from corporate IT liquidators on eBay. Mine was $100 and came with a Core i5, 250GB SSD, 8GB of memory. I’ve read about people swapping Xeons into them as well. It uses more power than a Pi but is still basically silent. Overall I’ve found it to be perfect for the things you’re talking about.