The Pi is the only SBC with an excellent OS ecosystem.
They already come with things like power supplies, RTC+battery, on-off switches, sata and/or m.2, expandable memory, etc.
Personally I use ARM SBCs to get physically separate hosts for things like Consul/Vault/Nomad servers, k8s control plane, some monitoring instances, workers for loads that don't need blazing single-thread performance, etc. This way I can run something close to "best practices" HA redundant clusters while staying low on purchase and electricity costs, and my whole setup can fit in a suitcase if I need to move.
Some of the things you mention (m.2, RTC, switches) are things that are either included or cheap and easy add-ons to the boards I mentioned.
Another nice upside is the low power means it's easier to power them via PoE, so you don't need a power supply in the first place.
I also try to go as far as I can in the direction of libre/open software/firmware/hardware, which means I try to minimize the reliance on Intel and AMD CPUs.
I think the “it depends” also depends on what you think the next ten years holds for ARM vs x64. Getting some more hours in dealing with ARM ‘servers‘ might be a decent way to hedge your bets.
Full sized hdmi port, USB-C with DisplayPort, gigE, and connectors for two WiFi antennae, and an M.2 4x slot on the backside of the board that would be great for an nVME card. It also has two screw holes and a power header for mounting a heat sink.
For this micro-server form factor, with a tiny little board in a tiny little case, what is a better storage form factor than a little portable SSD connected via USB 3?
(I wouldn't be wild about using a microSD card for a server that relied much on storage)
I recently built a desktop computer. It uses a 6x6 inch mini-ITX motherboard. The motherboard has a CPU and 2 sticks of RAM in it, raising the height to about 2 inches. The SSD goes inside the motherboard in the M.2 slot. Aside from this 6x6x2" unit, the only other things are:
- the gigantic graphics card - not necessary on these type of computers - the power supply unit - standard USB unit for these - and the CPU cooler which is a big hunk of metal sticking out and raising the total height to about 6 inches - again not necessary, maybe a tiny passive heatsink
M.2 is faster and lets you put a tiny SSD (literally just a PCB with flash chips on it) inside the thing instead of having a large external USB SSD with a cable to connect. So in the end you have a super compact computer that is basically just one PCB with another PCB inside it and maybe a tiny heatsink.
> having a large external USB SSD with a cable to connect.
The Samsung t5 and t7 SSDs I'm using with RPi 4s are about the size of a credit card (a stack of five credit cards, I guess). The tiny, very solid flirc cases for the Pis aren't much bigger, and dissipate heat beautifully. I like this solution a lot more than I anticipated I would.
Flashing the newest firmware is about it, now.