Atom CPUs are core-for-core comparable to the A72 cores in the RPi4. ICP isn't really comparable since the instruction set is different, but performance is similar. The RPi has 4 of them, only the most modern Atoms have that.
'Atom' is pretty vague. There are several different micro-architectures under that name, with different performance characteristics.
I'm not seeing USB 3 on that particular Optiplex, either. Gigabit ethernet, yes. No HDMI. DVI, VGA. Maybe displayport? Hard to tell. Do have PS/2 keyboard and mouse ports, which is kinda nice.
No USB3. I don't think it's any good as a thin client any more, it's only good as a low power server. Before the Pi4 it was much more attractive, especially because of GigE and because the Atom chip in it is pretty good compared to the ARM in the Pi3. But after reading the replies here I'm thinking it's not as good a choice as it once was.
Yeah, well I don't think you'd get a 4-core Atom for the same price, so maybe not so good compared to the Pi4 then.