I picked up a Dell T710 with 32 cores and 32GB of DDR3 ECC RAM for $400. I can throw more RAM in it for practically zero cost. It's amazing for batch workloads.
For interactive workloads, there's no need to get anything newer than a 4-series Core iX. The single-threaded performance has not improved much over the last five years. My daily driver is an i5-6500; motherboard and CPU, used, were $120.