If you don't care about your electricity bill, you can buy used Xeon workstations on your favorite auction site.
A couple years ago, we picked up a HP Z800 workstation with two 12-core processors and 24GB of RAM for $400.
The main downside is that if the power supply (proprietary) or motherboard die, there's not easy fix for it other than buying another of the same model.