Well, that was the reason for the creation of the Fed in the first place, the idea that you could have technocrats setting macroeconomics policy without political influence. But then Allan Greenspan happened, an ideologue disciple of Ayn Rand. When the federal budget was running a surplus in 2000 he told congress that budget surpluses were dangerous, then he pushed for Bush's tax cuts and then he helped inflate real estate and ignored everybody that was saying it was an out of control bubble.
So no, unelected elites aren't going to save us either.