Stashing money at the Fed is possible by the way, and effectively does destroy the money (or rather, takes it out of the economy). Banks can deposit money at the Fed earning exactly the interest rate that the Fed controls. This effectively takes that money out of the economy. That is generally rather bad, because it stifles growth. But in case of inflation, it can sort of help. That is part of why the Fed interest rate helps regulate inflation.
But generally speaking, you want loans to be made! It helps good and productive ideas get of the ground. It is core to Western economies. Hence the Fed is quite scared of narrow banking. They want to be the 'borrower of last resort'.