It's not immediately clear to me how we should read the Constitution on that question, but the Impoundment Control Act seems to explicitly include "delay" alongside "withholding" in things that it might be forbidding.