Biden had to deal the tail end of a pandemic and the financial fallout of that.
Not saying both couldn't have done much better on the budget but, if you compare them to Bush and Trump, they honestly do look quite competent.
Structurally, the budget has gotten worse every year since the 1990s. In large part for reasons not attributable to presidents. For example the number of old people (as a % of the population) in the US has doubled since the '90s, thus ballooning medicare and social security spend. Without cutting eligibility to those programs, increased spend was always going to be an inevitability due to seismic underlying demographic trends. Second, the persistent deficit has led to now $2T in annual interest expense. Again, not something an administration can simply "reform" or back out of; that is now structural inherited spend.