Infrastructure is just a sliver of the fed budget. Education is funded by property taxes, also a sliver. "History" and "societal background" has absolutely not been "paid for by taxes".
If every working American contributed $8,000 in taxes we would have the same revenue as the insanely progressive system we have now. I don't think anyone here would advocate for zero taxes. I think they would simply advocate for less taxes.