There's also many roads (that are reasonably considered highways) that are maintained using state and local funds.

(for example, in Michigan, counties, townships and incorporated municipalities all fund work on roads)

I don't mean that as an argument against your point about spending money in the wrong spot, just pointing out that the trust fund isn't the only spending.