Of course it's not just stainless steel appliances - the thrust of the argument is that it's silly to think of buildings as more important than the people inside them.
Direct payment like you're advocating is a political non-starter. As paternalistic as it is, taxpayers don't like the idea that their money could be spent on anything, they want it to go only to the things they approve of.