This is the second biggest piece of economics misinformation, behind people who believe their net income will go down if they get a raise into the next tax bracket.
Just like cars, all new housing is luxury. No one working minimum wage can afford the cheapest new car on the lot. But those new cars get bought by people who sell their used cars.