How are people being 'denied' affordable housing? Do you mean to say that your ideal location is more than you want to spend? Did you find a place to live that was affordable and someone denied you from buying it?
How about close proximity to family and relatives?
Sure, you can move to middle-of-nowhere Texas, and buy land for cheap, but how are you going to pay for that cheaper mortgage, if there are no jobs around? Maybe you can get a telecommuting job?