Is something stronger than your wish to get a regular job tying you to where you currently live?
Personally I would love to live in a more rural place, but until I am self sufficient enough, this is not an opportunity I am willing to take.
If you don't want people to ask, don't mention it.