At least you could always leave the small village. Can't really do that anymore.
I was recently reading "A Hangman's Diary", which included a Forward for the modern reader. It would appear that outsiders were viewed with extreme suspicion in those times. Obvi that's just a single snapshot of a single region, but it makes sense.
"what did this person do that they left all their family and friends to come to our town"