In some places the family name tips them off. Like here in Thailand a Thai woman who is married to a westerner and has his last name will have to fill out a form stating whether or not they are a US person.