> Those legislation mainly affected people who weren't US citizens, though.

Then what about Samuel Worcester?