So because this land was colonized 500 years ago (as it was before Europeans arrived as well by the way, native Americans were not pacifists), we shouldn't enforce borders?
How much time must pass after a land is conquered before nations are morally justified in enforcing sovereignty over borders? Particularly when the border belongs to a welfare state with finite resources and a host of internal issues that require fixing.