The distinction is unclear because "my own people" is such a nebulous concept when you're talking about a nation of millions. For example, for a "white nation", does "my own people" include Dutch Quakers? What about Irish Catholics? What about Italians? What about Jews? You will get a different answer depending on which white nationalist you ask. Thus the common element among many white nationalists is not actually wanting to live with one's own people, but exclusions of specific outgroups that are deemed inferior.