Or maybe they were just incredibly antisocial and felt compelled to leave by their desire to not live near other people. Such a seclusionist mindset might explain why they were there in the first place...
Trying to apply legal concepts to unclaimed barren islands not subject to any legal system does not work.
"Bigger army diplomacy" is the rule, not the exception. Weapons usually beat legal documents and concepts