Some of these continental orgs are quite flexible about what countries they permit to join. For example Israel is also in Eurovision, but it’s not in Europe. Similarly Australia are part of the Asian Football Confederation rather than Oceania’s Football Confederation (and Israel is a member of UEFA rather than AFC, for obvious reasons)
I don’t think anyone is saying “Australia is part of Europe” with a straight face though :-)