Language family actually doesn't have that much to do with it because the differences within families are so coarse. One of the easiest languages for English speakers to learn is Bahasa Indonesia, and it definitely is not an Indo-European language. Most Indic languages, like Hindi, are much harder despite being Indo-European.