These people largely consider themselves (much like the Anglo-Saxons, Christians, West...) as having done India a favor by destroying its grand old self, and continue in this 'noble' goal of 'civilizing the natives' by constantly waging genocide against the natives (even inside India).
Little wonder, the subcontinental Muslims are extremely violent, and are almost single handedly responsible for most medieval forms of barbarism that Islamism breeds.
Disliking such a community, which identifies India's natives as its mortal enemies is only natural. Would you fault native Americans for doing the same ? No ? Why? Beaucause they've lost, that's why.
Europeans and Islamists aren't too different from each other... Little wonder they've historically been allies in the war with India.