Ok and people are blank pages without cultures or tendencies, which means we can just graft them without issues?

There is also a dilution process by which you assimilate or adapt a population and if the % of new people is too high the culture that produced those societies basically disappears.