I agree with you that this looks like it has diverged into two separate questions.
But I think it is the view from the majority compared to the minority.
The majority see things as peaceful, quiet, fine. After the original slaughter, it was a peaceful federation of states (at a time where killing a native was 50/50 to come with any consequences) and no large scale civil wars.
The minority - the original inhabitants of this land - the war never stopped. Just changed in nature. Instead of outright killing, it was disenfranchisement/segregation, then blatant racism, now subtle/systemic racism. There is no peace.
And that can carry through generations. As the recent riots in the US show - which had similar sentiment here in Australia - even the killing on basis of race hasn't really stopped 100%.
Ask the minority, if the withdrawal was peaceful? YeahNah...