Indeed. The roots of the words prejudice are well known to most English speakers. It's supposed to denote "pre" judgement. Judgement before actual evidence.
Regarding impact: It could well be argued that current-day impact is the result of prejudice operating in the past. The interaction of society, economics, and demographics are complex. Hopefully, we'll just muddle through, somehow.