The age of consent being this low is to avoid prosecuting 15-20 yo having sex with each other. Not for gross old men to coerce minors into having sex with them.
Why does minority/majority matter? Minors are considered inferior to majors. They can't vote, and can't decide most of their life by themselves (loans, bank account...). We consider it 'normal' for them to get yield at/beaten by their parents (and once upon a time, teachers). The _minimum_ society can do to make up for them is protecting them as much as it can. And that means protecting them from predators like Epstein or even Seinfeld.