The United States is a legal entity. It's the one responsible for the harms, and it's the one responsible for the reparations.
Or we could just dissolve the country every 4 years and start over from scratch if you prefer. I don't see how that could go wrong. :-)
The US fought a civil war with the entities owning slaves. But reparations to slaves and their descendants is a separate issue from affirmative action.