It's not just the suffering of the offender, but the idea that justice to the offending party can only happen if the offender suffers like the offending party suffered. It's "An eye for an eye", just a few layers of abstraction over it.

Exactly. :)