My understanding is that alimony is quite distinct from child support. Rather it is payments made directly to a former spouse and harks back to a time when women had no way to support themselves after a divorce (they could not work and probably had little chance of remarriage). So the idea was that the alimony would continue to support them as if they were still married.
I have no idea why it still exists, however.