They were traitors.
They waged war against the United States, attacking the seams of this very country's unity, which by even the Constitution's purposely narrow definition, is treason.
They were pardoned for their treason because they were traitors.