IIRC, it was the Founding Fathers who were critical in allowing slavery to be legal. I wasn't aware that they were considered to be particularly left-wing.