The letter p was chosen to suggest probability because the p value is a probability.