This is the clearest answer I've read so far. The p-value is the minimum probability of ending up with a test statistic that lies in the rejection region (for a given null hypothesis and critical value).
Please re-read onetwofiveten's explanation. All I've done is paraphrase it. Alpha is just an arbitrary cutoff p-value corresponding to a threshold t-value for a given null hypothesis.