[jpeterson]

Is the p-value really not the probability of your results being due to chance?

No, it's the probability of a particular observation, given that we assume the result is due to chance. This sounds similar, but the difference is that it doesn't say anything about the probability of your result outside the context of the study's hypotheses.