Thread parent sort order:
Thread verbosity:
Welcome! OmniNerd's content is generated by you, the reader. Through voting and moderation we strive to highlight the nerdiest of what's around and provide content that's a little more thought provoking than other sites.
RE: A common error regarding the p-value
Yes, and no.
From a strict mathematical perspective, you're right, of course. I've always found the precise meaning of p to be a little hard to articulate in a way that really conveys the difference, though, and unless it's relevant, I don't bother.
In general, on the additional hypothesis that the experiment is correctly constructed, the p value does become the probability the tested effect occurred by chance. In a correctly constructed experiment, there are only two possible causes to which one can attribute an observed effect - to "chance" or to the treatment under test.
So, p (properly) is the probability the observed difference would occur if the treatment was ineffective. But, our experiment is constructed so that if the treatment is ineffective, then the observed outcome is due to chance. So, under those conditions, p is the probability that the observed difference would occur due to chance.
View Full Discussion