Sisyphus Speaks 58: Disastrous false positives.

Published: Jan. 25, 2024, 2:38 a.m.

It\u2019s very common for people to claim that an effect is real, not just chance, whenever the test produces a P value of less than 0.05, and when asked, it\u2019s common for people to think that this procedure gives them a chance of 1 in 20 of making a fool of themselves. Leaving aside that this seems rather too often to make a fool of yourself, this interpretation is simply wrong.