52: Give p's a chance (with Daniel Lakens)

Published: Oct. 20, 2017, 4 a.m.

In this episode, Dan and James welcome back Daniel Lakens (Eindhoven University of Technology) to discuss his new paper on justifying your alpha level.

\n\n

Highlights:

\n\n
    \n
  • Why did Daniel write this paper?
  • \n
  • Turning away from mindless statistics
  • \n
  • Incremental vs. seismic change in statistical practice
  • \n
  • The limitations to justifying your alpha
  • \n
  • The benefits of registered reports
  • \n
  • Daniel\u2019s coursera course
  • \n
  • What\u2019s better? Two pre-registered studies at .05 or one unregistered study at .005?
  • \n
  • Testing at the start of semester vs. the end of semester
  • \n
  • Thinking of controlling for Type 1 errors as driving speed limits
  • \n
  • Error rates mean different things between fields
  • \n
  • What if we applied the \u201c5 Sigma\u201d threshold used in physics to the biobehavioral sciences?
  • \n
  • What about abandoning statistical significance
  • \n
  • How did Daniel co-ordinate a paper with 88 co-authors?
  • \n
  • Using time zones to your benefit when collaborating
  • \n
  • How can junior researchers contribute to these types of discussions?
  • \n
  • Science by discussion, not manifesto
  • \n
  • The dangers of blanket recommendations
  • \n
  • How do you actually justify your alpha from scratch?
  • \n
\n\n

Links

\n\n

Daniel on Twitter - https://www.twitter.com/lakens
\nDaniel\u2019s courser course - https://www.coursera.org/learn/statistical-inferences
\nJustify your alpha paper - https://psyarxiv.com/9s3y6
\nAbandon statistical significance - https://arxiv.org/abs/1709.07588
\nUsing the costs of error rates to set your alpha - https://doi.org/10.1111/j.1461-0248.2004.00625.x

Special Guest: Daniel Lakens.

Support Everything Hertz