36: Statistical inconsistencies in published research

Published: Jan. 27, 2017, 6 p.m.

In episode 34 we covered a blog post that highlighted questionable analytical approaches in psychology. That post mentioned four studies that resulted from this approach, which a team of researchers took a closer look into. Dan and James discuss the statistical inconsistencies that the authors reported in a recent preprint.

\n\n

Some of the topics covered:

\n\n
    \n
  • Trump (of course)
  • \n
  • A summary of the preprint
  • \n
  • The GRIM test to detect inconsistencies
  • \n
  • The researchers that accidently administered the equivalent of 300 cups of coffee to study participants
  • \n
  • How do we prevent inconsistent reporting?
  • \n
  • 21 word solution for research transparency
  • \n
  • Journals mandating statistical inconsistency checks, such as 'statcheck'
  • \n
\n\n

Links

\n\n

The pre-print
\nhttps://peerj.com/preprints/2748/

\n\n

'The grad student that didn't say no' blog post
\nhttp://www.brianwansink.com/phd-advice/the-grad-student-who-never-said-no

\n\n

The caffeine study
\nhttp://www.bbc.com/news/uk-england-tyne-38744307

\n\n

Tobacco and Alcohol Research Group lab handbook (see page 6 for open science practices)
\nhttp://www.bris.ac.uk/media-library/sites/expsych/documents/targ/TARG%20Handbook%20161128.pdf

\n\n

21 word solution
\nhttp://spsp.org/sites/default/files/dialogue_26(2).pdf

\n\n

Facebook page
\nhttps://www.facebook.com/everythinghertzpodcast/

\n\n

Twitter account
\nhttps://www.twitter.com/hertzpodcast

Support Everything Hertz