Episode 5 - Is The Crisis Overblown

Episode 5 - Is the replicability crisis overblown?

This week talked about Pashier & Harris’s (2012) “Is the replicability crisis overblown? Three arguments examined.” http://journals.sagepub.com/doi/10.1177/1745691612463401

Highlights:
[1:00] Reproducible, replicable, robust, or generalisable? Table taken from Kirstie Whitaker, shared by @RemiGau http://sx.doi.org/10.6084/m9.figshare.4244996
[2:00] Argument 1: False Positive Rate
[3:00] False Positive Psychology - http://journals.sagepub.com/doi/abs/10.1177/0956797611417632
(which we mention more about in Episode 2)
[4:45] Dorothy Bishop on data simulation - http://deevybee.blogspot.com/2013/06/interpreting-unexpected-significant.html
[7:15] AMPPS paper Amy mentions - The Prior Odds of Testing a True Effect in Cognitive and Social Psychology
http://journals.sagepub.com/doi/pdf/10.1177/2515245918767122
[9:00] Shiny app to play around with power - https://lawsofthought.github.io/replication-crisis-demos/
[12:00] Precognition - https://slate.com/health-and-science/2017/06/daryl-bem-proved-esp-is-real-showed-science-is-broken.html
[14:00] Most published research findings are false - http://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed.0020124
[17:00] Argument 2: Replications
[19:00] Cyberball paradigm - https://www.youtube.com/watch?v=OwQ_VyOUGmY
[23:00] Flexible Measurement in aggression task - http://www.flexiblemeasures.com/crtt/
[26:45] Argument 3: Self-Correction
[29:30] Chris Chamber’s Book: https://www.amazon.co.uk/Seven-Deadly-Sins-Psychology-Scientific/dp/0691158908
[32:00] We have strong opinions on whether rigour and the credibility revolution “stifles creativity and innovation”.
[35:00] are these three arguments still being made?
[37:30] Dorothy’s blogpost on sowing seeds of doubt http://deevybee.blogspot.com/2018/05/sowing-seeds-of-doubt-how-gilbert-et.html
[40:00] We all (including senior academics) need to continue learning and let the revolutionaries pave the way forward.

Music credit: Kevin MacLeod - Funkeriffic
freepd.com/misc.php