ReproducibiliTea Podcast
67 episodes - English - Latest episode: 8 months ago - ★★★★★ - 2 ratingsServing mugs of Reproducibili☕️: Blends include transparency, openness and robustness + a spoonful of science. Brewed by the @ReproducibiliT Team
Homepage Apple Podcasts Google Podcasts Overcast Castro Pocket Casts RSS feed
Episodes
Episode 11 - Ivan Flis
November 27, 2018 18:31 - 52 minutes - 49.9 MBEpisode 11 - Ivan Flis This week we had an awesome chat with the super-interdisciplinary Ivan Flis. Ivan is like a cake made from psychology, history, and philosophy of science. This cake was the perfect compliment to our Repro-Tea. There was so much to cover that we will have Ivan back next time too! Just a few of the amazing resources Ivan mentioned: Deborah Mayo’s book, Statistical Inference as Severe Testing: How to Get Beyond the Statistics Words, Amy still doesn’t understand what she...
Episode 10 - Leaving Academia (part 2)
November 13, 2018 12:31 - 45 minutes - 46 MBIn a previous episode we discussed leaving academia. Lots of people who had left academia responded to our survey and gave us some insight into why they left and what they are doing now. This time we dive into the advice they offered to ECRs given the likely event of leaving academia. Thank you to everyone that responded, and for your advice. We will post to this list as we find more resources :) Music credit: Be Jammin – Alexander Nakarada freepd.com/world.php
Episode 9 - Did you know we love the open science community?
October 30, 2018 08:00 - 52 minutes - 51.2 MBEpisode 9 - Did you know we love the open science community? In this episode we tackle how the open science community is perceived, and our own experiences as members of it. We talk (in a non-specific way) about recent and recurring discussions concerning public critique and how harassment is dealt with on social media. We are happy to continue this discussion; if we have missed anything, or could have been more sensitive to specific issues let us know, we are interested in continuing the co...
SpecialiTEA 5 - Peder
October 16, 2018 18:24 - 1 hour - 27.2 MBSpecialiTea episode 5 – Peder Isager We get talking to Peder Isager about his PhD work, equivalence testing, and the psychological science accelerator. You can find Peder on twitter (@peder_isager); he also has a website https://pedermisager.netlify.com/ Some Equivalence testing resources: “Equivalence Testing for Psychological Research: A Tutorial” from Lakens, Scheel, and Isager http://journals.sagepub.com/doi/full/10.1177/2515245918770963 “TOST equivalence testing R package (TOSTER) an...
SpecialiTea 4 - Leaving Academia (part 1)
October 02, 2018 14:31 - 47 minutes - 47.7 MBSpecialiTea Episode 4 – Leaving academia (part 1) A few weeks ago we put out a survey to get a picture of peoples’ reasons for leaving academia and what advice they have for ECRs. We had lots of responses and dive into them here. There wasn’t quite enough time to really dig into the advice offered. But, that’s where you lovely people can come in. Our survey is still open (https://docs.google.com/forms/d/e/1FAIpQLSdad9GpUbqKebCxUSbUJXVvyOWH3gtC7zO77trFIo-SwUh-og/viewform), so if you have any ...
Episode 8 - The preregistration revolution
September 18, 2018 13:47 - 49 minutes - 23.5 MBEpisode 8 - The preregistration revolution It’s preregistration time! Distinguishing confirmatory (or prediction) and exploratory (or postdiction) analyses. We discuss this awesome paper from Nosek, Ebersole, DeHaven, and Mellor (2018) “The preregistration revolution”. Find the paper here http://www.pnas.org/content/early/2018/03/08/1708274114 Highlights [1:00] What is a preregistration anyhow? [2:00] Prediction vs postdiction [3:00] Why is preregistration important? Combatting bias; disti...
Episode 7 - Natural Selection Of Bad Science
September 04, 2018 11:41 - 58 minutes - 56.8 MBThis week we talk about “The natural selection of bad science” from Paul Smaldino and Richard McElreath. We get bummed, but try to put a positive spin on things. You can find the paper here http://rsos.royalsocietypublishing.org/content/3/9/160384 Highlights [1:00] “The natural selection of bad science” http://rsos.royalsocietypublishing.org/content/3/9/160384 [5:00] the need to distinguish yourself as a scientist - innovative and/or high output? [6:45] Our next SpecialiTEA - we want to he...
SpecialiTEA 3 - Julia Rohrer
August 28, 2018 17:20 - 38 minutes - 32 MBSpecialiTea 3: Julia Rohrer We talk to Julia Rohrer (@dingding_peng)about her blog, skills training as a PhD and what doesn’t get talked about enough in the Open Science Community. You can find her amazing blog here: http://www.the100.ci, where she is joined by Anne Scheel (@annemscheel), Ruben Arslan (@rubenarslan) and Malte Elson (@maltoesermalte). We want to note that this podcast had the world’s most WEIRDEST Skype setup as we forgot our headphone splitters. This meant that both Amy and...
Episode 6 - Open Science
August 21, 2018 09:45 - 51 minutes - 93.8 MBThis week we talked about “Open Science: What, Why, and How” from Spellman, Gilbert, and Corker. You can find the paper on OSF https://osf.io/gv6r4/ 0:14 Sophia is leaving Oxford :( (But the Podcast will continue) 0:48 This week’s focus: Open Science What Why and How; few in the JC read it but the discussion was awesome https://osf.io/gv6r4/ 2:15 Shoutout to Matt Jaquiery @MJaquiery 2:40 Broad Meaning of Open Science -- what do we mean; potentially misleading to include things beyond Open...
Episode 5 - Is The Crisis Overblown
August 14, 2018 07:11 - 43 minutes - 59.5 MBEpisode 5 - Is the replicability crisis overblown? This week talked about Pashier & Harris’s (2012) “Is the replicability crisis overblown? Three arguments examined.” http://journals.sagepub.com/doi/10.1177/1745691612463401 Highlights: [1:00] Reproducible, replicable, robust, or generalisable? Table taken from Kirstie Whitaker, shared by @RemiGau http://sx.doi.org/10.6084/m9.figshare.4244996 [2:00] Argument 1: False Positive Rate [3:00] False Positive Psychology - http://journals.sagepub.co...
SpecialiTEA 2 - SIPS
August 07, 2018 12:17 - 50 minutes - 70.2 MBSophia and Sam headed to this year's Society for the Improvement of Psychological Science (SIPS) meeting. We got talking to some super interesting and awesome researchers (follow them on twitter, handles below) to share the experience with all of you! Check out https://osf.io/ck28s/ for all things taught and created at SIPS 2018 Highlights: [0:00] What is SIPS anyway? [8:00] Elizabeth Page-Gould (@page_gould) and Michael Inzlict (minzlicht) - Creating and finding open science jobs [15:30] ...
Episode 4 - Reproducibility now
July 31, 2018 10:32 - 42 minutes - 61.2 MBEpisode 4 - Reproducibility Now This week we dive into the Open Science Collaboration’s (2015) paper “Estimating the reproducibility of psychological science” http://science.sciencemag.org/content/349/6251/aac4716 Highlights: [1:00] This paper has all of the authors [1:30] Direct vs conceptual replications [4:30] PhD students running replications as the basis of extending a paradigm [6:00] The 100 studies paper methods in brief [8:00] everything’s available for this collaborative effort, ...
Episode 3 - Questionable Research Practices
July 24, 2018 10:36 - 37 minutes - 22.9 MBEpisode 3 - Questionable Research Practices This week we discuss the prevalence of questionable research practices in John, Lowenstein, & Prelec “Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling” http://journals.sagepub.com/doi/abs/10.1177/0956797611430953 Highlights: [2:00] What are questionable research practices? [3:00] QRP as a political term [6:00] a pinch of transparency [8:00] QRPs as a grey area? [12:00] Does defining a QRP as ‘just’ que...
SpecialiTEA 1 - Tim Van Der Zee
July 17, 2018 16:45 - 32 minutes - 60 MBSpecialiTEA 1 – Tim van der Zee In our first SpecialiTEA episode we talk to Tim van der Zee (@research_Tim) about error detection, navigating critique on social media, and the positive side of the replication crisis for early career researchers. Highlights [1:30] Hey Tim! What are you working on? [2:30] Tim: I am meta-science BATMAN [3:30] Error detection: Impossible numbers in papers [5:00] Tim’s favourite errors: we’re not naming any names, but Tim will talk about some food studies… [10:...
Episode 2 - Examining analytic flexibility
July 10, 2018 21:05 - 38 minutes - 70.4 MBEpisode 2 - Examining analytic flexibility This week discuss analytic flexibility in “False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant” from Simmons, Nelson, & Simonsohn (2011) http://journals.sagepub.com/doi/abs/10.1177/0956797611417632 Highlights: [1:00] What is a false positive anyway? [3.30] Dead salmon fMRI study http://prefrontal.org/files/posters/Bennett-Salmon-2009.pdf [4:30] Pregnant men as our example of f...
Episode 1 - The problem defined
July 03, 2018 20:57 - 46 minutes - 86.3 MBIn our first journal club podcast we discuss "A manifesto for reproducible science" from Nosek et al. www.nature.com/articles/s41562-016-0021 Highlights [0:00] Sam butchers everybody's names, right from the start [7:00] "The first principle is that you must not fool yourself — and you are the easiest person to fool" - Richard Feynman [9:00] Figure 1; the best figure; the every-figure [13:30] HARKing (Hypothesising After the Results are Known), distinguishing confirmatory and exploratory anal...
Episode Zero - Introductions
June 27, 2018 03:31 - 24 minutes - 32.7 MBAmy, Sophia, and Sam introduce the ReproducibiliTea Journal Club Podcast - where we serve up mugs of ReproducibiliTea in blends of transparency, openness, and robustness with a spoonful of science. In upcoming episodes we will cover (the pdfs can also be found at https://drive.google.com/drive/folders/1dpJ7LBLjXIBhiWBJMlG-B-UgziJxyS7D); 1. A manifesto for reproducible science https://www.nature.com/articles/s41562-016-0021 2. False-Positive psychology http://journals.sagepub.com/doi/abs/...