Does Not Compute
Listen now
Description
Scientific journal articles have a lot of numbers. Scientists are smart people with even smarter computers, so an outsider might think that, if nothing else, you can count on the math checking out. But modern data analysis is complicated, and computational reproducibility is far from guaranteed. In this episode, we discuss a recent set of articles published at the journal Cortex. A group of authors set out to replicate an influential 2010 article that claimed that if you reactivate a fear-laden memory, it becomes possible to change the emotional association - something with clear relevance to clinical practice. Along the way, the replicating scientists encountered anomalies which led them to try to reproduce the analyses in the original study - and they discovered that they could not. We talk about what this means for science. What are the implications of knowing that for a nontrivial number if scientific studies, the math doesn't add up? Will a new era of open data and open code be enough to fix the problem? How much will Verification Reports - a new publication format that Cortex has introduced - help with that process? Plus: We answer a letter about swinging for the fences when your dream job comes up but you don't feel ready yet. Links: The three R's of scientific integrity: Replicability, reproducibility, and robustness, by Robert McIntosh and Chris Chambers The Validity of the Tool “statcheck” in Discovering Statistical Reporting Inconsistencies, by Michèle Nuijten et al Analytic reproducibility in articles receiving open data badges at Psychological Science: An observational study, by Tom Hardwicke et al The Black Goat is hosted by Sanjay Srivastava, Alexa Tullett, and Simine Vazire. Find us on the web at www.theblackgoatpodcast.com, on Twitter at @blackgoatpod, on Facebook at facebook.com/blackgoatpod/, and on instagram at @blackgoatpod. You can email us at [email protected]. You can subscribe to us on iTunes or Stitcher.   Our theme music is Peak Beak by Doctor Turtle, available on freemusicarchive.org under a Creative Commons noncommercial attribution license. Our logo was created by Jude Weaver.   This is episode 82. It was recorded on August 10, 2020.
More Episodes
In 2012, Rink Hoekstra received two emails on the same day. One was from a journal editor, telling him that a manuscript was being rejected based on the recommendations of two reviewers. The other was from one of those reviewers, complimenting the paper and congratulating him on a job well done....
Published 10/30/20
Published 10/30/20
Academics are under enormous stress right now, raising the possibility of a rising rate of burnout. Longtime structural trends in higher education have increased pressures for demonstrable productivity. On top of that are a global pandemic, resistance and backlash to calls for racial justice, and...
Published 09/23/20