Is MTurk Too Good To Be True?
Listen now
Description
In a recent article, psychologists Webb and Tangney document their experience collecting psychology data online using Amazon's crowdsourcing platform MTurk. Alarmingly, the authors conclude that ultimately only 2.6% of their sample was valid data from human beings. Yoel and Alexa weigh in on these findings, discussing what researchers can reasonably expect from online studies and platforms, and how their personal experiences have informed their own practices. They also consider a response written by Cuskley and Sulik, who argue that researchers, not recruitment platforms, are responsible for ensuring the quality of data collected online. Questions that arise include: What studies do people want to do? Does anyone read the fine print? And what are the ethics of mouse-hunting? Links: Two Psychologists Four Beers on UntappdToo Good to Be True: Bots and Bad Data From Mechanical Turk - Margaret A. Webb, June P. Tangney, 2022PsyArXiv Preprints | The burden for high-quality online data collection lies with researchers, not recruitment platformsLiving in Harmony with House Mice and Rats | PETA
More Episodes
Andrew Devendorf joins Alexa and Yoel to discuss his work on "me-search" (or self-relevant research) within clinical psychology. He talks about the prevalence of mental health difficulties within the field, and the harmful taboos against speaking openly about them. And, he shares his own reasons...
Published 10/04/23
Published 10/04/23
Playing devil's advocate, Yoel and Mickey mount a criticism against the scientific study of mindfulness. What is mindfulness? Can we measure it? Is mindfulness-based therapy effective? Can mindfulness improve the quality of attention beyond the meditation cushion? Are effects of mindfulness...
Published 09/27/23