Episodes
Dan and James discuss how scientific research often neglects the importance of maintenance and long-term access for scientific tools and resources. Other things they cover: Should there be an annual limit on publications (even if this were somehow possible)? The downsides of PhD by publication The Gates Foundation's new Open Access policy Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support...
Published 04/03/24
Published 04/03/24
Dan and James discuss the Retractobot service, which emails authors about papers they've cited that have been retracted. What should authors do if they discover a paper they've cited has been retracted after they published their paper? Other things they chat about A listener question about including examiner's comments in thesis The different types of retractions and thier impact Why aren't versioning systems more common in scientific publishing? Other links Everything Hertz on social...
Published 02/29/24
We discuss two recent plagiarism cases, one you've probably heard about and another that you probably haven't heard about if you're outside Norway. We also chat about the parallels between plagiarism and sports doping—would people reconsider academic dishonesty if they were reminded that future technology may catch them out? Here are some of the takeaways from the episode (generated with the help of AI): Plagiarism cases can range from minor academic practice issues to more serious...
Published 01/31/24
We chat about a paper on the invisible workload of open science and why academics are so bad at tracking their workloads. This episode was originally recorded in May 2023 in a hotel room just before our live recording of Episode 169, which is why we refer to the paper as a 'new' paper near the start of the episode. Links The paper on the invisible workload of open research Our live and in-person episode with Sandra Matz on using big data to understand behavior Other links Everything...
Published 12/29/23
We chat about a recent blogpost from Dorothy Bishop, in which she proposes a Master course that will provide training in fraud detection—what should such a course specifically teach and where would these people work to apply their training? We also discuss whether open science is a cult that has trouble seeing outward. Links The blog post on the Master in dark arts defence from Dorothy Bishop The blog post on whether open science is a cult from Andrew Gelman Other links Everything...
Published 12/07/23
James proposes proposes a new type of consortium paper that could provide collaborative opportunities for researchers from countries that are underrepresented in published research papers. We also talk about computational reproducibility and paper publication bonuses. Links The paper from Steve Lindsay on computational reproducbility: A Plea to Psychology Professional Societies that Publish Journals: Assess Computational Reproducibility Other links Everything Hertz on social...
Published 11/01/23
Dan and James discuss a recent paper that investigated how science journalists evaluate psychology papers. To answer this question, the researchers presented science journalists with fictitious psychology studies and manipulated sample size, sample representativeness, p-values, and institutional prestige Links The paper on how science journalists evaluate psychology papers The preprint paper on small samples Laboratory Life by Bruno Latour Other links Everything Hertz on social...
Published 10/01/23
Dan and James discuss a recent proposal to do away with discussion sections and suggest other stuff they'd like to get rid of from academic publishing. Links The paper on the proposed elimiation of the discussion section The paper on machine readable hypothesis tests Our episodes with Daniel Lakens Our episode with Lisa DeBruine Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get...
Published 08/31/23
We chat with Daniel Simons and Christopher Chabris about the science of cons and how we can we can avoid being taken in. We also cover the fate of the gorilla suit from the 'invisible gorilla' study, why scientists are especially prone to being fooled, plus more! Buy Daniel and Christopher's new book, Nobody's fool, from your favourite bookseller here. Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on...
Published 07/20/23
We discuss evidence of data tampering in a series of experiments investigating dishonesty revealed via excel spreadsheet metadata and how traditional peer review is not suited for the detection of data tampering. Links Data colada post 1 The conceptual replication attempt in Guatemalan taxpayers The paper on using caution when applying behavioural science to policy Data colada post 2 The carthorse child Other links Everything Hertz on social media Dan on twitter James on...
Published 06/23/23
In our first ever live and in-person episode, we chat with Sandra Matz about the opportunities and challenges for using big data to understand human behavior Links Everybody lies book, by Seth Stephens-Davidowitz A paper on "Born open" data Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise,...
Published 05/31/23
Dan and James discuss a new paper that reviews potential issues in metascience practices. They also talk about their upcoming live show in May in Frankfurt. Links Our upcoming show on May 8th, which will be a part of the at the 4th symposium on big data and research syntheses in psychology symposium to be held in Frankfurt, Germany The paper we discuss from Mark Rubin Peder Isager and team's paper on what to replicate Other links Everything Hertz on social media Dan on twitter...
Published 04/27/23
Dan and James chat about a new study that uses homeopathy studies to evaluate bias in biomedical research, a new-ish type of authorship fraud, and the potential for Chat GPT peer-review. Links The Chat GPT paper library tweet The Homeopathy paper The David Grimes paper British dental journal paper on fraud The AHealthcareZ YouTube channel The FittDesign Studio YouTube channel Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter...
Published 03/16/23
Dan and James discuss a recent paper that claims that science is becoming less disruptive over time and the suggested causes for this decline. Links Our prior episode, which discussed PhD defences The paper on disruption in science The news piece on the paper Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything...
Published 01/25/23
Dan and James chat about self-promotion in academia, how they both wish they had doctoral defences (these aren't a thing in Australia), and replacing error bars with the letter "t". Links and stuff The now retracted paper with the error bars as "t"s A direct link to the figure The blog post on self-promotion, titled "The End of Decency: When Self-Promotion Goes Too Far"...
Published 12/30/22
James and Dan discuss the recent migration of scientists from Twitter to Mastodon and the pros and cons of sharing the prior submission history of manuscripts The Mastodon thread discussion the submission history policy in American Chemical Society Journals The "Weekend at Bernies" film Our new Mastodon account: @[email protected] James' leaf blower man haiku Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything...
Published 11/28/22
Dan and James discuss eLife's new peer review model, in which they no longer make accept/reject decisions at the end of the peer-review process. Instead, papers invited for peer review will receive an assessment from eLife and the peer reviews will be shared on eLife's website. It's up to author if they would like revise their manuscript or publish their paper as the version of record. eLife's announment A editorial from Michael Eisen and team Episode 122: Reoptimizing scientific...
Published 11/07/22
We chat about a recent preprint describing an experiment on the role of author status in peer-review, dodgy conference proceedings journals, and authorships for sale. Links James' blogpost on conference proceedings journals The preprint/working paper on status bias Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz...
Published 10/17/22
Dan and James are joined by Brian Nosek (Co-founder and Executive Director of the Center for Open Science) to discuss the recent White House Office of Science Technology & Policy memo ensuring free, immediate, and equitable access to federally funded research. They also cover the implications of this memo for scientific publishing, as well as the mechanics of culture change in science. Open Science Framework hits half a million users The White house memo Brian on Twitter Other...
Published 09/12/22
Dan and James share ten rules for whistleblowing academic misconduct. The Safe Faculty Project website SLAPP statues https://en.wikipedia.org/wiki/Strategic_lawsuit_against_public_participation Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything Hertz merchandise, access to the occasional bonus episode, and the...
Published 08/31/22
Dan and James are joined by Saloni Dattani for a chat about the history of peer review, a reimagination of what peer review could look like, what happens when you actually pay peer reviewers, peer reviewer specialisation, post publication peer review, annual paper limits for authors, automation in peer review, and Big Cheese. Links Works in Progress magazine One of the many news stories about the Jarsberg cheese study The actual study Saloni's peer review piece The F1000 format Our...
Published 08/15/22
By popular demand, Dan and James chat about journal word and page limits.They also the debate around a recent meta-analysis on nudge interventions. Links The PNAS nudge meta-analysis The response letter The paper on adjectives and adverbs in life sciences Other links Everything Hertz on social media Dan on twitter James on twitter Everything Hertz on twitter Everything Hertz on Facebook Support us on Patreon and get bonus stuff! $1 per month: A 20% discount on Everything...
Published 08/01/22
Dan and James discuss a new preprint that examined the types of limitations authors discuss in their published articles and whether these limitation types has changed over the past decade, especially in light of methodological reform efforts. Links The Genetic Lottery by Kathryn Paige Harden The limitations preprint by Beth Clarke and collegues Simine Vazire’s episode (also known as the one where Dan's wife starts going into labor) The heartbeat paper from Galvez-Pol and collegues Rand...
Published 07/11/22
Dan and James discuss a recent paper that concluded (again) that most researchers aren't compliant with their published data sharing statement and whether torrents (remember them?) are a viable alternative for sharing large datasets. Links The data request paper The paper Dan and James co-authored led by Julian Koenig Our episode with Henry Drysdale Our episode with Chris Chambers The meta-psychology journal Other links Everything Hertz on social media Dan on twitter James on...
Published 06/21/22