The Reproducibility Crisis in Science: How do Expectations Influence Experimental Results?
Listen now
Description
Episode 4 of the online course How To Transform the Sciences: Six Potential Breakthroughs https://www.sheldrake.org/online-courses Around 2015, scientists were shocked to find that most papers in high-prestige peer-reviewed scientific journals are not reproducible. In one study of papers in prestigious biomedical journals, 90% could not be replicated, and in experimental psychology more than 60%. This crisis partly arises from systematic biases that Rupert discusses in his chapter on ‘Illusions of Objectivity’ in The Science Delusion (2012, new edition 2020; in the US this book is called Science Set Free), including the selective observation and reporting of results, and perverse incentives for scientists and journals to publish striking positive findings. The crisis continues to roll on, as shown, for example, by an editorial in Nature, December 2021, about un-reproducible results in cancer biology. All this is relatively straightforward, but Rupert suggests that some experiments may also involve direct mind-over-matter effects. It has long been known that experimenters can influence their experimental results through their expectations, in so-called ‘experimenter expectancy effects’, which is why many clinical trials, psychological and parapsychological experiments are carried out under blind or double-blind conditions. In most other fields of science, experimenter effects are ignored and blind methodologies are rarely employed. Rupert suggests that in addition to the usual sources of bias, experimenters may also influence experiments psychokinetically, through direct mind-over-matter effects. Scientists may be particularly prone to this source of error because most scientists believe psychokinesis is impossible, and hence take no precautions against it. They practise unprotected science. Rupert proposes experiments on experiments to test for the effects of experimenters’ hopes and expectations. References References ____ A Dream, or the Astronomy of the Moon Johann Kepler, published posthumously in 1634 by his son https://sheldrake.org/somnium ____ Rupert's essay The Replicability Crisis in Science https://sheldrake.org/replicability ____ Bad Pharma Ben GoldacreFourth Estate, 2012 https://sheldrake.org/badpharma ____ Artifacts in Behavioral Research Robert Rosenthal and Ralph L. Rosnow, Oxford University Press, 2009 https://sheldrake.org/rosenthal ____ Over half of psychology studies fail reproducibility test https://www.nature.com/articles/nature.2015.18248 ____ Differential indoctrination of examiners and Rorschach responses https://psycnet.apa.org/record/1965-12396-001 ____ A longitudinal study of the effects of experimenter bias on the operant learning of laboratory rats https://psycnet.apa.org/record/1965-01547-001 ____ Could Experimenter Effects Occur in the Physical and Biological Sciences? Skeptical Inquirer 22(3), 57-58 May / June 1998 https://sheldrake.org/skepticalinquirer98 ____ Quantum‐Mechanical Random‐Number Generator  https://aip.scitation.org/doi/abs/10.1063/1.1658698 ------ Dr Rupert Sheldrake, PhD, is a biologist and author best known for his hypothesis of morphic resonance. At Cambridge University, as a Fellow of Clare College, he was Director of Studies in biochemistry and cell biology. As the Rosenheim Research Fellow of the Royal Society, he carried out research on the development of plants and the ageing of cells, and together with Philip Rubery discovered the mechanism of polar auxin transport. In India, he was Principal Plant Physiologist at the International Crops Research Institute for the Semi-Arid Tropics, where he helped develop new cropping systems now widely used by farmers. He is the author of more than 100 papers in peer-reviewed journals and his research contributions have been widely recognized by the
More Episodes
March 20th, 2024 St. James's Church, LondonVideo: https://youtu.be/QuicgRaE7E8In this talk, Rupert Sheldrake explores the theme of finding God again, in an increasingly secular society. Drawing from personal experiences in India and his journey through various spiritual traditions, Rupert...
Published 05/21/24
Most people have had the experience of waking soon before an alarm clock goes off and some can even wake before a specified time without an alarm. The usual assumption is that this depends on an exquisitely sensitive time sense, but Rupert argues that it may be explained better in terms of...
Published 04/09/24