Description
In this two part episode we discuss the fine art of preregistration. We go back into the history of preregistration, its evolution, and current use. Do we preregister to control the Type 1 error rate, or to show that we derived our prediction from theory a priori? Can and should we preregister exploratory or secondary data analysis? And how severe is the issue of severe testing?
Shownotes
ClinicalTrials.gov
You can preregister on AsPredicted and the OSF
Johnson, M. (1975). Models of Control and Control of Bias. European Journal of Parapsychology, 36–44.
SPIRIT Checklist
Bishop, D. V. M. (2018). Fallibility in Science: Responding to Errors in the Work of Oneself and Others. Advances in Methods and Practices in Psychological Science, 1(3), 432–438. https://doi.org/10.1177/2515245918776632
FDA trials tracker: https://fdaaa.trialstracker.net
Ensinck, E., & Lakens, D. (2023). An Inception Cohort Study Quantifying How Many Registered Studies are Published. PsyArXiv. https://doi.org/10.31234/osf.io/5hkjz
van den Akker, O. R., van Assen, M. A. L. M., Enting, M., de Jonge, M., Ong, H. H., Rüffer, F., Schoenmakers, M., Stoevenbelt, A. H., Wicherts, J. M., & Bakker, M. (2023). Selective Hypothesis Reporting in Psychology: Comparing Preregistrations and Corresponding Publications. Advances in Methods and Practices in Psychological Science, 6(3), 25152459231187988. https://doi.org/10.1177/25152459231187988
Claesen, A., Gomes, S., Tuerlinckx, F., & Vanpaemel, W. (2021). Comparing dream to reality: An assessment of adherence of the first generation of preregistered studies. Royal Society Open Science, 8(10), 211037. https://doi.org/10.1098/rsos.211037
Bakan, D. (1966). The test of significance in psychological research. Psychological Bulletin, 66(6), 423–437. https://doi.org/10.1037/h0020412
Rosenthal, R. (1966). Experimenter effects in behavioral research. Appleton-Century-Crofts.
Johnson, M. (1975). Models of Control and Control of Bias. European Journal of Parapsychology, 36–44.
de Groot, A. D. (1969). Methodology. Mouton & Co.
Claesen, A., Lakens, D., Vanpaemel, W., & Dongen, N. van. (2022). Severity and Crises in Science: Are We Getting It Right When We’re Right and Wrong When We’re Wrong? PsyArXiv. https://doi.org/10.31234/osf.io/ekhc8
In this episode, we discuss the paper "In defense of external invalidity" by Douglas Mook.
Shownotes
Mook, D. G. (1983). In defense of external invalidity. American Psychologist, 38(4), 379–387.
Mook, D. G. (1989). The myth of external validity. Everyday cognition in adulthood and late life,...
Published 11/01/24
A reading of the paper In Defense of External Invalidty by Douglas G. Mook, which will be discussed in the next episode.
Mook, D. G. (1983). In defense of external invalidity. American Psychologist, 38(4), 379–387. https://doi.org/10.1037/0003-066X.38.4.379
Published 10/25/24