Can taste beat peer review?
Listen now
Description
Scientific peer review is widely used as a way to distribute scarce resources in academic science, whether those are scarce research dollars or scarce journal pages. At the same time, peer review has several potential short-comings. One alternative is to empower individuals to make decisions about how to allocate scientific resources. Indeed, we do this with journal editors and grant makers, though generally in consultation with peer review. Under what conditions might we expect individuals empowered to exercise independent judgement to outperform peer review? This podcast is an audio read through of the (initial version of the) article "Can taste beat peer review?", originally published on New Things Under the Sun. Articles mentioned Wagner, Caroline S., and Jeffrey Alexander. 2013. Evaluating transformative research programmes: A case study of the NSF Small Grants for Exploratory Research programme. Research Evaluation 22 (3): 187–197. https://doi.org/10.1093/reseval/rvt006 Goldstein, Anna, and Michael Kearney. 2017. Uncertainty and Individual Discretion in Allocating Research Funds. Available at SSRN. https://ssrn.com/abstract=3012169 or http://dx.doi.org/10.2139/ssrn.3012169 Card, David, and Stefano DellaVigna. 2020. What Do Editors Maximize? Evidence from Four Economics Journals. The Review of Economics and Statistics 102 (1): 195–217. https://doi.org/10.1162/rest_a_00839 Teplitskiy, Misha, Hao Peng, Andrea Blasco, and Karim R. Lakhani. 2022. Is novel research worth doing? Evidence from peer review at 49 journals. Proceedings of the National Academy of Sciences 119 (47): e2118046119. https://doi.org/10.1073/pnas.2118046119
More Episodes
Published 04/04/24
Welcome to patents week! I set out to write a post about using patents to measure innovation, but it turned into four. I'm releasing podcasts of each episode, one per day, but if you're too excited to wait, you can read all four here, on New Things Under the Sun. How many inventions are patented?...
Published 04/04/24
Welcome to patents week! I set out to write a post about using patents to measure innovation, but it turned into four. I'm releasing podcasts of each episode, one per day, but if you're too excited to wait, you can read all four here, on New Things Under the Sun. How many inventions are patented?...
Published 04/03/24