I have a question for you: "If a bat and a ball cost $1.10 in total and the bat costs $1.00 more than the ball, how much does the ball cost?". Did 10 cents seem right? The authors of questions like this are attempting to lure you to accept this incorrect answer in order to test whether you thought reflectively when you solved the problem. However, there may be problems with this method of testing reflective thinking. So my colleagues used some underrated methods to determine the degree to which tests like this misclassify correct responses as reflective or lured responses as unreflective. I'll read the paper in this episode. The (free) paper is "Tell Us What You Really Think: A think-aloud protocol analysis of the Verbal Cognitive Reflection Test". Special thanks to co-authors Brianna Joseph and Gabriela Gongora for helping me with Study 1 and to co-author Miroslav Sirota for helping with conceptualization and revisions. This paper is dedicated to the late Anders Ericsson (1947-2020), who helped inform the development of our online think-aloud protocol (Study 2). As always, free preprints of my papers are available on my CV at byrdnick.com/cv under "Publications". This podcast is sponsored by Namecheap. Namecheap is committed to offering the best value and customer service for website domains, hosting, and SSL encryption certificates. After looking at their offers, I was tempted to switch my website to their services. You can learn more namecheap.pxf.io/byrd. You can find the Upon Reflection podcast here or in your podcast app. You can also find out more about me and my research on Twitter via @byrd_nick, or on Facebook via @byrdnick. If you end up enjoying the Upon Reflection podcast, then feel free to tell people about it, online, in person, or in your review. Related posts * Upon Reflection, Ep. 10: Great Minds Do Not Think Alike * Upon Reflection, Ep. 8: Reflective Reasoning & Philosophy * What good is reflective reasoning? * The Roles of Intuition & Reflection in Skill & Expertise * On Whether Reflection Is A Virtue