"Justification for such claims. Getting higher test scores after studying philosophy does not show that higher scores are the result of studying philosophy."
The average scores of philosophy majors on the LSAT and other standardized tests are regularly presented as reasons for university students to major in philosophy. In an age of increasing pressure to compete for student enrollments, data of this sort are important for the discipline of professional philosophy. Tenure lines are partly justified on the basis of student enrollments, and students are encouraged to enroll in philosophy partly on the basis of the impact that philosophical instruction has on cognitive ability, these claims are part of the mechanism by which academic philosophers hope to secure university funding for their departments. Given these institutional arrangements, the profession of academic philosophy has an interest in determining whether these statements about the beneficial cognitive impact of the study of philosophy are justified.
In an essay published at Quillette in July of last year, Neven Sesardić critically examined the evidence for these statements and found them wanting. He wrote:
In reality, however, there is no justification for such claims. Getting higher test scores after studying philosophy does not show that higher scores are the result of studying philosophy. For all we know, it may be that philosophy students are brighter than average to begin with, and that this is why they perform so well on the tests. If that were true, their high scores would have nothing to do with their studying philosophy courses. Therefore, as long as this alternative hypothesis is not ruled out, no inference about practical benefits of philosophy is logically permissible.
Sesardić’s essay provoked some discussion at Daily Nous, and at Brian Leiter’s blog here and here. Building on my remarks at Leiter (and on another discussion at Daily Nous), in this essay I will examine a related claim about the impact of philosophical instruction on cognitive ability and suggest that, while the outlook is not so bleak, the discipline of philosophy is not yet paying enough attention to this issue.
* * *
Sesardić’s reservations are directed at the absence of evidence showing a link between university instruction in philosophy and its impact on university students’ cognitive development. While it may be true that claims for this university-level link are unjustified or overstated, a growing body of controlled and randomized research suggests that philosophical instruction in primary and secondary education positively impacts students’ subsequent cognitive development, sometimes for years after that instruction ceases. Improvements have been reported in mathematics, critical reasoning, reading comprehension, emotional intelligence, and listening/talking skills. For an overview, see the work surveyed on pages 4-7 of Philosophy for Children: Evaluation Report and Executive Summary.
That report is the result of a trial sponsored by the Education Endowment Foundation (UK), and independently evaluated by a team from Durham University, examining the impact of philosophical instruction for students in grades four and five at 48 schools in England. Students received (on average) one period’s worth of philosophy per week over the course of one year. Page three contains the following “Key Conclusions” (with ‘P4C’ as ‘Philosophy for Children’):
There is evidence that P4C had a positive impact on Key Stage 2 attainment. Overall, pupils using the approach made approximately two additional months’ progress in reading and maths.
Results suggest that P4C had the biggest positive impact on Key Stage 2 results among disadvantaged pupils (those eligible for free school meals).
Analyses of the Cognitive Abilities Test (a different outcome measure not explicitly focused on attainment) found a smaller positive impact. Moreover, in terms of this outcome it appears that disadvantaged students reaped fewer benefits from P4C than other pupils. It is unclear from the evaluation why there are these differences between the two outcomes.
Teachers reported that the overall success of the intervention depended on incorporating P4C into the timetable on a regular basis. Otherwise there was a risk that the programme would be crowded out.
Teachers and pupils generally reported that P4C had a positive influence on the wider outcomes such as pupils’ confidence to speak, listening skills, and self-esteem. These and other broader outcomes are the focus of a separate evaluation by the University of Durham.
Similar results were reported for the impact of P4C on non-cognitive abilities (e.g. social and communication skills, teamwork and resilience, and empathy), again with the largest results shown for economically disadvantaged pupils.
These results are not an outlier, as there are a number of controlled and randomized studies on the positive developmental effects of philosophical instruction in primary and secondary school. A review article of 10 studies was published in 2004. The authors of that article published the results of their own study in Scotland, where students were given one hour of philosophical instruction once a week for 16 months, in 2007. Similar gains were reported, and two years after instruction ceased the authors found that:
The significant pre-post cognitive ability gains in the experimental group in primary school were maintained towards the end of their second year of secondary school. Higher achieving pupils were somewhat advantaged in sustaining these gains. The control group showed an insignificant but persistent deterioration in scores from pre- to post-test to follow-up.
The original study was not completely randomized, however: when the researchers made their proposal, some of the schools surveyed had already settled on a curriculum. As a result, only those schools that had space in their curriculum were selected for the first phase of the intervention. A replication of that study undertaken in Texas during the 2010/11 school year avoided that problem, however, and persistent gains were likewise recorded during a follow-up, this time three years later.
* * *
As Sesardić documents in his essay, a number of philosophy departments broadcast the putative benefits of the study of philosophy on the cognitive abilities of university students. He suggests that the reticence to examine these benefits may be due to a concern that doing so would “harm their own discipline by destroying an important rationale for the existence and funding of philosophy departments in their current form and size.” While it may be true that the evidence for those benefits among university students is lacking, that does not seem to be the case for the impact of philosophical instruction in primary and secondary schooling.
Nevertheless, this is a relatively recent area of social science research, and more work is needed before we can conclusively assert that philosophical instruction prior to higher education has the effects these studies document. And the opportunity for further research is substantial. Currently, over 60 countries have philosophical programs in place that serve students from kindergarten through high school, and a variety of approaches toward teaching philosophy in primary and secondary education have been developed over the last forty years (see the discussion on pages 20-26 of the 2011 UNESCO report Teaching Philosophy in Europe and North America, the summary at The Variety of Schools of Philosophy for Children in France and in Philolab, the Stanford Encyclopedia of Philosophy’s article on Philosophy for Children, and the essays collected in Transforming Thinking: Philosophical Inquiry in the Primary and Secondary Classroom by Catherine C McCall, Routledge 2009).
I do not want to overstate the case, but this is also an area of potential growth for the profession of philosophy. Whereas the number of PhD-granting programs in philosophy swelled over the course of the twentieth century, there has to date been very little interest in teaching philosophy to students in elementary school, middle school, and high school, particularly in the United States. But even if the link between university instruction and increased cognitive ability is severed, it does not follow that the health of the discipline (measured in student enrollments and the funding this brings with it) needs to suffer. One might imagine a future in which academic philosophers work more closely with schools of education, first to establish whether these apparent benefits are real, and then to teach philosophy in primary and secondary schooling.
* * *
One final benefit of early philosophical instruction should be noted. Much of the work on philosophy for children is downstream from the pioneering efforts of Mathew Lipman as director of the Institute for the Advancement of Philosophy for Children at Montclair State University in New Jersey. Lipman’s work there was the result of his experience teaching philosophy at Columbia University in the late 1960s. Despairing over the state of his students’ dialectical skills, and the impact this was having on not only the student protest movement but on the broader arena of public discourse, Lipman became convinced that American citizens needed exposure to philosophy from an early age.
Looking around at the state of public discourse in the United States today, and at the character of social unrest on college campuses, one must conclude that the need for careful and critical reasoning is as pressing as it ever was. This need is not localized to the United States. In May of 2011, the UK published a report entitled Teaching Approaches that Help to Build Resilience to Extremism Among Young People. That report cited Philosophy for Children as one effective method (see also the discussion at Daily Nous). Consider the following remarks made by Bjorn Ihler, a survivor of Anders Breivik’s terrorist attack in Norway in July of 2011 and a member of the anti-extremism initiative Extremely Together:
Bjorn’s main recommendation for schools is that they teach students that people are allowed to hold very different ideas and opinions.
“I would like to see a class teaching critical thinking or philosophy in every school,” he says.
“Students need to learn to analyse the information they receive, and to understand that there are many ways to interpret information, rather than see the world as black and white.”
He is concerned that many education systems are “shutting down critical thinking and teaching propaganda”.
He says the mentorship of his old philosophy teacher helped him get through a difficult year following the attack.
“I was all over the place, I couldn’t make sense of anything, so I decided to call my old high school philosophy teacher,” he says.
“He had taught me that people can see the world in different ways. If Breivik had had him as a teacher, I think things could have been very different.”
In addition to the value that philosophical instruction in primary and secondary school may have on both young people and the profession of philosophy, then, it may also be valuable for the societies in which philosophers live and move and have our being.