Education

Gender Bias in STEM—An Example of Biased Research?

I don’t agree with everything in the infamous “Google Memo” written by James Damore, but I can understand why one might write such a memo after sitting through one too many training sessions on unconscious bias. I’m a professor in a STEM discipline, and like many STEM fields mine has substantially fewer women than men. Like every STEM professor that I know, I want my talented female students to have fair chances at advancing in the field. I’ve served on (and chaired!) hiring committees that produced “short lists” of finalists that were 50 percent women, I’ve recommended the hiring of female job applicants, I’ve written strong reference letters for female job applicants and tenure candidates, and I’ve published peer-reviewed journal articles with female student co-authors. At the same time, I’ve become increasingly frustrated by the official narratives promulgated about gender inequities in my profession arising from our unconscious biases. These narratives are, at best, awkward fits to the evidence, and sit in stark contradiction to first-hand observations.

My field is smaller than many other STEM fields, so for the sake of anonymity I will not name it, but all available data shows that the proportion of women in my discipline remains stable from the start of undergraduate studies and on through undergraduate degree completion, admission to graduate school, completion of the PhD, hiring as an assistant professor, and conferral of tenure. There have even been statistical studies (conducted by female investigators, FYI) showing that the number of departments with below-average proportions of women is wholly consistent with the normal statistical fluctuations expected from random chance in unbiased hiring processes. I cannot say that everyone in my field is perfectly equitable in all of their actions, but I can at least say that available evidence strongly suggests that the sexist actions of certain individuals do not leave substantial marks on the composition of our field. This should be a point of pride for us: Whatever sins might be committed by some individuals, as a community we have largely acted fairly and equitably in matters with tangible stakes for people’s careers.

Nor is my field unusual. In 2015, Professors Wendy Williams and Steven Ceci of Cornell University published a series of experimental findings in the Proceedings of the National Academy of Sciences (PNAS), and in their experiments they found that faculty reviewing hypothetical faculty candidates consistently preferred female candidates to male candidates. Moreover, Williams and Ceci cited literature showing that in real-world hiring women have an advantage over men.

My guess is that many readers will be surprised to hear me describe such findings. (After all, we’ve all sat through training sessions on purported biases in hiring processes.) Not being a social scientist myself, I cannot offer an in-depth defense of the work of Williams and Ceci, but I have searched in vain for informed critiques by experts. Alas, every critical summary that I’ve found reveals that the author did not actually read the paper. For instance, many people express incredulity at the assertion that real-world hiring data supports the finding of an advantage for female scientists in academic hiring. However, references 16 and 30-34 of the Williams and Ceci article make exactly that case. Are these references representative of the wider literature? Do they show data that was collected and analyzed via sound methods? I have yet to see a critic make that case, but if an informed expert can point to flaws in those references I would gratefully read their analysis.

Another common criticism is that Williams and Ceci ignored the famous “Lab Manager Study” of Corinne Moss-Racusin et al., also published in PNAS in 2012, which found that faculty were willing to offer higher salaries to hypothetical applicants for a lab manager position if the name on the resume was male rather than female. However, Williams and Ceci did not ignore this study; they actually cited it in the main text of the article (reference 6) and then discussed it at length on page 25 of the supplemental materials. The response of Williams and Ceci is that faculty hiring involves highly-accomplished applicants for high-status jobs, not less-accomplished new college graduates applying for lower-status jobs, and so different psychological factors may come into play when people are evaluating the prospective hires. Are they right? I don’t know enough about the relevant psychological literature to venture an informed opinion, but I’d love to read a response by a critic who acknowledges that Williams and Ceci actually discussed these findings, rather than one who dismisses them by asserting that they ignored the work of Moss-Racusin.

So, although I cannot assert with complete confidence that STEM fields are wholly free of sexism, I can point to strong evidence that disparities in STEM are not driven by hiring bias, and I must regretfully note that there has been little informed engagement with such findings. It is not intellectually healthy to have so little informed, critical dialogue around work with potentially high significance for such an important issue. Meanwhile, for those of us working in STEM, it is demoralizing to see that when researchers find evidence that we are working actively and fruitfully to remedy gender gaps in our profession, the response is not to celebrate our success but rather to offer uninformed critiques. It seems to be impermissible to question whether our purported sexism continues to drive inequality in our community.

If this were just about one study then we could (and should) react with stiff upper lips, and not let it colour our perception of the debate around gender in the STEM disciplines. Alas, there is a pattern (bias?) in research on bias in academic science. For instance, in the same year that PNAS published the work of Williams and Ceci, they also published a study of gender bias in science by van der Lee and Ellemers, purportedly showing that female scientists in the Netherlands are more likely than male peers to have their grant proposals rejected. However, the numbers provided in the article clearly show that the disparities in funding success result from how women are distributed among disciplines, not differential treatment of men and women in the review process: Women in the Netherlands are more likely to be in fields like biology (with low funding success rates) than physics (with comparatively higher funding success rates), but within each field women and men have similar success rates for their grant proposals. This point was quickly noted by a reader, and the editors of PNAS published a critical comment within two months of the original article’s publication.

Perhaps it is a sign of healthy scientific communication when published work sparks informed discussion of alternative explanations and the journal editors make room for that discussion, but it is worrisome that such a basic error was allowed to slip through the initial review process. It’s even more worrisome when one examines the “Acknowledgments” section of the Williams and Ceci article, which I will quote in part: “We thank [names of colleagues who provided advice], seven anonymous reviewers, one anonymous statistician who replicated our findings, and the editor.” It is very unusual for an article to be reviewed by seven separate peer reviewers before publication (the most I’ve ever had was four, and I’ve published in some rather high-impact journals), and even more unusual for a journal to insist that the raw data be sent to an anonymous statistical consultant for independent verification of the results. One cannot help but wonder if Williams and Ceci were held to a higher standard than van der Lee and Ellemers because Williams and Ceci offered work that contradicted a common narrative while van der Lee and Ellemers offered work that allegedly affirmed the conventional wisdom.

To put these articles in context, keep in mind the place that PNAS occupies in the hierarchy of academic journals. PNAS is not merely a high-status, high-impact, widely-read journal. There are many such journals; indeed, every field of science has at least one such publication venue (and often more than one). What makes PNAS stand out is that it’s one of the few well-respected journals to publish work spanning the entire breadth of science and engineering, ranging from psychology to materials engineering to marine biology. My colleagues and I don’t usually read psychology journals but we do read PNAS. It’s unlikely that we’ll ever have a lunch conversation about an article published in a specialty venue for social scientists, but it’s entirely possible that we’ll pass a lunch time discussing some social science finding published in PNAS. An editorial slant in such a respected and well-read journal will have consequences for the narratives that gain traction in our field.

So much for the big picture. What about the small scale? Everyone has heard anecdotes about sexist treatment of women, and I confess that I’ve witnessed a few such incidents. (I tried to do what I could when I witnessed them, but it isn’t always easy to process what you’ve seen quickly enough to respond in a timely fashion, especially when issues of power and status loom large.) At the same time, I’ve also witnessed compensatory measures, and even over-compensation. I’ve seen “diverse” colleagues get away with conduct bordering on fraud because nobody wanted to call them out for it. I’ve seen middling female students lavished with praise and encouragement when they were ambivalent about whether to apply to graduate school, while similarly weak male students were met with (quite appropriate!) skepticism about their interest in graduate study. I’ve seen hiring committees bend over backwards to paper over a female applicant’s weaknesses while rigorously critiquing a male applicant.

Of course, I’ve seen white and male colleagues get away with certain things as well, so I can’t say that the situation is entirely one of “reverse sexism” or “political correctness” or some such thing. What I can say is that my ground-level observations are largely consistent with the big-picture data: Sexist things do happen, but people work conscientiously to compensate and even over-compensate, resulting in an employment landscape that is at the very least level and often somewhat favorable to women. But it is impermissible to vocalise this observation, so we are left with no choice but to nod and agree as we are scolded for shameful internal biases that allegedly leave their mark on our professional community, a community that many of us care deeply about improving.

This can only go on for so long before people push back. I certainly have my criticisms of Damore’s arguments, and I would be the first to agree that he is clueless about how to navigate workplace politics. Nonetheless, if we keep hearing that conscientious and hard-working people are at fault for gender gaps, disparities that they themselves have actively worked to combat, and that have even seen peers perhaps over-correct for, eventually people will start responding with something other than enthusiastic confessions of privilege and bias. People will start pointing to contradictory data, and even sympathetic people might start grumbling about excesses of political correctness that they may have witnessed. Some of us will do it pseudonymously, both for our own comfort and the comfort of co-workers, but some people will do like James Damore and speak out under their own names, making the workplace uncomfortable (to put it mildly).

We have a choice before us. One option is to celebrate the progress that has been made, stop pointing the blame at the alleged biases of conscientious people, and steer the conversation to the true origin of disparities, earlier “in the pipeline” as they say. The other option is to keep admonishing generally well-meaning professionals to stop behaving in such an allegedly biased manner, and then act shocked and scandalised when somebody draws attention to the countervailing data. The first path will mean fewer silly training sessions, but it might also mean awkward conversations about how and why people become interested in different paths of work and study.  Whether these factors arise from nature, nurture, or the interaction thereof, they come into play long before anybody gets to a STEM career, and moving past bias explanations means that people who are concerned about the makeup of the profession will have to be able to confront these questions. The second path will avoid those awkward conversations, but at the cost of resentment that might occasionally pour out. I can’t speak for everyone in STEM, but as a scholar I’d rather see conscientious people confront data and discuss its implications, not paper over it with misplaced blame.

Filed under: Education

by

The author is a tenured professor in a STEM discipline. Sebastian Cesario is a pseudonym.

19 Comments

  1. andrewnwest says

    “One cannot help but wonder if Williams and Ceci were held to a higher standard than van der Lee and Ellemers because Williams and Ceci offered work that contradicted a common narrative while van der Lee and Ellemers offered work that allegedly affirmed the conventional wisdom”

    Shouldn’t there be a higher standard? Claims that go against the conventional wisdom need greater evidence than those supporting it, because the conventional wisdom is (hopefully) reached by weighing earlier evidence.

    • Chris23235 says

      No, “conventional wisdom” has nothing to do with science. If there is a process in place how scientific work is judged it doesn’t matter, it isn’t of interest, if the work is colliding with “conventional wisdom” or not. You have to proof your point in your study and if a certain number of peer reviewers is seen as sufficient for one study, it is of course sufficient for another study.

      • Bill says

        Chris, while your point seems logical it leads to some odd end points. Take, for example, the infamous “97% agree” by Cook in the climate science realm. That calculation was based upon looking at published, peer review literature and attempting a qualitative analysis to determine consensus. Disregarding discussion about the method — if research that affirms “conventional wisdom” is subjected to less rigor prior to publication then logically more “conventional wisdom” affirming research is published. As a consequence, any meta-analysis on published data becomes skewed and those meta-analysis, since they are also “conventional wisdom” also receive the lower level of rigor and the cycle accelerates.

      • Santoculto says

        “Conventional wisdom has nothing to do with science”

        Such a elitist-scientistic statement. Yes it has.

      • No, “conventional” wisdom has nothing to do with it. Your reply about climate science is off target, because that is accumulated scientific knowledge, not conventional wisdom.

        Your point might hold if and only if there was a HUGE consensus in the scientific community that discrimination is a major cause of STEM inequalities. Whereas it is possible to cherrypick evidence to support such a conclusion, there is ABUNDANT evidence that factors other than discrimination contribute to STEM inequalities as well, and nearly as abundant evidence that personnel decisions are highly, if imperfectly, meritocratic.

        So, absent something like a 97% consensus that discrimination at the point of hiring (which is exactly what was assessed both by Moss-Racusin et al and by Williams and Ceci) is the major source of STEM inequalities, no, there is no basis for having held W&C to a higher standard.

        Of course, now that it was published AFTER being held to such a higher standard, the burden of proof should shift to those arguing for discrimination. Don’t hold your breath, though, waiting for social scientists to require high standards (such as 5 separate experimental studies using multiple methods, as in Williams and Ceci) to demonstrate discrimination.

        Lee Jussim

    • Fish says

      That is – perhaps unfortunately – human nature.

      I speak from personal experience when I say that, on starting to review a paper presenting a claim that goes against the consensus one immediately thinks “that can’t be right” and goes through the paper with a microscope looking for a big mistake.

      This is something that we must try to account for in the peer review process, but it is not easy to do so.

      That said, having so many reviewers is very strange (and I’ve never heard of an independent statistician before – not that it’s a bad thing) but likely reflects more on the editors than the reviewers.

  2. Grumpy Old Man says

    No – everyone should be held to the same standard – the presumption that conventional wisdom is supported by evidence is most politely described as brave. I think the sentiments in this article are spot – but then I’m an old white male so I would.

  3. This is another terrific entry in Quillette. The author gets all the science exactly right.

    However, to me, the most telling aspect of this essay is that the author felt compelled to post it using a pseudonym. Now, why might that be? Because s/he is afraid to post it under his/her own name (the backlash is often even worse if you post this sort of thing as a woman or minority, so, despite the name, I make no assumption about whether the author is male or female).

    it is extremely difficult, bordering on impossible, to have a reasoned, sane conversation about these issues, as shown by Damore’s firing and the aftermath. If anything, the situation is even worse in the academy, where anyone having the unmitigated gall to question the prevalence or power of discrimination to fully explain any inequality basically paints a big fat target on their face and is saying, “Shoot me.”

    And if you have any doubt about that, please check out my essay, The Psychology of the New McCarthyism over at Psychology Today.

    • Sebastian Cesario says

      I’ve made some of these points before in difficult conversations with colleagues. It did not go over well. If I named my field that might be enough to confirm my identity, should one of them read this.

      If certain people found out, I would lose good friends and productive research collaborators.

      If I used my real name and then served on a hiring committee, that could later be used against me and the institution if somebody were unhappy with the outcome of a hiring process.

      If it became widely known to colleagues that I wrote this article, I might no longer be elected to serve on certain committees where I’ve been able to make meaningful contributions to my institution.

      • Bill says

        And aren’t those facts a bit scarey? That you can’t have discourse on a topic using underlying published research without fear of being blackballed or terminated or worse? Denier! Heretic! Nazi! Nope…Scientist =)

        Ironically, diversity, as it appears in research context not the affirmative action context of the news media, creates the ecosystem necessary for disruptive innovation. Unfortunately, we’re descending into an environment where diversity is not accepted. Terminology has been flipped Orwellian style.

      • Zachary Reichert says

        If you are denounced and thrown to the wolves for daring to tell the truth, maybe that’s the best thing that could possibly happen. Maybe continuing to serve in such a position does nothing but weaken you and make you resentful.

  4. > the response is not to celebrate our success but rather to offer uninformed critiques

    have you considered that maybe there is a veiled interest in the “diversity industry” to keep the narrative forever in a state of “sexism is alive and well and we must fight it” ?

  5. I am in agreement with the article that censorship on gender related materials has gone too far. That being said, it’s bizarre to me that this piece that is clearly spurred on by Damore’s memo not once mentions the ‘divisive programs’ (extra training, presentations, meals, events, and mentoring for non cis males) that was the memo’s progenitor. White men are being actively and openly disadvantaged in their workspace and the most this article has to say on it is they should use a pseudonym when raising their grievances so as not to make others uncomfortable? Because that sounds a lot like the author is saying it is a worse act to speak out against discrimination then to actually discriminate. This has me wondering, whose side is the author actually on?

    The author here claims some workplace awkwardness is the worst that can come out of this. I would instead point to just one assessment of our last election, though many seem in agreement, from The Atlantic (https://www.theatlantic.com/politics/archive/2016/11/how-trump-won/507053/): “For Trump the key to [victory in the midwest] was his remarkable success among white working class voters” and say the author really needs to leave her academic bubble.

  6. Pingback: « Notícias

  7. Wasted my time reading this apologist equivocation on an important issue. I would prefer to read an expose on prejudice where women are over-represented. Isn’t it enough that women enjoy hiring preference in practically every field of endeavor except the really physically hard, risky, dirty work that is reserved for men? Why aren’t you advocating for more women as oil rig operators and lumberjacks? What sexism have you found in those areas?

    • Some of us are. I have been on a crusade at my workplace to get some women hired in the mechanical/electrical technician fields as apprentices. At present, 100% of our apprentices are men. HR has told me “women don’t want to be plumbers”, presumably because it’s riskier and physically harder than HR. I keep pressing. I have also asked why there isn’t more gender equality amongst the secretarial and admin population. Equality is not equality unless it goes both ways.

  8. Stephen Richter says

    Such a long article. Yet no mention of the fact that all of the advances in computer software have been accomplished by men. Being that the software field has such a low barrier to entry, doesn’t the mob that lynched James Damore have to explain this obvious disparity?

    • I disagree with your assessment about the advances in computer software having been accomplished by men. With the exception of single-developer pieces, software is developed by a group and has been for decades. A claim that women coders, even though they are very few, were not involved in the advances would be a tough argument. In many cases, female coders are superior to many men due to their (my observation and equally anecdotal) attention to detail. If you base the moniker of “advances” on things like peer research, well then I would argue that many advances precede that as well. Computer software is not computer science.

      You are playing the numbers game where 10,000 men throw 10,000 pieces of software at a wall. 9,997 are total crap, 2 are decent, 1 is great. 10 women throw 10 pieces of software at the wall, get 1 decent. Are the men “superior” or are we simply seeing statistical insignificance due to too low of an “n?” Believe me, there are 10,000 men throwing crap out out there and have been since the 1990s with “web developer for dummies.” It’s part of the H1B problem in IT. The DoL included all of those H.S. grads in the pool of “developers” when figuring out prevailing wage which allows companies to grab indentured servants with skills (java developers for example) and pay them below the segmented market rate (java developers = 80k/yr, “all developers” = 60k, so they can get an H1B java developer at a 25% discount).

  9. Sebastian Cesario says

    If I had known that the biggest objection to my article would be that I’m too politically correct I would have used my real name.

    Alas, I suspect that my colleagues would read this article differently than the people commenting here. So the pseudonym is staying.

Comments are closed.