Back to blog
Sofia Marchetti

What the research says about bias in AI candidate screening

Abstract illustration of a balance scale for AI screening fairness

The conversation about AI bias in hiring tends to split into two unproductive camps. One camp claims AI screening is inherently biased and should be banned. The other claims AI screening is objective and bias-free by definition. Both claims are wrong. The actual research is more nuanced and more useful.

Where AI screening reduces bias

Human reviewers show consistent, well-documented biases in resume screening. Name-based discrimination is perhaps the most replicated finding in the literature: resumes with names associated with particular demographic groups receive systematically fewer callbacks, even when credentials are identical. Recency bias, fatigue effects, and in-group affinity also affect human screening in measurable ways.

AI screening eliminates all of these at the signal-extraction layer if the system is designed correctly. A model that evaluates skill evidence, project outputs, and role history against a defined rubric can be explicitly designed to not process name, address, school name, or other demographic proxies. That's a genuine reduction in bias relative to unaugmented human review.

Fatigue effects are underappreciated in the bias conversation. Studies on human judgment under cognitive load consistently show that the quality of decisions degrades as the decision-making session lengthens. For resume review, this means the 60th candidate in a session is evaluated under materially different conditions than the 10th. If demographic characteristics correlate with application timing (which they sometimes do, given differences in how job postings reach different networks), fatigue effects can produce discriminatory patterns that aren't the reviewer's intent. Consistent automated evaluation doesn't fatigue.

Where AI screening can replicate bias

The legitimate concern is training data and rubric design. If an AI model is trained on historical hiring data from a company that hired 80% of one demographic group, the model learns that candidates resembling past hires are preferred. That's not reducing bias; it's automating it.

Rubric design is the second risk surface. A rubric that requires "degree from a top-30 university" as a criterion isn't neutral. It proxies socioeconomic background and geographic access. The bias isn't in the AI; it's in the criterion specification.

Proxy variables are a subtler concern. A requirement like "prior experience at a company with over 500 employees" may seem role-relevant for certain leadership positions, but it correlates with geographic advantage and demographic access to large-company networks. Any criterion that maps onto socioeconomic background or network access rather than directly onto capability carries bias risk, regardless of whether a human or a machine applies it.

What the research says about explainability

Several research teams studying algorithmic decision-making in hiring have converged on a consistent finding: explainability doesn't just improve human oversight, it changes how humans interact with the system's outputs. When reviewers can see the reasoning behind a ranking, they challenge incorrect rankings at higher rates and accept correct rankings with more confidence. The explanation layer effectively converts the system from an oracle to a collaborator.

This matters for bias in a specific way. When a reviewer disagrees with a ranking and can see that the disagreement is about a criterion specification rather than an evaluation error, they can correct the specification. The feedback loop between human judgment and system output is richer when the output is legible. That's not just good product design; it's the mechanism by which systematic errors, including biased criterion specifications, get identified and fixed.

What design choices matter

The answer is to build systems where rubric criteria are explicit and auditable, where the training data (if any) is screened for demographic skew, and where recruiters can inspect the reasoning behind any score. Opacity is what allows bias to hide. Explainability is the primary structural defense: when every score links to specific evidence, a recruiter can check whether a ranking reflects the criteria they specified or something else.

This is why explanation-first design isn't just a product feature. It's a bias mitigation requirement. If you can't explain why a candidate was ranked where they were, you can't audit the system for discriminatory patterns. And if you can't audit it, you can't trust it.

For teams building or selecting AI screening tools, the practical questions are: Can I see the evidence that drove each score? Can I modify the rubric and see how rankings change? Can I review how a specific type of candidate tends to score against a specific type of requirement? A system that answers yes to those three questions gives a TA team genuine control over what the screening is actually measuring.

The ongoing audit responsibility

Deploying an AI screening tool is not a one-time bias check. Organizations that take fairness seriously run ongoing audits: periodic comparisons of shortlist demographics against applicant pool demographics, systematic review of which criteria account for the most rejections, and structured tests of whether rubric changes affect demographic outcomes in unintended ways. These aren't exotic practices -- they're what makes the difference between a tool that was bias-checked before launch and a tool that is actively maintained against bias over time.

The regulatory landscape is also moving. Several US states and cities have passed or are considering laws requiring algorithmic impact assessments for automated hiring tools. New York City's Local Law 144, which took effect in 2023, requires employers using automated employment decision tools to conduct annual bias audits and publish summaries. Other jurisdictions are following. A TA team that has built ongoing audit practices as part of their AI screening workflow is in a much better position as these requirements expand than one that has to construct an audit practice from scratch in response to a compliance deadline.