AI Hiring Bias Amazon Resume: Automated Recruiting Tool Discriminated Against Women

Amazon developed an AI recruiting tool that systematically discriminated against women, penalizing resumes containing words like "women's" as in "women's chess club captain" and downgrading graduates of all-women's colleges. The tool was trained on a decade of resume data reflecting the male-dominated tech industry, and it learned to replicate and amplify existing gender biases. Amazon reportedly used the tool from 2014 to 2017 before internal discovery of the bias led to its discontinuation. The case became the seminal example of how AI systems trained on biased historical data produce discriminatory outcomes. Despite Amazon stating the tool was never used as the sole decision-maker, the bias was embedded in the scoring system that influenced which candidates advanced. The incident prompted widespread examination of AI hiring tools across the industry and contributed to New York City passing Local Law 144 requiring bias audits of automated employment decision tools.

The ramifications of this incident extend beyond the immediate data exposure. Privacy regulators in multiple jurisdictions have opened investigations, and affected individuals are organizing collective action to demand accountability and meaningful remediation. The case highlights systemic weaknesses in how organizations handle personal data and the gap between corporate privacy promises and operational reality.

For impacted individuals, immediate action is critical. Filing a data subject access request forces the company to disclose exactly what data they hold about you, providing the foundation for deletion requests, regulatory complaints, and potential legal action. Below, we outline the specific data types at risk and the concrete steps you can take to protect yourself.