Apple Card Algorithm Allegedly Gave Women Lower Credit Limits Than Husbands
Apple / Goldman Sachs
What happened
Tech entrepreneur David Heinemeier Hansson publicly revealed that Apple Card had given him a credit limit 20 times higher than his wife despite them filing joint tax returns and his wife having a higher credit score. Multiple women reported similar disparities.
Root cause
The Goldman Sachs credit model used proxy variables that correlated with gender even without directly using gender as an input feature; no fairness testing across demographic groups was conducted post-deployment.
Architectural failure
No demographic parity monitoring or bias detection applied to credit decisions; model evaluated on historical credit data reflecting gender-based financial disparities; no explainability mechanism.
Outcome
New York Department of Financial Services opened an investigation. Led to broader regulatory interest in fair lending algorithms.
Architectural Failure Patterns
These pattern categories on aipatterns.com.au describe the systemic failure modes this incident exhibited.
governance
model bias detection
aipatterns.com.au
governance
responsible ai framework
aipatterns.com.au
governance
ai risk assessment framework
aipatterns.com.au
data
ai training data governance
aipatterns.com.au
compliance
apra cps234 ai security
aipatterns.com.au
human in the loop
human override pattern
aipatterns.com.au
Cite this incident
https://corporateai.com.au/incidents/apple-card-gender-discrimination-2019Quick facts
- Date
- 10 November 2019
- Organisation
- Apple / Goldman Sachs
- Sector
- Banking
- Severity
- High
- Regulatory bodies
- Equal Credit Opportunity Act (ECOA)Fair Housing ActNY Banking LawCFPB Regulations
- Tags
- algorithmic-biasgender-discriminationcredit-scoringfintechfair-lendingproxy-discrimination
Related in Banking
APRA Issues Supervisory Letters to 4 Regulated Entities for AI Governance Failures
Multiple APRA-regulated entities · 1 April 2026
NatWest Cora Chatbot Gave Incorrect Guidance to Vulnerable Customers
NatWest · 1 June 2023
Westpac AML Monitoring Missed 23M+ Transactions — $1.3B Penalty
Westpac Banking Corporation · 20 November 2020
Explore failure patterns
aipatterns.com.au