NatWest Cora Chatbot Gave Incorrect Guidance to Vulnerable Customers
NatWest
What happened
NatWest's Cora AI chatbot was found to be giving incorrect or misleading guidance to customers, including those flagged as financially vulnerable. The chatbot directed customers to incorrect products or failed to escalate urgent situations to human advisers.
Root cause
AI system not calibrated to detect vulnerability indicators or high-stakes financial queries requiring human escalation; insufficient boundary between general information and regulated financial advice.
Architectural failure
No confidence-based routing to human advisers for vulnerable customer indicators; no output filtering to detect regulated advice boundaries; FCA Consumer Duty requirements not embedded in escalation logic.
Outcome
FCA Consumer Duty regulations placed new obligations on firms. NatWest updated Cora with additional guardrails. Contributed to FCA guidance on AI in financial services.
Architectural Failure Patterns
These pattern categories on aipatterns.com.au describe the systemic failure modes this incident exhibited.
human in the loop
human escalation pattern
aipatterns.com.au
human in the loop
ai confidence threshold routing
aipatterns.com.au
security
ai output filtering
aipatterns.com.au
governance
ai regulatory compliance gateway
aipatterns.com.au
observability
hallucination detection
aipatterns.com.au
governance
ai audit trail
aipatterns.com.au
Cite this incident
https://corporateai.com.au/incidents/natwest-cora-financial-advice-2023Quick facts
- Date
- 1 June 2023
- Organisation
- NatWest
- Sector
- Banking
- Severity
- High
- Regulatory bodies
- FCA Consumer DutyFinancial Services and Markets Act 2000FCA PS22/9
- Tags
- chatbotfinancial-advicevulnerable-customersregulated-adviceconsumer-dutybanking
Related in Banking
APRA Issues Supervisory Letters to 4 Regulated Entities for AI Governance Failures
Multiple APRA-regulated entities · 1 April 2026
Westpac AML Monitoring Missed 23M+ Transactions — $1.3B Penalty
Westpac Banking Corporation · 20 November 2020
Apple Card Algorithm Allegedly Gave Women Lower Credit Limits Than Husbands
Apple / Goldman Sachs · 10 November 2019
Explore failure patterns
aipatterns.com.au