Australian EnterpriseAI Index
AU AI Incident Database

Australian AI Incident Database

Structured, searchable database of AU AI failures, algorithmic errors, and regulatory actions. Each incident cross-links to the architectural failure patterns on aipatterns.com.au.

29

Total incidents

16

Critical

5

Sectors affected

Multi-billion

Financial impact

2Critical
0High
0Medium
0Low

Showing 2 of 2 incidents

Criticalhealthcare1 July 2021

Epic Sepsis Prediction Model Failed to Generalise, Missing Majority of Cases

Epic Systems / University of Michigan

Details

A University of Michigan study found that Epic's commercially deployed Sepsis Prediction Model performed significantly worse than claimed when deployed in their health system. The model flagged only 7% of sepsis patients before clinical deterioration and generated so many false positives that clinicians began ignoring alerts.

FDA AI/ML-Based Software as a Medical Device (SaMD)21st Century Cures ActHIPAAmodel drift detection ai performance benchmarking
Criticalhealthcare25 July 2017

IBM Watson for Oncology Recommended Unsafe Cancer Treatments

IBM Watson Health

Details

Internal IBM documents leaked to STAT News revealed that IBM Watson for Oncology had recommended treatments that oncologists described as 'unsafe and incorrect'. The system generated advice based on hypothetical training cases rather than real patient data.

FDA SaMD Guidance21 CFR Part 820 (QSR)HIPAAai training data governance ai performance benchmarking
Admin-curated database. Incidents are sourced from OAIC, ASIC, APRA, AUSTRAC, TGA, Federal Court records, and verified reporting. Contact us with sources for consideration.Pattern cross-links reference architectural failure categories on aipatterns.com.au. Not legal advice.