AI Observability
Monitoring, tracing, evaluation, and debugging of LLM applications and AI pipelines in production
6
Total vendors
2
AU presence
1
Market leaders
0
AU-native
Competitive Position Map
Market Landscape
Rotate or view on a larger screen for the full interactive chart
LLM traces, cost tracking, and evaluation integrated into Datadog's existing APM. Already deployed in most large AU tech teams.
LLM performance monitoring, token cost tracking, and response quality evaluation within New Relic platform.
Experiment tracking, model monitoring, and LLM evals. Popular in AU ML research teams and AI-native startups.
Open-source LLM observability. Prompt tracing, cost analytics, and eval framework. Fast-growing in AU developer community.
ML and LLM observability platform. Embedding drift, hallucination detection, and performance monitoring.
Lightweight LLM proxy with observability. One line of code integration — popular for AU startups and proofs-of-concept.
Tier classifications based on public market data, AU customer announcements, and AEAI signal analysis. Not investment advice. Updated quarterly. Suggest an addition →