Back to AI updates
GoogleNew features

The Outer Loop, Insights First: An Ambient Quality Agent That Diagnoses Your Production Agent

This is relevant if your organisation has developers running AI agents in production on Google Cloud. It is a free, open-source tool that automatically samples live agent sessions, flags recurring failures, and suggests fixes, which can save a developer's time compared with manually reviewing transcripts.

Read the original source 1 min read

What changed

Google's Developers Blog introduced AQuA (Ambient Quality Agent), an open-source reference implementation for monitoring and diagnosing AI agents after they're deployed. Running in a developer's own Google Cloud project alongside their agent, outside the request path, it samples up to 1,000 recent production sessions from Cloud Trace, Cloud Logging, or BigQuery; grades each session against a nine-point failure checklist; clusters related failures and verifies them against full transcripts using a separate model; tracks issues as new, recurring, or resolved across runs; and can run on-demand root-cause analysis that cites specific lines in the deployed source and proposes fixes, though it never applies edits or opens pull requests itself. The code is open source (google/adk-recipes); a local demo needs no cloud project or credentials, but attaching it to a live agent requires a Google Cloud project and the agents-cli tooling, with the dashboard behind Identity-Aware Proxy. It is currently scaffolded one-to-one per agent; fleet-wide use is still being explored. Costs are usage-based under standard Gemini platform pricing.

Why it matters to your work

This is relevant if your organisation has developers running AI agents in production on Google Cloud. It is a free, open-source tool that automatically samples live agent sessions, flags recurring failures, and suggests fixes, which can save a developer's time compared with manually reviewing transcripts.

Source & availability

This is a summary of a published provider announcement, with practical context from SCALA’s feed.

Plan, region, workspace and rollout conditions may affect access in Australia. Check the original source for current availability.

developers.googleblog.com

This update is primarily for technical teams.