
Video unavailable
This video can't be played right now.
Building a custom evaluation for your agent
Build your custom evaluation with ADK → https://g.dev/cloud/cpm-vid-adk Codelab → https://g.dev/ai/self-evolving Learn how to build, test, and automate custom evaluations for your AI agents using Google's Agent Development Kit (ADK). In this step-by-step tutorial, Annie Wang teaches how to define what "success" means for complex agents, compare using requirement-based checkers, and integrate agent tests directly into CI/CD deployment pipelines using pytest. Chapters: 00:00 - Intro & the 4 pillars of agent evaluation 00:28 - What counts as success? 01:56 - Evaluation approaches: Comparators 03:45 - How to check: Deterministic code vs. LLM as a judge 05:50 - Building a custom metric in Python 08:00 - Configuring ADK eval & validating the evaluator 11:00 - Automating agent testing in CI/CD with Pytest Speaker: Annie Wang Products Mentioned: Agent Development Kit
Suggested videos

The Future of AI Infrastructure
Google Cloud Tech · 39:51

LLM as a Judge: Scaling AI Evaluation Strategies
IBM Technology · 6:09

Google Cloud Platform Full Course | GCP Tutorial | Google Cloud Training | Edureka
edureka! · 7:39:43

Build an AI Agent Evaluation System with DeepEval & LangChain (Full Project, step-by-step)
AI Career Lab · 2:53:29

Which model should I use? | The Agent Factory
Google Cloud Tech · 23:10

How to Build AI Evals in 2026 (Step-by-Step, No Hype)
Aakash Gupta · 1:07:01

Google Cloud Tech
Google Cloud Tech · 1:35

When to Build Your Own Agent Harness | Harrison Chase, LangChain
Sequoia Capital · 23:57

What is Google Cloud?
Google Cloud Tech · 5:30

How to use Agent Evaluation in Microsoft Copilot Studio
Microsoft Power Platform · 4:30

A Developer’s Guide to Gemini 3.5 Transcribe
Google Cloud Tech · 5:08

How to Systematically Setup LLM Evals (Metrics, Unit Tests, LLM-as-a-Judge)
Dave Ebbelaar · 55:02