Meteorite logoMeteorite
Back to videos

Video unavailable

This video can't be played right now.

Building a custom evaluation for your agent

Build your custom evaluation with ADK → https://g.dev/cloud/cpm-vid-adk Codelab → https://g.dev/ai/self-evolving Learn how to build, test, and automate custom evaluations for your AI agents using Google's Agent Development Kit (ADK). In this step-by-step tutorial, Annie Wang teaches how to define what "success" means for complex agents, compare using requirement-based checkers, and integrate agent tests directly into CI/CD deployment pipelines using pytest. Chapters: 00:00 - Intro & the 4 pillars of agent evaluation 00:28 - What counts as success? 01:56 - Evaluation approaches: Comparators 03:45 - How to check: Deterministic code vs. LLM as a judge 05:50 - Building a custom metric in Python 08:00 - Configuring ADK eval & validating the evaluator 11:00 - Automating agent testing in CI/CD with Pytest Speaker: Annie Wang Products Mentioned: Agent Development Kit

Suggested videos