Meteorite logoMeteorite
Back to videos

Technical Workshop: Observability Without Overs... Joaquin Rodriguez & Amin Espinoza de los Monteros

Don't miss out! Join us at the next Open Source Summit in Seoul, South Korea (November 4-5). Join us at the premier vendor-neutral open source conference, where developers and technologists come together to collaborate, share knowledge, and explore the latest innovations and advancements in open source technology. Learn more at https://events.linuxfoundation.org/ Technical Workshop: Observability Without Oversharing: Privacy-Conscious Telemetry for LLMs - Joaquin Rodriguez & Amin Espinoza de los Monteros, Microsoft In this 1-hour workshop, participants will have the opportunity to learn how to achieve robust observability for Large Language Models (LLMs) while safeguarding sensitive data. As LLMs become integral to production systems, monitoring their performance, usage, and costs is essential, and so is protecting user privacy! This session addresses these challenges using open-source tools such as OpenTelemetry + OpenLIT, and Prometheus + Grafana. Through guided, hands-on exercises, participants will come away with practical skills in ethical AI monitoring. This workshop is designed for developers, data scientists, and AI practitioners who want to leverage open-source solutions to tackle privacy challenges in LLM deployments. Join us to gain hands-on experience and contribute to the future of responsible AI observability!

Suggested videos