Build Smarter Agents,
Monitor LLMs Effectively

What Was This Meetup All About?

On Saturday, May 31, 2025, Covasant Technologies, in collaboration with Google for Developers, hosted a meeting and hands-on workshop titled, "Build Smarter Agents, Monitor LLMs Effectively."

This event, part of the #BuildingWithAI Meetup series, brought together AI professionals, developers, and enthusiasts to explore the latest in large language model (LLM) observability and agentic AI development. Attendees checked in and connected with other participants. The event started with all the attendees introducing themselves, as they shared their areas of interest.

ReddyRaja Annareddy, Chief Technology Officer at Covasant, delivered an insightful talk on monitoring large language models to ensure their reliability and fairness. He emphasized the importance of observability in AI systems, discussing how it enables reliable production systems, builds user trust through fairness, speeds up iteration via drift monitoring, and aids in product decisions through remediation strategies.

The session was followed by an interactive session focused on practical tools and techniques from Google to build GenAI solutions. Attendees engaged in building a travel agent using MCP Toolbox for databases and ADK, facilitated by Ashutosh Bhakare, Google Authorized Trainer and a Google Developer Expert.