Loading…
March 18-20, 2025
Napa, California
View More Details & Registration

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for the event to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to find out more information.

This schedule is automatically displayed in Pacific Daylight Time (UTC/GMT -8). To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Thursday March 20, 2025 2:45pm - 3:15pm PDT
If 2023 is the year of LLMs, then 2024 will be the year for LLM Applications. As LLMs continue to integrate into various applications ranging from chatbots and search engines to creative writing aids, the need to monitor and comprehend their behaviors intensifies.

Observability plays a crucial role in this context. It involves the systematic collection and analysis of data to enhance LLM performance, identify and correct biases, troubleshoot issues, and ensure AI systems are both reliable and trustworthy.

In this discussion, we will explore the concept of LLM observability in depth, focusing on how OpenTelemetry can fit into the world of LLM observability . Additionally, we will talk about challenges around modeling of prompts, completions, events, semantic conventions, and basically our path with the llm-sem-conv working group.
Speakers
avatar for Guangya Liu

Guangya Liu

Senior Technical Staff Member, IBM
Guangya Liu is a Senior Technical Staff Member (STSM) for IBM Instana. He is the technical leader driving the IBM Instana development and customer support. He is also the open source leader for IBM Instana team, driving the cloud-native open source contribution to integrate with... Read More →
avatar for Nir Gazit

Nir Gazit

CEO, Traceloop
CEO @ traceloop; ex-chief architect @ Fiverr, ex-tech lead @ Google; OpenTelemetry contributor
Thursday March 20, 2025 2:45pm - 3:15pm PDT
Silverado East

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Share Modal

Share this link via

Or copy link