3 items tagged with "llm-observability"
LLM observability is the practice of tracing, logging, and measuring LLM applications in production to monitor quality, cost, latency, and safety and to debug failures.
Instrument an LLM application to trace prompts, responses, tokens, latency, and cost so you can debug and optimize in production.
A reference design for an LLM observability platform on Kubernetes that captures traces, evaluations, cost, and quality signals across AI applications.