Introducing OpenLLMetry — Extending OpenTelemetry to LLMs
OpenLLMetry has been released as an open-source extension to OpenTelemetry, providing observability tools for LLM and AI applications without vendor lock-in, similar to how OpenTelemetry revolutionized cloud observability. The tool offers instrumentations for various LLM platforms (like OpenAI and Anthropic), vector databases, and frameworks, allowing developers to track LLM responses, prompts, and performance metrics while maintaining the flexibility to use any observability platform they choose.