OpenLLMetry is an open source project that allows you to easily start monitoring and debugging the execution of your LLM app. Tracing is done in a non-intrusive way, built on top of OpenTelemetry. You can choose to export the traces to Traceloop, or to your existing observability stack.

You can use OpenLLMetry whether you use a framework like LangChain, or directly interact with a foundation model API.

Getting Started

Select from the following guides to learn more about how to use OpenLLMetry:

Was this page helpful?