Tracing
Without OpenLLMetry SDK
All the instrumentations are provided as standard OpenTelemetry instrumentations so you can use them directly if you’re already using OpenTelemetry.
Installation
Install the appropriate packages for the modules you want to use.
LLM Foundation Models
Provider | PyPi Package Name |
---|---|
OpenAI | opentelemetry-instrumentation-openai |
Anthropic | opentelemetry-instrumentation-anthropic |
Bedrock | opentelemetry-instrumentation-bedrock |
Cohere | opentelemetry-instrumentation-cohere |
Vector DBs
Vector DB | PyPi Package Name |
---|---|
Chroma | opentelemetry-instrumentation-chromadb |
Pinecone | opentelemetry-instrumentation-pinecone |
LLM Frameworks
Framework | PyPi Package Name |
---|---|
Haystack | opentelemetry-instrumentation-haystack |
Langchain | opentelemetry-instrumentation-langchain |
LlamaIndex | opentelemetry-instrumentation-llamaindex |
Usage
Instantiate the instrumentations you want to use and call instrument()
to register them with OpenTelemetry.
For example, to use the OpenAI instrumentation:
Python
from opentelemetry.instrumentation.openai import OpenAIInstrumentor
OpenAIInstrumentor().instrument()
If you’re setting OpenTelemetry’s TracerProvider
manually, make sure to do
this before calling instrument()
.
Was this page helpful?