Tracing
Without OpenLLMetry SDK
Tracing
Without OpenLLMetry SDK
All the instrumentations are provided as standard OpenTelemetry instrumentations so you can use them directly if you’re already using OpenTelemetry.
Installation
Install the appropriate packages for the modules you want to use.
LLM Foundation Models
| Provider | PyPi Package Name |
|---|---|
| OpenAI | opentelemetry-instrumentation-openai |
| Anthropic | opentelemetry-instrumentation-anthropic |
| Bedrock | opentelemetry-instrumentation-bedrock |
| Cohere | opentelemetry-instrumentation-cohere |
Vector DBs
| Vector DB | PyPi Package Name |
|---|---|
| Chroma | opentelemetry-instrumentation-chromadb |
| Pinecone | opentelemetry-instrumentation-pinecone |
LLM Frameworks
| Framework | PyPi Package Name |
|---|---|
| Haystack | opentelemetry-instrumentation-haystack |
| Langchain | opentelemetry-instrumentation-langchain |
| LlamaIndex | opentelemetry-instrumentation-llamaindex |
Usage
Instantiate the instrumentations you want to use and call instrument() to register them with OpenTelemetry.
For example, to use the OpenAI instrumentation:
Python
from opentelemetry.instrumentation.openai import OpenAIInstrumentor
OpenAIInstrumentor().instrument()
If you’re setting OpenTelemetry’s TracerProvider manually, make sure to do
this before calling instrument().
Was this page helpful?