Observability for Chroma with Dynatrace
OpenLLMetry lets you trace queries and indexing of documents in Chroma. With 5 minutes of work you can get complete view of your system directly into Dynatrace. See how below.
Step 1
Install the Traceloop SDK and initialize it. It will automatically log all calls to Chroma using its SDK - both query calls and index calls.
Step 2
Go to your Dynatrace environment and create a new access token under Manage Access Tokens.
The access token needs the following permission scopes that allow the ingest of OpenTelemetry spans, metrics and logs (openTelemetryTrace.ingest, metrics.ingest, logs.ingest).
Set the following environment variables.
Discover use cases
Trace Indexing pipelines with Chroma
Build an indexing pipeline and save documents to Chroma. See how your documents are indexed and detect errors.
Trace your RAG retrieval pipeline
Build a RAG pipeline with Chroma and OpenAI. See vectors returned from Chroma, full prompt in OpenAI and responses
