Observability for Chroma with Dynatrace

OpenLLMetry lets you trace queries and indexing of documents in Chroma. With 5 minutes of work you can get complete view of your system directly into Dynatrace. See how below.

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to Chroma using its SDK - both query calls and index calls.

Step 2

Go to your Dynatrace environment and create a new access token under Manage Access Tokens. The access token needs the following permission scopes that allow the ingest of OpenTelemetry spans, metrics and logs (openTelemetryTrace.ingest, metrics.ingest, logs.ingest). Set the following environment variables.

Discover use cases

Trace Indexing pipelines with Chroma

Build an indexing pipeline and save documents to Chroma. See how your documents are indexed and detect errors.

Trace your RAG retrieval pipeline

Build a RAG pipeline with Chroma and OpenAI. See vectors returned from Chroma, full prompt in OpenAI and responses