Observability for Chroma with Grafana Tempo

OpenLLMetry lets you trace queries and indexing of documents in Chroma. With 5 minutes of work you can get complete view of your system directly into Grafana Tempo. See how below.

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to Chroma using its SDK - both query calls and index calls.

Step 2

Make sure you have a Grafana Agent installed and running in your system. Go to the Grafana Cloud account page under https://grafana.com/orgs/<your org name>, and click on Send Traces under Tempo. In Grafana Data Source settings, note the URL value. Click Generate now to generate an API key and copy it. Note also the Stack ID value (you can find it in the URL https://grafana.com/orgs/<Your Org Name>/stacks/<Stack ID>). Add this to the configuration of your Grafana Agent.

Discover use cases

Trace Indexing pipelines with Chroma

Build an indexing pipeline and save documents to Chroma. See how your documents are indexed and detect errors.

Trace your RAG retrieval pipeline

Build a RAG pipeline with Chroma and OpenAI. See vectors returned from Chroma, full prompt in OpenAI and responses