Observability for OpenAI with Honeycomb

OpenLLMetry lets you trace prompts and embedding calls of OpenAI. With 5 minutes of work you can get complete view of your system directly into Honeycomb. See how below.

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to OpenAI, with prompts and completions as separate spans.

Step 2

Route the traces to Honeycomb’s endpoint and set the API key

Discover use cases

Trace prompts and completions

Call OpenAI and see prompts, completions, and token usage for your call.

Trace your RAG retrieval pipeline

Build a RAG pipeline with Chroma and OpenAI. See vectors returned from Chroma, full prompt in OpenAI and responses