Observability for Cohere with Honeycomb

OpenLLMetry lets you trace prompts and embedding calls of Cohere. With 5 minutes of work you can get complete view of your system directly into Honeycomb. See how below.

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to Cohere, with prompts and completions as separate spans.

import boto3
import json

from traceloop.sdk import Traceloop
from traceloop.sdk.decorators import task, workflow

Traceloop.init(app_name="joke_generation_service")
co = cohere.Client(os.environ.get("COHERE_API_KEY"))

Step 2

Route the traces to Honeycomb’s endpoint and set the API key

TRACELOOP_BASE_URL=https://api.honeycomb.io
TRACELOOP_HEADERS="x-honeycomb-team=<YOUR_API_KEY>"

Docs

Discover use cases

Trace prompts and completions in Cohere

Call Cohere and see prompts, completions, and token usage for your call.

See Code Example

Observability for Cohere with Honeycomb

Step 1

Step 2

Discover use cases

Trace prompts and completions in Cohere

More things you can connect to {platform}

Chroma

OpenAI

Bedrock

Watsonx

Anthropic

LangChain

LlamaIndex