Observability for Bedrock with New Relic

OpenLLMetry lets you trace prompts and completions to any of AWS Bedrock's models. With 5 minutes of work you can get complete view of your system directly into Traceloop. See how below.

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to Bedrock using boto3 - both prompts and completions.

Step 2

Get an access key from New Relic dashboard and set the following environment variables.

Discover use cases

Trace your RAG retrieval pipeline

Build a RAG pipeline with Chroma and OpenAI. See vectors returned from Chroma, full prompt in OpenAI and responses