Observability for Bedrock with Grafana Tempo

OpenLLMetry lets you trace prompts and completions to any of AWS Bedrock's models. With 5 minutes of work you can get complete view of your system directly into Traceloop. See how below.

Step 1

Install the Traceloop SDK and initialize it. It will automatically log all calls to Bedrock using boto3 - both prompts and completions.

Step 2

Make sure you have a Grafana Agent installed and running in your system. Go to the Grafana Cloud account page under https://grafana.com/orgs/<your org name>, and click on Send Traces under Tempo. In Grafana Data Source settings, note the URL value. Click Generate now to generate an API key and copy it. Note also the Stack ID value (you can find it in the URL https://grafana.com/orgs/<Your Org Name>/stacks/<Stack ID>). Add this to the configuration of your Grafana Agent.

Discover use cases

Trace prompts and completions in Bedrock

Call Bedrock and see prompts, completions and token usage for your call. All Bedrock models supported.