Skip to main content
You can also check out our full working example of a RAG pipeline with Pinecone here.
1

Install the SDK

Want our AI to do it for you? Click here
Run the following command in your terminal:
pip install traceloop-sdk
In your LLM app, initialize the Traceloop tracer like this:
from traceloop.sdk import Traceloop

Traceloop.init()
If you’re running this locally, you may want to disable batch sending, so you can see the traces immediately:
Traceloop.init(disable_batch=True)
2

Annotate your workflows

If you have complex workflows or chains, you can annotate them to get a better understanding of what’s going on. You’ll see the complete trace of your workflow on Traceloop or any other dashboard you’re using.We have a set of decorators to make this easier. Assume you have a function that renders a prompt and calls an LLM, simply add @workflow.
The @aworkflow decorator is deprecated and will be removed in a future version. Use @workflow for both synchronous and asynchronous operations.
If you’re using a supported LLM framework - we’ll do that for you. No need to add any annotations to your code.
from traceloop.sdk.decorators import workflow

@workflow(name="suggest_answers")
def suggest_answers(question: str):
  ...

# Works seamlessly with async functions too
@workflow(name="summarize")
async def summarize(long_text: str):
  ...
For more information, see the dedicated section in the docs.
3

Configure trace exporting

Lastly, you’ll need to configure where to export your traces. The 2 environment variables controlling this are TRACELOOP_API_KEY and TRACELOOP_BASE_URL.For Traceloop, read on. For other options, see Exporting.

​
Using Traceloop Cloud

You need an API key to send traces to Traceloop. Generate one in Settings by selecting a project and environment, then click Generate API key.⚠️ Important: Copy the key immediately - it won’t be shown again after you close or reload the page.Detailed instructions →
Set the API key as an environment variable in your app named TRACELOOP_API_KEY:
export TRACELOOP_API_KEY=your_api_key_here
Done! You’ll get instant visibility into everything that’s happening with your LLM. If you’re calling a vector DB, or any other external service or database, you’ll also see it in the Traceloop dashboard.
Not seeing traces? Make sure you’re viewing the correct project and environment in the dashboard that matches your API key. See Troubleshooting.