Skip to main content
POST
/
v2
/
evaluators
/
execute
/
agent-tool-trajectory
Execute agent-tool-trajectory evaluator
curl --request POST \
  --url https://api.traceloop.com/v2/evaluators/execute/agent-tool-trajectory \
  --header 'Authorization: <api-key>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "input": {
    "executed_tool_calls": "[{\"name\": \"search\", \"input\": {\"query\": \"weather\"}}]",
    "expected_tool_calls": "[{\"name\": \"search\", \"input\": {\"query\": \"weather\"}}]"
  },
  "config": {
    "input_params_sensitive": true,
    "mismatch_sensitive": false,
    "order_sensitive": false,
    "threshold": 0.5
  }
}
'
{
  "reason": "Tool calls match the expected trajectory",
  "result": "pass",
  "score": 0.85
}

Authorizations

​
Authorization
string
header
required

Type "Bearer" followed by a space and JWT token.

Body

application/json

Request body

​
input
object
required
​
config
object

Response

OK

​
reason
string
Example:

"Tool calls match the expected trajectory"

​
result
string
Example:

"pass"

​
score
number
Example:

0.85