Eval API quickstart

End-to-end path for customers using the Evaluation API product.

Outcome

You deploy an evaluation playbook, authenticate with a deployment secret, run POST /v1/evaluate, and see results in the dashboard Recent evaluations table.

Prerequisites

• EchoStack account (sign in)
• A playbook deployed and set to live
• A webhook secret (ech_dw_…) from the deployment page

1. Sign up

1. Open getechostack.com and try the live demo (optional).
2. Sign in via magic link at /login.
3. On first dashboard load, your user and organization are created automatically.

2. Deploy an evaluation playbook

1. Go to Dashboard → Playbooks (default tab: Evaluation API).
2. Open a playbook (e.g. BANT Evaluation API).
3. Click Deploy Evaluation API → review → Deploy.
4. Preflight creates a deployment; eval playbooks auto-activate to live.

3. API credentials

1. On the deployment page, generate a webhook secret (ech_dw_…).
2. Use Authorization: Bearer ech_dw_<secret> on all evaluate calls.

Evaluate uses deployment secrets (ech_dw_), not org-level esk_* keys.

4. Call the API

POST https://api.getechostack.com/v1/evaluate
Authorization: Bearer ech_dw_<your-secret>
Content-Type: application/json

{
  "input_type": "transcript",
  "input": [{ "role": "user", "content": "We have a team of 10 and need to go live next month." }],
  "options": { "request_next_action": true }
}

The manifest is resolved from your deployment — do not send manifest_id in the body.

Branch on the response

There is no numeric score in the public evaluate response.

5. Verify in the dashboard

• Test evaluation panel: run a sample transcript without external tools.
• Recent evaluations: table of evaluation log rows for this deployment.

6. Next integrations

Troubleshooting

API reference

Request and response schemas: API reference.