Monitor outbound call quality in near real time with criterion-level scoring
For a team making lots of outbound calls, this agent checks each call against your quality standards shortly after it ends and flags the unclear ones for a person. Managers coach on the same day instead of days later.
Paste this into ChatGPT, Claude or your agent tool. See the prompt
- Call Coaching
- advanced
- SDR manager
- Sales leader
- Category
- Call Coaching
- Difficulty
- Advanced
- Est. cost
- Not stated here; the source discusses build cost
Problem
An outbound floor's QA team sampled a small share of calls against a checklist, so issues were caught days late and coaching was reactive.
Setup
The agent connects to the client's telephony system, transcribes calls in near real time with diarization, and has an LLM score each call against each quality criterion independently, with evidence and a confidence level. Low-confidence evaluations go to human review. It produces per-agent dashboards, trends and coaching summaries with the top improvement areas.
Prompt
Starter prompt by The GTM Agent Weekly, written from the setup described on this page. It is not the source's own prompt; see the source link below for their write-up.
# ROLE
You are a call quality analyst for an outbound calling team. You score each call against
each quality criterion separately, with evidence and a confidence level, and send unclear
cases to a human reviewer.
# INPUTS
- {{TRANSCRIPT}}: near real-time transcript with speaker labels and timestamps.
- {{CRITERIA}}: the quality checklist, one criterion per line with pass and fail examples
(e.g. disclosure read, correct opening, objection handled, next step set).
- {{AGENT}}: the caller's name and team.
# TASK
1. Evaluate each criterion on its own. Do not let one criterion influence another.
2. For each: result (met, not met, not applicable), the quote and timestamp, and confidence
(high, medium, low).
3. Any criterion with low confidence goes to the human review queue with your reasoning.
4. Write a two-line coaching note naming the single biggest improvement area.
# OUTPUT FORMAT (JSON)
{"agent": "", "call_id": "", "criteria": [{"name": "", "result": "", "quote": "", "timestamp": "",
"confidence": "high|medium|low"}], "needs_review": true, "coaching_note": ""}
# GUARDRAILS
- Never mark a compliance criterion as met without a quote.
- If the transcript is incomplete or garbled, mark confidence low rather than guess.
- Weekly, roll results up per agent: trends and top improvement areas, not single-call blame. Replace every {{PLACEHOLDER}} before running. Works with any capable LLM and runner.
Tools
Steps
- Write each quality criterion with a definition, pass and fail examples and a severity.
- Capture call audio from the telephony system and transcribe with speaker separation.
- Score each criterion independently with evidence and confidence.
- Route evaluations below a confidence threshold to human reviewers.
- Generate per-agent coaching summaries with specific call examples.
Results
The agency reports the client scaled its floor without adding QA headcount and that human-review flags fell as prompts were tuned. Self-reported by the builder.
What goes wrong
Gotchas
- Sarcasm and background noise caused misjudged criteria; confidence thresholds caught these for human review.
- A noticeable share of evaluations needed human review in the first month before tuning reduced it.
- Transcription runs a few seconds behind live audio, which limits truly real-time intervention. (editor note)
Get 5 like this every week, free.
Real agent setups with sources and failure modes, in one short weekly email.
Free. One email a week. Unsubscribe anytime.
Source and credit
Abhijit Das, Madgeek · vendor
Source dated 2026-06-08 · last reviewed 2026-10-11. Summarized in our own words; see the source for details.