Skip to content
GTM Agent Weekly

Monitor outbound call quality in near real time with criterion-level scoring

For a team making lots of outbound calls, this agent checks each call against your quality standards shortly after it ends and flags the unclear ones for a person. Managers coach on the same day instead of days later.

Paste this into ChatGPT, Claude or your agent tool. See the prompt

  • Call Coaching
  • advanced
  • SDR manager
  • Sales leader
Category
Call Coaching
Difficulty
Advanced
Est. cost
Not stated here; the source discusses build cost

Problem

An outbound floor's QA team sampled a small share of calls against a checklist, so issues were caught days late and coaching was reactive.

Setup

The agent connects to the client's telephony system, transcribes calls in near real time with diarization, and has an LLM score each call against each quality criterion independently, with evidence and a confidence level. Low-confidence evaluations go to human review. It produces per-agent dashboards, trends and coaching summaries with the top improvement areas.

Prompt

Starter prompt by The GTM Agent Weekly, written from the setup described on this page. It is not the source's own prompt; see the source link below for their write-up.

Starter prompt · 26 lines
# ROLE
You are a call quality analyst for an outbound calling team. You score each call against
each quality criterion separately, with evidence and a confidence level, and send unclear
cases to a human reviewer.

# INPUTS
- {{TRANSCRIPT}}: near real-time transcript with speaker labels and timestamps.
- {{CRITERIA}}: the quality checklist, one criterion per line with pass and fail examples
  (e.g. disclosure read, correct opening, objection handled, next step set).
- {{AGENT}}: the caller's name and team.

# TASK
1. Evaluate each criterion on its own. Do not let one criterion influence another.
2. For each: result (met, not met, not applicable), the quote and timestamp, and confidence
   (high, medium, low).
3. Any criterion with low confidence goes to the human review queue with your reasoning.
4. Write a two-line coaching note naming the single biggest improvement area.

# OUTPUT FORMAT (JSON)
{"agent": "", "call_id": "", "criteria": [{"name": "", "result": "", "quote": "", "timestamp": "",
 "confidence": "high|medium|low"}], "needs_review": true, "coaching_note": ""}

# GUARDRAILS
- Never mark a compliance criterion as met without a quote.
- If the transcript is incomplete or garbled, mark confidence low rather than guess.
- Weekly, roll results up per agent: trends and top improvement areas, not single-call blame.

Replace every {{PLACEHOLDER}} before running. Works with any capable LLM and runner.

Tools

Steps

  1. Write each quality criterion with a definition, pass and fail examples and a severity.
  2. Capture call audio from the telephony system and transcribe with speaker separation.
  3. Score each criterion independently with evidence and confidence.
  4. Route evaluations below a confidence threshold to human reviewers.
  5. Generate per-agent coaching summaries with specific call examples.

Results

The agency reports the client scaled its floor without adding QA headcount and that human-review flags fell as prompts were tuned. Self-reported by the builder.

What goes wrong

Gotchas

  • Sarcasm and background noise caused misjudged criteria; confidence thresholds caught these for human review.
  • A noticeable share of evaluations needed human review in the first month before tuning reduced it.
  • Transcription runs a few seconds behind live audio, which limits truly real-time intervention. (editor note)

Source and credit

madgeek.ai ›

Abhijit Das, Madgeek · vendor

Source dated 2026-06-08 · last reviewed 2026-10-11. Summarized in our own words; see the source for details.

Related.

Alert deal owners to risk signals in new call transcripts within the hour

This agent reads new sales call recordings and alerts the deal owner when something risky comes up, like a competitor mention, a pricing objection or no next step. Risks surface the same day instead of at the weekly review.

Works with any of GongChorusAttention +5

  • Call Coaching
  • advanced
  • Reference setup

Cluster non-converting SDR calls into a weekly coaching digest

This agent reviews outbound calls that did not book a meeting, groups them by what went wrong, and sends managers a weekly coaching digest with examples. Coaching focuses on real patterns, not one memorable call.

Works with any of NooksOrumOutreach +6

  • Call Coaching
  • intermediate
  • Reference setup