The Setter Scorecard: How Online Coaches Know If a Setter Is Actually Working

You can hire a setter and still feel like you are the one carrying the whole sales system.

That is the part nobody likes to say out loud.

From the outside, hiring a setter sounds like the mature move. You have leads. You have DMs. You have calls. You are not trying to do everything yourself anymore.

So you bring someone in to handle the front end.

At first, it feels lighter.

Then the questions start:

• Are they actually booking better calls?
• Are they following up with the right people?
• Are they qualifying leads or just chatting?
• Are they updating anything consistently?
• Are they helping, or did I just create a second inbox I now have to manage?

This is where a lot of online coaches get stuck. They judge a setter by vibes, booked call count, or how busy the setter seems. None of those are enough.

A setter is not working just because they are active.

A setter is working when the pipeline becomes clearer, faster, more consistent, and easier to manage without you jumping into every thread.

That is what this scorecard is for.

Start with the real question: what is the setter supposed to fix?

Before you score a setter, you need to know why you hired one.

Not the generic reason.

Not "to help with DMs."

The actual bottleneck.

Most coaches hire a setter because one of these is happening:

• New leads are sitting too long before a first reply
• Warm leads are not getting followed up with
• Too many weak-fit people are booking calls
• Good prospects are losing momentum before they book
• The coach has no idea who is hot, warm, booked, or stalled
• The VA is doing admin but cannot carry sales conversations
• The coach is spending too much mental energy checking every thread

Those are different problems.

If your real problem is response speed, you score the setter differently than if your real problem is call quality. If your real problem is messy status tracking, a setter who "sounds good in the DMs" is not enough.

That is why the first scorecard question is not "Did they book calls?"

It is:

Did this person reduce the specific bottleneck they were hired to own?

If you have not defined that, you are not managing a setter. You are hoping one makes the business feel easier.

For a broader role-level breakdown, read VA vs Setter vs Closer: Which Role Does Your Online Coaching Business Actually Need?. This post goes one layer deeper: once the setter exists, how do you know whether the role is working?

Score 1: First response and ownership

This is the obvious metric, but most coaches track it too vaguely.

"They usually reply fast" is not a system.

You want to know:

• How long does it take for a new interested lead to get a real first reply?
• Who owns the thread once interest shows up?
• Is the setter picking up conversations from content replies, story responses, ManyChat flows, outbound replies, and warm follow-ups?
• Are leads ever left in a weird gray zone where everyone assumes someone else handled it?

Response time matters in sales because attention decays. HubSpot's overview of lead response time is written for broader sales teams, but the point applies painfully well to coaching DMs: speed only matters if the system routes interest to a real next step.

For coaches, "fast" does not mean the setter spams a calendar link at anyone who says "interested."

Fast means:

• the lead feels seen
• the context is understood
• the next question is relevant
• the thread has an owner
• the status is visible

Score this weekly:

If this score is low, do not jump straight to "bad setter."

Ask whether your lead sources are even visible in one place. A setter cannot own what they cannot see.

Score 2: Follow-up completion

Follow-up is where setters either create real leverage or create a false sense of movement.

The setter says, "I am following up."

But when you look closer, what does that mean?

• Did every qualified lead get the promised follow-up?
• Did warm leads get a follow-up based on context, not a generic bump?
• Did people who asked for the link but did not book get a clean nudge?
• Did no-shows get handled calmly?
• Did the setter stop following up when the lead clearly became weak-fit?

Good follow-up is not "hey, just checking in" copy-pasted forever.

Good follow-up carries the previous conversation forward.

If someone said they needed to talk to their spouse, the follow-up should not sound like they forgot that. If someone wanted pricing clarity, the follow-up should not pretend the issue was motivation. If someone no-showed, the message should create a clean reschedule path without sounding desperate.

This is also where coach fatigue hides. You think the setter is helping because they are "on follow-up," but your mental load is still high because you do not trust that the right people are being followed up with at the right time.

Score this weekly:

If you want a wider weekly rhythm for catching these leaks, pair this with the 30-minute weekly DM and sales triage ritual.

Score 3: Qualification quality

This is where a lot of setters look good until you read the actual conversations.

They are friendly.

They reply fast.

They ask questions.

But the questions do not reveal anything useful.

Good qualification is not asking a checklist in order. It is finding out whether this person is actually worth a call without making the DM feel like intake paperwork.

For a coaching business, a setter should usually uncover:

• What the prospect wants
• Why now
• What they have tried
• What is making this hard on their own
• Whether the offer is likely relevant
• Whether the prospect can make a real decision
• Whether there is a hidden blocker before the call

Notice what is not on that list:

• interrogating them about money immediately
• forcing every lead through the same script
• acting like every warm reply deserves a calendar link
• over-qualifying so hard that good people feel processed

The goal is not to block people.

The goal is to protect the calendar and increase trust before the call.

Score this weekly by reading a sample of actual threads:

This matters because "more calls" can become a vanity metric. If the setter books more calls but show rate drops, call quality drops, or you spend more time with people who were never a fit, the role is not working. It is just moving the mess from DMs to your calendar.

Score 4: Booking handoff quality

A booked call is not the finish line for a setter.

It is a handoff.

Bad handoffs create no-shows, awkward calls, and coach confusion.

Good handoffs create momentum.

A clean booking handoff should answer three questions:

1. Does the prospect know why the call is worth showing up for?

2. Does the coach know what matters before the call starts?

3. Does the system know what happened in the conversation?

If the setter sends a calendar link too early, the prospect may book without real commitment. If the setter gives you no notes, you start the call cold. If the setter does not update status, the business loses visibility.

That is why setter performance should connect directly to no-show patterns. If you are seeing people book and vanish, do not only blame lead quality. Inspect the handoff before the calendar event.

Score this weekly:

The easiest way to audit this is simple:

Pick five booked calls from the last week. Before reading the DM thread, ask yourself what you know about each person. Then read the thread.

If you learn the important context only after digging manually, your setter did not complete the handoff.

Score 5: Status accuracy

This one sounds boring until it starts costing money.

A setter can be charming and still wreck your visibility if statuses are wrong.

You need to know who is:

• new and unanswered
• in active conversation
• warm but not ready
• qualified but unbooked
• booked
• no-showed
• not a fit
• needs coach review

If those buckets are not accurate, you are back to scrolling and guessing.

Pipeline visibility is a standard sales management problem, not just a coaching problem. HubSpot's guide to sales pipeline stages is useful here because it shows the broader principle: stages only help if they reflect what is actually happening.

For a coach, status accuracy matters because DMs move fast. A lead can go from curious to qualified to booked to no-showed in a few days. If the system does not keep up, your "pipeline" becomes a prettier version of memory.

Score this weekly:

This is often the hidden reason a setter does not feel like leverage.

You are not only paying for replies. You are paying for reduced uncertainty.

Score 6: Disqualification quality

Good setters do not just move people forward.

They also know when not to.

This is uncomfortable for coaches because a rejected lead feels like lost opportunity. But if you sell high-ticket coaching, bad-fit calls drain energy, distort your calendar, and make you question your offer when the real issue is fit.

A setter should be able to gracefully filter out people who:

• want a result you do not sell
• are not ready for the level of support
• cannot make a decision
• are only hunting free advice
• are outside the basic requirements for your offer
• keep dodging clear questions

The goal is not to be rude.

The goal is to keep your calendar honest.

Score this weekly:

This is one of the biggest differences between a setter and someone who is just "good at DMs."

A setter is not paid to make every conversation positive.

A setter is paid to move the right conversations forward.

Score 7: Coach load

This is the score most people forget.

After hiring a setter, are you actually carrying less?

Not just fewer messages.

Less mental cleanup.

Less checking.

Less "Wait, what happened with her?"

Less "Can you send me context before the call?"

Less decision fatigue.

If you still have to review every thread, remind them who to follow up with, correct statuses, rewrite their messages, and rescue unclear handoffs, you did not buy leverage. You bought another management layer.

That does not automatically mean the setter is bad. Sometimes it means the process was never clear enough to delegate.

But the score still matters.

This is the real test.

If the business still feels chaotic after hiring a setter, do not keep asking, "Do they need more training?"

Ask, "What part of the system still requires me to hold it together?"

The weekly setter scorecard

Use this once a week. Score each category from 1 to 5.

Total possible score: 35.

Here is how to read it:

Do not use the score to shame someone.

Use it to diagnose.

A low score can mean:

• the setter is not a fit
• the setter was trained poorly
• the offer is unclear
• the lead sources are messy
• the CRM or DM system is too fragmented
• the coach has not defined standards
• the role is being asked to solve the wrong problem

That last one matters.

Sometimes you do not need a better setter.

You need fewer handoffs, clearer statuses, and one place where the conversation, context, and next step live together.

When to coach the setter, fix the system, or replace the person

After you score the week, choose one lane.

Coach the setter when:

• They are trying but inconsistent
• The same mistake appears repeatedly
• They need clearer examples of good qualification
• They are missing tone, pacing, or context
• Their scores are close to strong but not stable

Coaching works when the person has the right instincts and the process is visible enough to improve.

Fix the system when:

• Nobody can see all lead sources clearly
• Statuses live in too many places
• Follow-up depends on memory
• The booking handoff is undefined
• The coach keeps changing qualification standards
• The setter has to ask where everything goes

System fixes come before performance judgments. If the process is mushy, even a good setter will look average.

Replace the setter when:

• They ignore the agreed process
• They repeatedly miss follow-ups
• They damage trust in conversations
• They hide mistakes or avoid updates
• They resist clear feedback
• They make the coach feel less in control over time

Replacing someone is not the first move. But it is sometimes the honest one.

The point of a setter is not to make you feel like you hired help.

The point is to make the sales system hold more volume without losing quality.

The cleanest next step

This week, do not overhaul everything.

Pick five active conversations, five booked calls, and five warm leads that did not book.

Read them with the scorecard open.

Ask:

• Did we respond quickly?
• Did someone clearly own the thread?
• Did follow-up happen?
• Did qualification reveal real fit?
• Did the handoff make the call stronger?
• Did the status tell the truth?
• Did this reduce or increase my mental load?

That small audit will tell you more than another vague conversation about whether your setter is "doing well."

If the scorecard shows the person is strong but the system still feels scattered, the issue may not be the setter. It may be the layer underneath them: where conversations live, how context is preserved, and whether follow-up is visible without constant human checking.

That is the kind of problem Intellicoach is built around: keeping high-volume coaching DMs organized, contextual, and moving without forcing you to choose between more headcount and more chaos.

For the broader decision of whether another hire is even the right fix, read Why Hiring More Setters Won't Fix DM Operations next.

CTA: Use the scorecard this week. If the answer is "the setter is fine, but the system is still messy," see how Intellicoach helps coaches keep DM context, follow-up, and lead status in one place.