How to Choose an Appointment Setting Company (Scorecard)

The right way to choose an appointment setting company is to judge every vendor on qualified meetings that get held and turn into real pipeline, not on the raw number of bookings they promise. The classic failure is a vendor that fills your calendar with cheap meetings that no-show or never fit your ICP. Below is a 100-point scorecard you can grade each vendor on, plus the red and green flags that predict which ones actually build pipeline.

We book meetings for clients, so read this knowing we sell it. That is also why the scorecard leans so hard on the definition of a qualified meeting, which is where appointment setting is won or lost.

What should you judge an appointment setting company on?

Judge them on outcomes deeper in the funnel than a booking: meetings that are held, that fit your ICP, and that create qualified pipeline. A booking is a promise; a held, qualified meeting is the thing your closers can actually work. Any vendor can inflate bookings, so anchor on the numbers a booking cannot fake.

That taper is the whole argument. A vendor paid per booking optimizes the first bar. You care about the last one. Two vendors can book the same number and be completely different services once you look at held and qualified.

What goes on the appointment setting scorecard?

Score each vendor out of 100 on the ten criteria below, weighted by how much each one predicts pipeline. The weights are directional, so adjust them to your market. The point is to force a like-for-like comparison instead of being sold on a headline meeting count.

1. Definition of a qualified meeting, and who owns it (20 pts). The single biggest factor. A qualified meeting should mean a prospect who matches your ICP, has a problem you solve, and agreed to a real conversation. You should own that definition in writing, not inherit theirs.
2. Show-rate, and how they measure it (15 pts). Ask what share of booked meetings actually get held, and how they count a no-show versus a reschedule. Vague answers here mean they do not track it, which usually means it is bad.
3. Qualified versus guaranteed meetings (15 pts). A vendor that guarantees a meeting count regardless of fit is guaranteeing the wrong thing. You want a quality bar, not a quota that gets hit by lowering standards.
4. ICP and targeting rigor (12 pts). How do they build the list, and can you veto it? Bad targeting sinks good outreach. You want sample accounts and contacts before anyone sends or dials.
5. Reporting transparency (10 pts). You should see booked, held, and qualified as separate numbers, plus the raw activity behind them. One proud tally of meetings booked is a red flag by itself.
6. Caller seniority and English or market fit (10 pts). For cold calling, the person on the phone has to sound credible to your buyer. Ask who calls, how senior they are, and whether they fit your market.
7. Script and personalization quality (8 pts). Ask to see real scripts and sequences. Generic, mail-merged messaging books generic, low-intent meetings.
8. Pricing model and incentive alignment (5 pts). Does the model reward the outcome you want? Pay-per-booking rewards volume; a retainer or hybrid can reward quality. Our appointment setting cost breakdown compares the models.
9. Replacement policy for no-shows (3 pts). If a booked meeting no-shows or was never qualified, do they replace it? A fair policy signals they stand behind the definition.
10. Ramp time and onboarding (2 pts). How long until the first qualified meetings, and what do they need from you? Honest ramps are measured in weeks, not days.

What are the red flags, and what are the green flags?

Some vendor behaviors reliably predict disappointment, and a few predict the opposite. Score a vendor down hard for the red flags and up for the green ones, because these are the tells that a slick sales call is designed to hide.

Red flags:

• Paying per raw booking with no quality bar. You will get volume, and most of it will not fit.
• Guaranteeing a meeting count regardless of ICP fit. A guarantee on quantity is a promise to lower quality.
• No separate show-rate or qualified number. If they only report meetings booked, assume held and qualified are ugly.
• A black-box list you cannot see or veto. Bad targeting is the most common reason outreach fails.
• Vague answers on who makes the calls. If they will not name the callers or their seniority, expect juniors reading a script.

Green flags:

• They ask you to co-write the qualified definition. They want the bar set before they book against it.
• They volunteer their show-rate and how it is measured. Only vendors with a decent number do this unprompted.
• Reporting shows booked, held, and qualified separately. Transparency here is the strongest single signal.
• They replace no-shows and unqualified meetings. Real skin in the game on quality.
• They tell you what they need from you. Real programs need your input; vending machines do not.

How do you run an appointment setting bake-off?

Do not choose on the pitch. Give two or three vendors the same ICP and the same qualified definition, run a short paid pilot, and score the results on the same scorecard. The vendor with the best held-and-qualified numbers wins, not the one with the highest booking count.

1. Write the qualified definition yourself. Use the same one for every vendor, including no-show handling.
2. Run a short paid pilot, not a free trial. Free trials get you their easiest, least representative meetings.
3. Score booked, held, and qualified separately. Then normalize to cost per meeting that shows and converts so price is comparable across vendors.
4. Interview them with the general checklist too. Appointment setting is one flavor of outreach, so the wider how to choose a sales outreach agency questions still apply.

A paid pilot is the honest test, and we are happy to be in it. Send us your ICP and two competing proposals, and we will score all of them on this scorecard with you on a short call. No obligation to pick us.

How does MarginSales choose which meetings to book?

MarginSales provides sales outreach services for companies that want to extend their outbound capacity without building the entire sales development function internally. On appointment setting, we book against a written qualified definition you approve, report booked, held, and qualified as separate numbers, and would rather book fewer real meetings than a pile of soft ones. Soft meetings quietly cost more than they save.

Where appointment setting fits in the wider service, see our sales outreach services guide.

Frequently asked questions

What is the most important thing when choosing an appointment setting company?

The definition of a qualified meeting, and who owns it. If the vendor sets the bar, they will book to it in their own favor. Insist on writing the definition yourself, covering ICP fit, the problem being solved, and no-show handling, then judge every vendor on meetings that meet it, not on raw bookings.

Should I pick a vendor that guarantees a number of meetings?

Be careful. A guarantee on quantity, regardless of fit, is a promise to hit the number by lowering quality. Guaranteed meetings and qualified meetings are not the same thing. Prefer a vendor that guarantees a process and a quality bar, replaces no-shows and unqualified meetings, and reports held and qualified counts honestly.

Want your appointment setting shortlist scored?

Send us your two or three finalists and the proposals they gave you, and we will score each on this 100-point scorecard and translate every quote into a real cost per qualified, held meeting. You will get a clear-eyed comparison even if you do not hire us. Book a call.