The 12 Test Calls and 24 Questions to Use Before You Buy an Answering Service


Use this while you are actually testing providers, phone in hand. It is the practical half of our AI receptionist vs answering service comparison, pulled out so you can keep it open on a second screen.
Nothing here is gated. There is no form and no PDF to download, because you should not have to trade an email address for a checklist.
Why not just use the vendor's demo? Because a demo is run on the calls the vendor already knows it handles. Everyone passes those. The twelve below include the four that most providers fail, and the tenth is the one almost nothing survives.
The 12 test calls
Place each one, score it 0-2, and keep the recording. 0 = failed, 1 = handled but clumsy, 2 = handled well. Run the identical twelve at every provider you shortlist, so the scores are comparable.
| # | The call | What a pass looks like |
|---|---|---|
| 1 | "What are your opening hours?" | Correct answer in one turn, no transfer |
| 2 | "Do you cover [a postcode just outside your area]?" | Says no clearly and offers something useful. Saying yes is a fail |
| 3 | Book a routine appointment for a specific day and time | It lands in your calendar with the right details. Then check whether it wrote back or just emailed you a message |
| 4 | Call from a mobile, outdoors, traffic or a fan running | Recovers or escalates. Looping "sorry, say that again" is a fail |
| 5 | Have someone with a strong regional or non-native accent place calls 1 and 3 | Same score as the clean calls. The most predictive test in the battery |
| 6 | Speak slowly, with long pauses, the way an older caller often does | It waits. Interrupting or timing out is a fail |
| 7 | Give a name with an unusual spelling, plus a postcode | Reads both back before acting |
| 8 | Ask for something entirely outside its knowledge | Says it does not know and takes a message. Inventing an answer is disqualifying |
| 9 | Ask for a human on the first turn, plainly | Routes immediately. No friction, no third question |
| 10 | Trigger an out-of-hours emergency at a genuinely out-of-hours time, then do not answer the escalation for 15 minutes | The fallback fires. Almost everything fails this one |
| 11 | Hang up in silence after four seconds | Check the invoice at the end of the trial. Were you billed for it? |
| 12 | Place three calls at once from three phones | All three answered. A human service will queue at least one |
Then two things after the trial: request transcripts or recordings for all twelve, and reconcile every call against the invoice to check the rounding. A provider that cannot produce the transcripts cannot help you improve.
Calls 5, 10 and 12 are the ones that separate providers. Almost everyone passes calls 1 to 3, which is why demos are useless.
How to read your scores
Calls 5, 10 and 12 are the ones that separate providers. Nearly everybody passes 1 to 3, which is exactly why demos tell you nothing.
- Call 5 fails, calls 1-3 pass. You do not have a working agent, you have one that works for some of your customers. If a meaningful share of your callers have strong regional or non-native accents, treat this as the decision, not a caveat.
- Call 8 fails. Disqualifying, full stop. An agent that invents an answer on a test call will invent one on a real one.
- Call 10 fails. The most common failure in the category. It means "escalation" is a checkbox with nothing behind it, and at 2am your caller gets nothing.
- Call 11 shows a charge. Ask how many of those you will get a month. Junk calls are a real line item on per-call pricing.
- Call 12 queues. Expected from a human service, and fine if your demand is steady. A problem if it is bursty.
After the trial, do two more things. Request the transcripts or recordings for all twelve, because a provider who cannot produce them cannot help you improve. Then reconcile every call against the invoice and check the rounding.
The 24 questions to send in writing
Email these before you sign. Answers in writing are worth more than any comparison table, including ours. Questions 2, 7, 11 and 16 are the ones that most often produce a surprising answer.
Pricing
- Your full fee schedule, including overage rates.
- What billing increment do you use? Per second, 30 seconds, or rounded up to the whole minute?
- Is hold time billable? Transfer time? After-call write-up time?
- What do I pay for a call that lasts under 30 seconds?
- Out-of-hours, weekend and bank holiday surcharges, as percentages.
- Is appointment booking included or an add-on, and at what rate?
- Calendar month billing or 28-day cycles? How many invoices a year?
- Setup fee?
Contract
- Minimum term?
- Notice period to cancel, and does it have to be in writing?
- If you allocate me a phone number, who owns it if I leave?
- Can I export my call data, transcripts and contact records, and in what format?
Capability
- Which of my systems do you integrate with natively, as opposed to via Zapier or a webhook? Name them.
- Does the integration write back, or only read?
- Can I see a transcript or recording of every call?
Escalation
- What exactly happens when you try to reach my on-call contact and they do not answer? Walk me through the next 15 minutes.
- Can I set different escalation rules by time of day and by call type?
For AI providers
- What does the agent say when it does not know the answer?
- How many failed understanding attempts before it escalates?
- Show me your data processing agreement, and confirm it covers telephony, speech-to-text, the model, and text-to-speech.
- Can I have a trial line to run my own test calls, including calls from accented and elderly callers?
For human providers
- How many of your agents will be trained on my account?
- What is my hold time at peak, and how is that measured?
- Do you use AI on any part of my calls, and will you tell my callers if so?
Question 24 is not rhetorical. Several human providers now run AI on some portion of calls, and the boundary is not always disclosed.
Question 24 is not rhetorical. Several human providers now run AI on some portion of calls, and the boundary is not always disclosed to you or to your callers.
What to do with the answers
Total the twelve-month cost, not the monthly one. Setup fees, minimum terms and notice periods only show up in the annual figure, and they are where the difference between two similar-looking quotes usually lives.
Then, whichever way you go: keep your own phone number and divert it to the provider. Never advertise a number they gave you. Some providers' terms state that any number they allocate remains their property, so switching later can cost you a rebrand instead of a five-minute change to a divert rule.
The full reasoning behind all of this, including published UK prices for both sides and the rounding mechanics that inflate per-minute bills, is in AI receptionist vs answering service.