Back to Blog
AI Automation

ElevenLabs Agents: Build an Appointment Booking Voice Agent

5 min read
ElevenLabs Agents: Build an Appointment Booking Voice Agent

Get your next client on autopilot

Inside AI Autopilot Academy you get my 27-day Claude Code mastery program with a 1-click install setup file, so you’re up and running on day one. Plus my GoHighLevel CLI, the Skool Automation MCP and Jarvis +. And you get a proven Claude Code content system to get your next client on autopilot.

Join AI Autopilot Academy →

Your team isn’t picking up the phone, and every missed call is a lost appointment.

An AI voice agent that books appointments fixes that, and I built one in under 8 minutes of screen time. I’m Charles J Dove, I run Charlie Automates, and here’s the exact process I used in ElevenLabs Agents.


How Do You Build an AI Voice Agent That Books Appointments?

You write one good prompt, give the agent a voice, a knowledge base and two calendar tools, then connect a phone number. That’s the whole build. I used ElevenLabs for the agent and walked through it live, with an agent named Autumn that works for CC Strategic.

The part most people rush is the prompt. The prompt is the brain, and after a few backend settings it’s the most important thing in the build.

Why Does Markdown Formatting Matter in Your Prompt?

Markdown works as a priority ranking system for your AI agent. Top level headings, second level headings and third level headings tell the bot what matters most, and bold or all-caps text tells it what matters even more. Dashes as bullet points keep the rules clean.

Here’s how I built Autumn’s prompt:

  1. I screenshotted the template from one of my n8n workflows and gave it to ChatGPT as the formatting guide.
  2. I told it the bot’s name, who built it and who it works for.
  3. I listed what it must collect: business name, email address and biggest pain point.
  4. I told it to summarize those details back to the prospect before booking.
  5. I told it to read phone numbers and websites normally instead of spelling them out.

What Should the First Message Say?

Tell people it’s an AI. Transparency is something a lot of businesses skip, and people aren’t dumb. My opener was: “Hey, this is Autumn. I’m the AI assistant Charles Dove built for CC Strategic. My job is simple, understand your business fast, figure out where you’re stuck and help you get the right solution without wasting your time. What’s the name of your business?”

That builds rapport fast and nobody feels duped.

What Settings Do You Change in ElevenLabs Agents?

Pick a voice, leave the base settings alone to start, set the language to English and keep the default model (I left it on Gemini 2.5 Flash). Save it. Then you have three more areas to fill in:

  • Knowledge base. Customers will ask what something costs and how it works with their systems. Add as much as you can as PDFs or spreadsheets.
  • Tools. This is where the webhook tools live so the agent can check your calendar, create an event, update an event and delete one.
  • CRM. The details don’t have to land in a spreadsheet. You can push them into GoHighLevel or whatever CRM you use.

What Does a Real Call Look Like?

On the first preview, Autumn collected the business name, confirmed the email by repeating it back, asked about the pain point and summarized everything. It didn’t book yet because I hadn’t connected the tools.

After I set up two tools, check availability and book appointment, I called her again. I asked for the earliest slot, asked for 3 p.m. instead, and she booked a 30-minute meeting and sent a calendar invite. The appointment landed in my CRM automatically. I built that second version in under 8 minutes of video.

How Do You Connect a Phone Number?

Connect Twilio. Set up an account at twilio.com, add a number, and import it into the agent. Then anyone who calls that number can check availability, book and change appointments, all handled by the same backend. You can also put the number on a landing page next to a booking button.

Is an AI Voice Agent Meant to Replace You?

No. It’s meant to increase your output. The agent runs the qualification so the calls on your calendar already come with the business name, the email and the pain point. You decide whether to take the call, text the person or reschedule.

Then you pair it with an outbound text that includes a pre-call video and other assets showing who you are and what to expect. You spend your time on consulting calls, not first-pass discovery. If you want the text side of this, I wrote about an AI text agent built with GoHighLevel and n8n.

Key Takeaways

  • The prompt is the brain. Use markdown headings, bold and bullets so the agent knows what matters most.
  • Say it’s an AI in the first message. Transparency builds trust fast.
  • Collect 3 things: business name, email and biggest pain point, then summarize them back before booking.
  • Two tools do the booking: check availability and book appointment.
  • Twilio gives the agent a real phone number for inbound calls.
  • Use it to qualify, not replace. You show up for calls that already have the details.

Where to Go From Here

Get your next client on autopilot.

Join AI Autopilot Academy for my 27-day Claude Code mastery program with a 1-click install setup file, plus a proven Claude Code content system to get your next client on autopilot.

Join AI Autopilot Academy →

Related tools on the Charlie Automates site, charlieautomates.com:

Want the full system instead of piecing it together? AI Autopilot Academy is where I teach you to build and sell systems like the one in this post.

At my agency CC Strategic we build systems like this for business owners, and new builds drop every week on my YouTube channel @charlieautomates.

FAQ

How do you build an AI voice agent that books appointments? Write a prompt with markdown headings, add a knowledge base, connect check availability and book appointment tools to your calendar, then attach a phone number through Twilio. I did it in ElevenLabs.

What is markdown formatting in an AI prompt? Markdown uses headings, bold text and dashes to rank instructions. Higher level headings and bold text tell the AI agent what is a priority and what is not.

Do I need to tell callers it’s an AI? I do. My agent opens by saying it’s the AI assistant I built for CC Strategic. People aren’t dumb, and being upfront builds rapport quickly.

How does the AI voice agent get a phone number? Create a Twilio account, add a number and import it into the agent. Callers then reach the same agent that checks availability and books appointments.