← Courses
Building an AI Agency
← Module 4
Module 5 of 8
Module 6 →
Intro
Scenario
Lesson
Context
Lab Skill ~20 min
Intro

The Leverage Gap

2 min read

The premise of an AI agency is leverage: you deliver more value per hour of your time than a non-AI operator can. But leverage doesn't appear automatically. It has to be engineered — specifically in the parts of your business where the same work happens for every client, every time.

Client onboarding is the first place most agency founders lose leverage they should have. The welcome email, the intake form, the project brief template, the first-call preparation — these happen for every new client. They take between three and eight hours each time. And they are almost entirely automatable. Most agencies don't automate them because they "feel personal." But the things that make onboarding feel personal are not the hours spent writing emails. They're the specificity and speed with which the client feels understood. Automation, done well, delivers more of both — not less.

This module teaches the skill of automation design: choosing what to automate, designing the sequence, and measuring whether the NIST MEASURE function is being satisfied — that what AI handles is producing the expected outcomes, and you'd know if it wasn't.

Portfolio artifact — Skill
A client onboarding automation spec: trigger conditions, sequence steps (AI-generated and human-personalized), measurement criteria, and the NIST MEASURE monitoring plan for each AI-produced output.
  • Identify the repeatable steps in client onboarding that can be automated without losing personalization
  • Design a trigger-based onboarding sequence with AI-generated and human-verified steps
  • Apply NIST MEASURE principles to define what "working" looks like for each automated step
  • Distinguish between automation that reduces your burden and automation that reduces client experience
  • Produce a complete onboarding automation spec ready for implementation
Scenario

Six Hours Per Client

3 min read

An AI content agency tracks its time for thirty days. The founder discovers that onboarding a new client takes an average of six hours — spread across two weeks of back-and-forth, form-filling, welcome-writing, and brief-building. Across twelve clients per year, that's seventy-two hours of onboarding work — nearly two full work weeks — before a single dollar of revenue-generating work is delivered.

The founder breaks down the six hours. An hour is spent on the welcome email and initial onboarding message — personalizing it to the client's context. An hour is on intake form administration — chasing completions, following up on missing fields. Two hours are on the project brief — translating the intake form into a structured brief the AI tools can work from. An hour is on the initial kickoff call preparation — gathering background on the client's competitors, recent content, and stated voice. One hour is on the kickoff call itself, which is not automatable but could be shorter with better preparation.

Four of these six hours are automatable. The welcome email can be AI-generated from a template triggered by contract signature. The intake form follow-up can be triggered automatically. The project brief can be AI-generated from the completed intake form. The kickoff preparation can be AI-researched. The founder's time goes from six hours to two — and the client experience improves, because AI-generated preparation is more thorough than a rushed human effort.

The skill is knowing which steps to automate, how to set them up, and how to monitor whether the AI-generated outputs are actually serving the client. Not everything that can be automated should be. But everything that is automated should be measured.

Lesson

Three Automation Types

3 min read

Not all automation is the same. Three types cover the automation decisions an AI agency makes in fulfillment. Knowing which type applies to a given step determines how you design it and how you monitor it.

A human writes a template. The AI personalizes it using data from the intake form or CRM. Output: a draft that looks personal but was never fully written from scratch. Best for: welcome emails, project status updates, check-in messages. Risk: template drift — the AI's personalization introduces errors or tonal inconsistencies. Measurement: spot-check sample rate, client response rate as proxy for quality.

An event triggers an automated action. Contract signed → intake form sent. Intake form completed → brief generated. Brief approved → kickoff prep started. No human initiates any step. Best for: administrative sequences where timing matters more than personalization. Risk: the trigger fires at the wrong moment, or the trigger condition is not met and the sequence breaks. Measurement: sequence completion rate, time-from-trigger-to-output.

The AI produces a full output from inputs — the project brief from the intake form, the competitive research from the client's URL, the kickoff preparation from the brief. Output quality depends heavily on input quality. Best for: synthesis tasks that would take a human an hour but that follow predictable patterns. Risk: the AI produces plausible-sounding but wrong output — especially in research tasks. Measurement: explicit human review before the output is used, with specific accuracy criteria.

NIST AI RMF — MEASURE Function

The MEASURE function requires that organizations analyze and assess AI risk — meaning they have methods to evaluate whether AI systems are performing as intended, and they monitor for deviation. For automated fulfillment, MEASURE is the difference between "we have a system" and "we know if the system is working." Every automated step should have a measurement plan: what does success look like, how often is it checked, and what triggers a manual review? An agency that can't answer these questions for its automated workflows has operational risk it's not managing.

NIST AI RMF — MANAGE Function

MANAGE requires that identified risks are treated with appropriate responses. For onboarding automation, this means: what happens when the AI-generated welcome email is wrong? When the brief has errors? When the trigger fires twice? Each automated step needs a failure mode and a response plan — not as a bureaucratic exercise, but because clients experience automation failures directly, and how the agency responds defines client trust.

Context

Three Design Questions

2 min read

Before building any automated step, answer three questions. They prevent the most common automation failures — steps that work in testing but degrade in production.

Question 1: What's the trigger, and can it fail?

Every automated step fires based on a condition. What is that condition? What happens if the condition is never met — does the sequence stall, or does someone get alerted? What happens if the condition fires twice? Trigger reliability is the most common failure mode in automation sequences. Design for it explicitly: name the trigger, describe the failure mode, and document the recovery action.

Question 2: Where does human judgment still happen?

Automation doesn't eliminate human judgment — it moves it. In a fully automated onboarding sequence, where does a human still look at the output before it reaches the client? If the answer is "nowhere," you've created a delivery channel with no quality gate. For AI-generated outputs especially, there should always be a checkpoint — even a lightweight one — before the output becomes client-facing. Define that checkpoint explicitly in the design.

Question 3: How will you know if it stops working?

Automation degrades silently. A template drifts from what clients expect. A trigger stops firing because of a CRM update. An AI model changes its output behavior. None of these announce themselves. Define your NIST MEASURE plan: what are you monitoring, at what frequency, and what threshold triggers a manual review? For client-facing outputs, a monthly spot check is the minimum. For high-stakes outputs (project briefs, compliance documents), every output should be reviewed.

You'll apply all three questions in the lab — designing a complete onboarding automation spec with triggers, human checkpoints, and a NIST MEASURE monitoring plan.

◆ Skill Lab
Onboarding Automation
~20 minutes · full sequence
What you're doing
You'll design an automated onboarding sequence for your agency: triggers, steps, automation type, human checkpoints, and a monitoring plan. I'll flag missing triggers, unmonitored steps, and automation that removes too much human judgment.
Roles
👤
You — Automation DesignerYou're building the onboarding system for your agency. Design it for a new client arriving today.
🔍
AI — System ReviewerI'll push on trigger reliability, missing human checkpoints, and what your NIST MEASURE plan looks like for each automated step.
Framework — for each step
Automation type: template-first, trigger-based, or AI-generated
Trigger — what event fires this step?
Human checkpoint — where does a human review before client sees it?
NIST MEASURE — how do you know if this step stops working?
Failure mode — what breaks, and what's the recovery?
Success criteria
A complete onboarding automation spec with named triggers, human checkpoints at the right steps, and a monitoring plan you'd actually run.
Shift + Enter for a new line
✓ Module Complete
You've completed Module 5 of 8. Your onboarding automation spec is your fifth portfolio artifact.
Next Module →