Why Your Agency's Case Studies Are Lying to You (And What Real Performance Proof Looks Like)

The Problem With Agency Case Studies

Every agency has them. Glossy PDFs with big numbers in green font:

"300% increase in ROAS"

"10x growth in 90 days"

"$2M in revenue generated"

They look impressive. They're designed to. But most agency case studies are engineered to persuade — not to inform.

Here's what's usually missing.

The Five Lies of Agency Case Studies

1. Cherry-Picked Time Windows

"We increased conversions 400% in Q4."

What they don't mention: Q3 was a disaster. The account was paused for two months. The "400% increase" is measured from the worst-performing period to the best — a recovery, not a breakthrough.

What real proof looks like: Performance shown across the full engagement period, including the bad months. A system that works should show consistency, not spikes.

Vanity Metrics Disguised as Outcomes

"12 million impressions delivered."

Impressions are a cost, not a result. Clicks are a step, not a destination. Even leads — without qualification data — are just names in a spreadsheet.

What real proof looks like: Metrics tied to business outcomes. Cost per qualified lead. Lead-to-enrollment rate. Revenue attributed to specific campaigns. Customer acquisition cost compared to lifetime value.

3. No System Description

"We ran Facebook ads and the client grew."

This tells you nothing about what was built. Was there a tracking infrastructure? A lead routing system? A conversion-optimized landing page? A retargeting architecture? Or just a boosted post with a prayer?

What real proof looks like: A clear description of the system — the campaign architecture, the funnel logic, the measurement framework, and the optimization methodology. If they can't explain *how* it works, it probably doesn't.

4. No Compliance Context

For agencies working in regulated verticals — financial services, health and wellness, legal, real estate — compliance isn't optional. It's the foundation.

Yet most case studies in these verticals never mention:

- How they navigated platform advertising policies

- What compliance frameworks were in place

- How they handled Special Ad Categories or restricted content rules

- Whether the work would survive an audit

What real proof looks like: Explicit acknowledgment of regulatory constraints and how the system was built within them — not despite them.

5. No Mention of What Didn't Work

Every project has failures. Creative that bombed. Audiences that didn't convert. Landing pages that leaked leads. Channels that underperformed.

Agencies that only show wins are agencies that don't learn from losses.

What real proof looks like: Honesty about what was tested and failed, and how those failures informed the final system. This is where methodology lives.

What a Real Case Study Should Tell You

If you're evaluating an agency, their case studies should answer five questions:

1. What was the starting state?

Not "the client wanted more leads." What was actually broken? What infrastructure existed? What was missing?

2. What system was built?

The architecture — campaign structure, funnel design, tracking implementation, lead routing, creative strategy. The system is the product. If they can't describe it, they don't have one.

3. What were the real numbers?

Not cherry-picked peaks. Full-period performance. Cost per lead, cost per acquisition, return on ad spend, conversion rates through each funnel stage. And if they can, downstream metrics: enrollment rates, patient show rates, revenue per customer.

4. What constraints were navigated?

Compliance requirements, platform restrictions, budget limitations, competitive dynamics. The hardest part of the work is usually what's not shown.

5. What failed and what was learned?

The test that bombed. The audience that didn't convert. The creative hypothesis that was wrong. This is where you see whether an agency has a methodology or just got lucky.

How We Build Case Studies at VAM

We do this because our clients aren't looking for an agency that runs ads. They're looking for a partner that builds revenue systems. And a revenue system should be explainable, measurable, and repeatable.

The Bottom Line

Case studies should make you smarter, not just more impressed.

The next time an agency shows you a case study, ask:

- What was the system?

- What were the full-period numbers?

- What didn't work?

- Would this survive a compliance audit?

If they can't answer those questions, the case study isn't proof of performance. It's a sales tool.

And there's a big difference.

The VAM Group builds revenue systems for brands in regulated and competitive verticals. Every case study on our site describes the system we built, the constraints we navigated, and the numbers we delivered. See them at thevamgroup.com/case-studies.