Shaira Hernaez • June 5, 2026

Why Your Agency's Case Studies Are Lying to You (And What Real Performance Proof Looks Like)

Author

Shaira Hernaez

Date

June 5, 2026

Share

The Problem With Agency Case Studies

Team meeting with a laptop displaying charts and graphs in a bright office conference room

Every agency has them. Glossy PDFs with big numbers in green font:


"300% increase in ROAS"

"10x growth in 90 days"

"$2M in revenue generated"


They look impressive. They're designed to. But most agency case studies are engineered to persuade — not to inform.


Here's what's usually missing.

The Five Lies of Agency Case Studies

1. Cherry-Picked Time Windows

"We increased conversions 400% in Q4."


What they don't mention: Q3 was a disaster. The account was paused for two months. The "400% increase" is measured from the worst-performing period to the best — a recovery, not a breakthrough.


What real proof looks like: Performance shown across the full engagement period, including the bad months. A system that works should show consistency, not spikes.

Vanity Metrics Disguised as Outcomes

"12 million impressions delivered."


Impressions are a cost, not a result. Clicks are a step, not a destination. Even leads — without qualification data — are just names in a spreadsheet.


What real proof looks like: Metrics tied to business outcomes. Cost per qualified lead. Lead-to-enrollment rate. Revenue attributed to specific campaigns. Customer acquisition cost compared to lifetime value.

3. No System Description

"We ran Facebook ads and the client grew."


This tells you nothing about what was built. Was there a tracking infrastructure? A lead routing system? A conversion-optimized landing page? A retargeting architecture? Or just a boosted post with a prayer?


What real proof looks like: A clear description of the system — the campaign architecture, the funnel logic, the measurement framework, and the optimization methodology. If they can't explain *how* it works, it probably doesn't.

4. No Compliance Context

For agencies working in regulated verticals — financial services, health and wellness, legal, real estate — compliance isn't optional. It's the foundation.


Yet most case studies in these verticals never mention:

- How they navigated platform advertising policies

- What compliance frameworks were in place

- How they handled Special Ad Categories or restricted content rules

- Whether the work would survive an audit


What real proof looks like: Explicit acknowledgment of regulatory constraints and how the system was built within them — not despite them.

5. No Mention of What Didn't Work

Every project has failures. Creative that bombed. Audiences that didn't convert. Landing pages that leaked leads. Channels that underperformed.


Agencies that only show wins are agencies that don't learn from losses.


What real proof looks like: Honesty about what was tested and failed, and how those failures informed the final system. This is where methodology lives.

What a Real Case Study Should Tell You

If you're evaluating an agency, their case studies should answer five questions:

1. What was the starting state?

Not "the client wanted more leads." What was actually broken? What infrastructure existed? What was missing?

2. What system was built?

The architecture — campaign structure, funnel design, tracking implementation, lead routing, creative strategy. The system is the product. If they can't describe it, they don't have one.

3. What were the real numbers?

Not cherry-picked peaks. Full-period performance. Cost per lead, cost per acquisition, return on ad spend, conversion rates through each funnel stage. And if they can, downstream metrics: enrollment rates, patient show rates, revenue per customer.

4. What constraints were navigated?

Compliance requirements, platform restrictions, budget limitations, competitive dynamics. The hardest part of the work is usually what's not shown.

5. What failed and what was learned?

The test that bombed. The audience that didn't convert. The creative hypothesis that was wrong. This is where you see whether an agency has a methodology or just got lucky.

How We Build Case Studies at VAM

The Opportunity

What the business needed, honestly stated.

The Challenge

What constraints made this hard. Compliance, competition, infrastructure gaps, budget.

What We Built

The system. Not the tactics — the architecture. Campaign structure, funnel logic, tracking infrastructure, lead routing, creative framework.

The Numbers

Real performance data. Not peaks — sustained results. Tied to business outcomes, not vanity metrics.

Why It Matters

What this work demonstrates about our methodology, not just our results.

We do this because our clients aren't looking for an agency that runs ads. They're looking for a partner that builds revenue systems. And a revenue system should be explainable, measurable, and repeatable.

The Bottom Line

Case studies should make you smarter, not just more impressed.

The next time an agency shows you a case study, ask:

- What was the system?

- What were the full-period numbers?

- What didn't work?

- Would this survive a compliance audit?


If they can't answer those questions, the case study isn't proof of performance. It's a sales tool.


And there's a big difference.

The VAM Group builds revenue systems for brands in regulated and competitive verticals. Every case study on our site describes the system we built, the constraints we navigated, and the numbers we delivered. See them at thevamgroup.com/case-studies.

Purple glowing digital waveform and particle data stream forming a central ring on a dark background
By Joey Abrasaldo • October 3, 2026
Meta, Google Ads, and Shopify can all report different ROAS for the same period. Learn why, what each dashboard measures, and which metric to use.
By Jan Marquez • September 18, 2026
If your product page ranks on page one and your revenue still isn't moving the way it used to, the problem might not be your ranking at all. It might be that fewer people are getting to the ranking in the first place. A growing share of product research now happens inside ChatGPT, Perplexity, and Google's AI Overviews before a shopper ever opens a search results page. Someone asks "what's the best recovery drink for marathon training" or "which skincare brand actually works for sensitive skin" and gets a short, synthesized answer with two or three brand names attached. If your brand isn't one of them, you never get the click. You don't show up as a missed impression on a dashboard. You just don't exist in that conversation. This is the shift that Answer Engine Optimization, or AEO, is built to address. For D2C brands already spending real money on paid acquisition, this isn't an academic SEO topic. It's a new front door that either includes your brand or doesn't, and most growth teams have no process for influencing it. Why Product Discovery Is Moving Into AI Tools Search behavior for high consideration and comparison-heavy purchases has been trending toward conversational queries for a while. Instead of typing "best running shoes for flat feet," people increasingly ask a chat interface the full question the way they'd ask a friend, and expect a direct answer with reasoning attached. This matters more for D2C than almost any other category, because so much of D2C purchasing is comparison driven. Shoppers are weighing ingredients, price points, reviews, and fit against three or four alternatives before they buy. That's exactly the kind of query language models are built to answer well. When a generative tool synthesizes that comparison, it pulls from sources it can parse cleanly and trusts as accurate, not necessarily from the highest-ranked page on Google. The practical effect is that a brand can have strong organic rankings and healthy backlink profiles and still be functionally invisible in the place a growing number of purchase decisions now start. What Actually Changes When You Optimize for AEO Traditional SEO optimizes for a search engine that indexes pages and ranks them by relevance and authority signals. AEO optimizes for a language model that reads content, extracts facts, and decides whether your brand is a credible answer to a specific question. The mechanics are different enough that a page built purely for keyword ranking often performs poorly here, even with strong domain authority. A few concrete differences matter most for D2C brands: Specificity beats repetition Language models don't reward keyword density. They reward clear, specific claims they can extract and reuse without risk. "Our formula is designed with clean ingredients" gives a model nothing to cite. "Our recovery blend uses 5 grams of tart cherry extract per serving, the dose used in the sleep studies this category is usually compared against" gives it something concrete to attach to your brand name. Structure determines retrievability Generative systems tend to pull from content organized in clear question-and-answer blocks, defined terms, and scannable comparison structures, because that format is easier to extract without misrepresenting the source. A product or category page buried in narrative paragraphs is harder for a model to parse correctly, even if a human would read it just fine. Entity clarity replaces backlink volume as the trust shortcut Traditional SEO leans heavily on backlinks as a trust signal. AI systems lean more on entity consistency: does this brand show up the same way, with the same claims, across its own site, its reviews, its social presence, and third party mentions. Contradictory or vague information across those sources makes a model less likely to treat the brand as a confident answer. Schema tells the model what it's looking at Structured data, particularly Product, FAQ, and Organization schema, gives language models an explicit map of your content instead of forcing them to infer it. For a D2C brand with a real catalog, this is one of the highest leverage, lowest effort levers available. A Practical Framework for D2C Brands Here's how this typically plays out for a mid-sized D2C brand starting from scratch. Step 1: Audit current AI visibility. Before changing anything, ask the actual questions your buyers would ask across ChatGPT, Perplexity, and Google AI Overviews. Note whether your brand appears, how it's described, and which competitors show up instead. This baseline tells you whether the problem is visibility, accuracy, or both. Step 2: Fix entity consistency first. Make sure your brand name, category claims, ingredient or material specifics, and core differentiators are described the same way on your site, your Amazon listing if applicable, your review platforms, and your social bios. Inconsistency here is one of the most common reasons a model hedges instead of recommending a specific brand. Step 3: Rebuild key pages around direct answers. Product and category pages should include a section that plainly answers the most common comparison questions in your niche, using specific, verifiable claims instead of adjectives. This doesn't replace your brand storytelling. It sits alongside it. Step 4: Deploy Product, FAQ, and Organization schema. This is a technical implementation, not a copywriting one, and it's often the fastest win because it doesn't require rewriting existing content, just marking it up correctly. Step 5: Monitor and iterate quarterly. AI training and retrieval cycles aren't real time. Expect the technical work to be visible within thirty days, but meaningful shifts in how often your brand gets cited typically take three to six months to show up. Where This Fits Into a Bigger Growth Picture AEO doesn't replace paid media, CRO, or CRM automation. It sits upstream of all three. If AI tools are influencing which brands even make it into a shopper's consideration set, then every dollar spent on paid acquisition downstream is working against a smaller pool of aware, considering buyers if AEO is ignored. This is also why treating AEO as a standalone freelance project rarely works well for D2C brands. It depends on the same technical site health, content architecture, and tracking infrastructure that a real SEO and paid media system already requires. A brand that has fragmented vendors handling ads, landing pages, and content separately usually finds that no single vendor owns entity consistency across all of it, which is exactly the thing AEO depends on. Frequently Asked Questions What is Answer Engine Optimization? AEO is the practice of structuring content, data, and entity information so that AI tools like ChatGPT, Perplexity, and Google AI Overviews can accurately extract and recommend a brand when answering a user's question. Is AEO different from traditional SEO? They overlap but aren't identical. Traditional SEO focuses on ranking pages in search results. AEO focuses on whether a language model treats your brand as a trustworthy, citable answer. Strong technical SEO supports AEO, but AEO adds entity consistency and structured, extractable content on top of it. How long does it take to see results from AEO? Technical implementation, including schema and page restructuring, can be completed within thirty days. Measurable shifts in how often a brand is cited by AI tools typically take three to six months, since language models don't update their understanding of a brand in real time. Do small or mid-sized D2C brands actually benefit from AEO, or is this only for big brands? Mid-sized D2C brands often have more to gain, since they're less likely to already dominate AI citations the way category leaders do. A specific, well-structured claim from a smaller brand can outperform a vague one from a larger competitor in a model's eyes. Does AEO help with Google Business Profile and local visibility too? Yes, for brands with a physical or regional presence. Local Business schema and consistent location data feed the same entity resolution process AI tools use for shopping and service recommendations. Where to Start  If you're not sure whether your brand currently shows up when AI tools answer questions in your category, that's the first thing to find out, before spending on a rebuild. The VAM Group folds AEO into the same integrated system that already handles SEO, content, and tracking for the D2C brands we work with, so entity consistency isn't managed by five different vendors with five different answers. Get a free growth audit and we'll show you exactly where your brand stands in AI search today.
Purple digital profile of a human face against a dark background with glowing particle effects
By Joey Abrasaldo • September 4, 2026
Your CAC didn't get worse overnight. Learn why declining retention and LTV — not media performance — are often the real reason acquisition stops being profitable.
By Jan Marquez • August 28, 2026
Learn how D2C brands become visible in ChatGPT, Perplexity, and AI Overviews. A practical guide to structured data and entity signals.
By Jan Marquez • August 21, 2026
Your ROAS looks strong on every dashboard, but revenue isn't growing. Here's why D2C attribution breaks at scale, and how to fix it.
By Jan Marquez • August 14, 2026
Stop wasting ad spend on vanity metrics. Learn how multi-touch attribution and server-side tracking build a highly profitable D2C revenue system.
By Jan Marquez • August 7, 2026
Stop guessing what works. Learn how connecting your ads, landing pages, CRM, and attribution into a single D2C revenue system eliminates wasted ad spend.
By Jan Marquez • July 31, 2026
Learn how B2B Answer Engine Optimization services protect organic visibility. Discover how to rank in ChatGPT, Perplexity, and AI Overviews. Read the guide.
By Jan Marquez • July 25, 2026
Stop burning cash on disconnected marketing agencies. Learn how to architect a unified growth ecosystem that connects paid media, CRO, and your CRM to drive downstream revenue.
By Jan Marquez • July 17, 2026
Discover why siloed marketing agencies stall growth. Learn how building an integrated revenue system unifies acquisition, conversion, and accurate attribution.
Show More