I read a competitor agency's case study last week and noticed, halfway through, that I could not actually tell what had happened. The case study was beautifully laid out. It described the client's challenge in three confident paragraphs. It showed the visual work the agency had produced. It ended with a results section featuring three impressive-looking percentage gains — 180 percent increase in engagement, 240 percent increase in reach, 6x growth in followers — none of which were qualified by baseline numbers, time frames, or attribution methodology. The work looked good. The results looked great. The case study told me almost nothing about whether the engagement had actually been successful.
This is not unusual. It is, more accurately, the standard. The vast majority of agency case studies published in 2026 are highlight reels structured to win sales, not documents structured to inform a reader about what actually happened. They omit, almost without exception, the things that would let a serious prospective client evaluate whether the work would translate to their situation. The omissions are not accidents. They are the entire point. A case study designed for sales has different incentives than a case study designed for honesty, and the published agency conversation has converged on the first kind so completely that the second kind barely exists in the market.
This article is about what the standard case study leaves out, why the omissions persist, and what an honest version of a case study would actually include. The position is uncomfortable for the industry because the structural critique applies to almost every published case study — including, I should acknowledge upfront, the older ones MLHMTECH has produced. The honest path forward requires admitting that the current format is broken and committing to producing case studies that earn their credibility through specificity rather than through visual polish. This is a small bet that almost nobody else is making, which is exactly the reason it might be the most valuable one available. [BACKLINK PLACEHOLDER → internal: link to article #19 (marketing data theater) — both pieces examine how marketing self-presentation drifts toward performance rather than truth.]
Key Takeaways
- Most agency case studies omit the four things that would let a reader actually evaluate them: baseline numbers, time frames, attribution methodology, and what did not work.
- The omissions are structural, not accidental. Case studies are written for sales, not for accountability. The format converged on what wins meetings rather than what informs readers.
- The honest case study would look different in five specific ways. Specific baselines, defined attribution, named time frames, an acknowledgment of failures or surprises, and the qualitative texture that vague percentage claims hide.
- Clients who read case studies critically can spot the omissions in under thirty seconds. Once you know the four things to look for, most case studies reveal themselves as marketing material rather than documentation.
- The bet on honest case studies is structurally underrated. Agencies that produce them stand out almost immediately, because the contrast with the standard format is so visible that readers can feel the difference even without naming it.
The Four Things Case Studies Almost Always Omit
If you read agency case studies critically — looking for what they are not saying rather than what they are — four omissions appear in roughly 90 percent of them. Recognizing these is the fastest way to evaluate whether a case study is documenting work or performing competence.
Omission 1: Baseline Numbers
"180 percent increase in engagement." This sounds impressive. It is also literally meaningless without a baseline. A 180 percent increase from 5 engagements per post to 14 is a different story than a 180 percent increase from 500 to 1,400. Without the starting number, the percentage is rhetoric. With it, the reader can evaluate whether the result is meaningful for their situation.
Almost no case studies include baselines. The omission is so consistent that I have come to read its absence as a signal of either small numbers being hidden or a basic lack of measurement discipline. Either way, the reader cannot evaluate the work, which is the structural function of leaving the baseline out.
Omission 2: Time Frame
"6x growth in followers." Over what period? A six-times follower growth in three months is dramatic. The same growth over three years is unremarkable. The time frame determines whether the result is impressive or ordinary, and case studies routinely omit it for exactly that reason. The reader is meant to read the multiplier and assume the time frame was short. The actual time frame, if specified, would often deflate the apparent achievement.
The honest version of the same result would specify both the time frame and the relevant context. "Follower count grew from 4,200 to 25,400 over 18 months, a period during which the client's vertical saw average industry growth of approximately 2x." This sentence is harder to write and significantly more informative. It is also harder to use as a sales asset, which is why it almost never appears.
Omission 3: Attribution Methodology
"The campaign drove a 40 percent increase in revenue." How was the attribution measured? Multi-touch attribution? Last-click? Self-reported? Time-correlated assumption? Each of these methodologies tells a different story, and the difference between them is often the difference between "the campaign actually worked" and "revenue increased during the campaign period for reasons that may or may not have been related."
Attribution is genuinely hard, and the honest acknowledgment of that difficulty is what separates documentary case studies from marketing material. A case study that names the attribution methodology — and its limitations — is significantly more credible than one that presents a confident causal claim. The omission of methodology is the implicit claim that no methodology was needed, which is almost never true. [BACKLINK PLACEHOLDER → external: a credible piece on marketing attribution methodology, e.g. from HBR, the Ehrenberg-Bass Institute, or a respected analytics publication. Aligns with the $4–9 CPC on marketing and analytics tools.]
Omission 4: What Did Not Work
Almost no case study acknowledges what did not work. Every project I have ever been part of has had at least one element that underperformed, at least one decision that turned out to be wrong, at least one surprise that required mid-course correction. The published case study version of those same projects presents an unbroken arc of strategy producing exactly the intended result. The arc is fiction.
The omission of failure is the single most damning structural feature of the standard case study format. Real projects are messy. Real engagements include misses. A case study that does not acknowledge any failures is either describing a project that did not really happen the way it was depicted, or describing a real project with the messy parts edited out. Either way, the reader is being deprived of the information that would let them evaluate whether the agency actually knows how to handle the inevitable misses on their project.
Why The Omissions Persist
Case studies are written by agencies for sales purposes. The sales function is to convert a prospective client into an active client. Anything in a case study that complicates that conversion — a baseline that reveals small starting numbers, a time frame that contextualizes the multiplier, an attribution caveat that introduces doubt, a documented failure that reveals imperfection — is a sales obstacle. The structural incentive is to remove those obstacles.
This is not malicious. It is structurally rational from inside an industry where case studies compete with other case studies, and every other case study has stripped out the same information. An agency that publishes a case study with baselines, time frames, attribution caveats, and honest acknowledgments of what did not work is competing against case studies that present cleaner numbers and tidier arcs. The honest case study looks worse by direct comparison, even though it is actually more credible to a serious reader.
The result is a published case study format that has converged on the lowest common denominator — visual polish, percentage gains, confident causal language — and that almost nobody is incentivized to break from. The agencies that would benefit most from breaking from it are also the ones least likely to, because they are the most invested in the format that has been working as sales material. [BACKLINK PLACEHOLDER → internal: link to article #20 (forgettable agency websites) — both pieces examine how agency self-presentation has converged on conventions that defeat their own purpose.]
What An Honest Case Study Would Include
If I were producing a case study in a format designed to actually inform a serious reader rather than to win meetings, the structure would look like this.
Specific baselines, in absolute numbers. "Client started with 4,200 followers, $8,500 in monthly revenue from social, and an average save rate of 1.8 percent on Instagram." These numbers let the reader contextualize everything that follows.
Named time frame. "Engagement ran from January 2025 to August 2025, an eight-month period." The reader can now evaluate whether the time frame was reasonable for the results claimed.
Attribution methodology with honest caveats. "Revenue attribution measured via first-touch UTM tagging on Instagram traffic, with the limitation that customers who first encountered us on Instagram but converted via organic search or direct traffic would be undercounted." The reader now knows what the numbers do and do not represent.
Documented surprises and corrections. "The first three months underperformed our initial projections. The hypothesis we started with — that audience growth would track our existing brand voice — proved wrong, and we recalibrated the content strategy in month four. Recovery began in month five." This is the section that most distinguishes honest case studies from sales documents. It is also the section that builds the most credibility, because it demonstrates that the agency knows how to recognize and respond to misses.
Qualitative texture alongside quantitative claims. "The audience growth was real, but the most important outcome was the change in the kind of inbound conversations the client started receiving. Pre-engagement, inquiries came primarily from price-sensitive prospects. Post-engagement, the inquiries shifted toward fit-driven prospects asking about specific capabilities." This kind of detail is what a prospective client actually wants to know, and it almost never appears in standard case studies because it cannot be reduced to a percentage.
A case study structured this way is longer, denser, and harder to skim than the standard format. It is also dramatically more credible, because every claim it makes is supported by the kind of specificity that distinguishes documentation from marketing.
What Clients Should Look For Instead
If you are evaluating an agency and reading their case studies critically, four diagnostic questions cut through the standard format quickly.
Does the case study include baseline numbers? If not, assume the starting numbers were small or unfavorable. Confident agencies share baselines.
Does it name the time frame? If not, assume the time frame was longer than impressive — usually because a shorter time frame would have shown less dramatic results.
Does it explain how outcomes were attributed? If not, the causal claims are not supported by methodology, and the agency may be taking credit for results that had other explanations.
Does it acknowledge anything that did not work? If not, the case study is either describing a project that did not really happen the way depicted or omitting the parts that would reveal the agency's actual experience handling misses.
A case study that fails three or four of these questions is marketing material. A case study that passes all four is documentation. The difference between the two is the difference between an agency you can evaluate and an agency you have to trust on faith. [BACKLINK PLACEHOLDER → external: a credible piece on evaluating agency credibility, e.g. from a B2B publication, a marketing analyst, or a respected procurement resource on selecting creative partners.]
Why The Honest Bet Is Underrated
The reason almost no agencies produce honest case studies is the structural one I described earlier — they look worse in direct comparison against agencies that have stripped out the inconvenient information. The bet on honest case studies is that the readers who matter — serious prospects evaluating fit rather than browsing for the most impressive numbers — recognize the difference and respond to it.
In my experience, this is true more often than the industry assumes. Sophisticated clients evaluating agencies are already skeptical of polished case studies, because they have read enough of them to recognize the format. An honest case study stands out precisely because it is unfamiliar, and the unfamiliarity reads as integrity. The agency that produces case studies with baselines, time frames, attribution methodology, and acknowledged failures is making an implicit claim — we are confident enough in our work to show you what actually happened — that the polished competitors cannot make.
The bet is not that honest case studies will win every prospect. The bet is that they will win the prospects worth winning. The prospects who respond to polished percentage claims are usually the same prospects who churn quickly because the underlying expectations were never accurately set. The prospects who respond to honest documentation are usually the ones who become long-term clients because they entered the relationship with realistic expectations. The trade is dramatically favorable in the medium term, and almost nobody is making it.
