The problem with standard SEO reporting
Most SEO reports are built to look good, not to prove causation. Impressions go up because Google indexed more of your pages — not necessarily because rankings improved on queries that matter. Rankings improve on low-volume keywords that drive no traffic. Traffic goes up in Q4 because it always goes up in Q4 for your industry. The report attributes all of it to SEO work.
This isn't always dishonest. Most SEO consultants genuinely believe the metrics they're reporting. But belief isn't proof. A business that grew 15% year-over-year in a market that grew 20% actually underperformed — but without a benchmark, the growth looks like success.
The same problem exists in SEO. If your organic traffic grew 25% after six months of SEO work, that sounds good. But if the average business in your category grew 30% organically over the same period due to market growth and algorithm changes, your SEO underperformed — and nobody told you.
Impressions are the number of times your pages appeared in search results — including at positions 40–100 where nobody clicks. Impressions can double while your traffic stays flat. If your monthly report leads with impressions as the primary success metric, ask for clicks instead.
Metrics that actually prove SEO impact
Not all metrics are equal. Here's how to think about which ones actually demonstrate that SEO work caused a business outcome:
| Metric | What it actually measures | Verdict |
|---|---|---|
| Impressions | How often your pages appear — including at positions where nobody clicks | Weak |
| Average position | Average ranking across all queries, including low-volume ones that don't drive traffic | Weak |
| Domain Authority / DR | Third-party scores that correlate with link profiles — not Google ranking signals | Weak |
| Clicks (GSC) | Actual visits from organic search — people who saw your listing and clicked | Meaningful |
| Clicks on target queries | Clicks specifically on the keywords your SEO work targeted | Strong |
| Organic leads / form submissions | Contacts generated from organic traffic — tied directly to revenue potential | Strong |
| Organic phone calls | Calls attributed to organic search visits — the hardest to fake | Strongest |
The further down that table you can get your reporting, the more confidence you have that SEO is producing real business impact. This is the framework behind measuring SEO ROI correctly — connecting organic performance to revenue, not just to rankings.
The holdout method — separating SEO from everything else
Even clicks and leads don't prove causation on their own. If your organic leads doubled in the six months after you hired an SEO consultant, three things might explain it:
- The SEO work improved your rankings on queries that convert
- Your market grew and more people were searching for your category
- Google's algorithm updated in your favor regardless of your site changes
Without controlling for the second and third explanations, you can't be sure the first is what caused the result. This is the problem quantitative analysts solve with holdout groups — a set of observations that don't receive the treatment, used as a control.
In SEO, a holdout works like this: when you start an optimization program, identify a set of pages that will receive work (the treated group) and a comparable set that won't (the holdout). After 60–90 days, compare how the two groups moved. If the treated pages improved significantly more than the holdout pages, that's evidence the SEO work caused the improvement rather than external factors.
A plumbing company has 40 service area pages. An SEO consultant optimizes 20 of them — new title tags, improved content, schema markup added. The other 20 are left untouched as a holdout. After 90 days, the optimized pages show 35% click growth. The holdout pages show 8% click growth. The difference — 27 percentage points — is the estimated SEO contribution. The 8% the holdout pages gained tells you what would have happened anyway due to market growth or algorithm shifts.
Most consultants don't run holdouts because it creates accountability they'd rather avoid. If the holdout pages improve just as much as the treated pages, the SEO work didn't cause the results. That's an uncomfortable finding to deliver to a client paying a monthly retainer. But it's the honest answer — and it's the only way to know whether the budget is working.
How to run the analysis in GSC yourself
You don't need a data scientist to run a basic version of this analysis. Here's how to do it in Google Search Console with no external tools:
The verdict framework — what the data is telling you
After running the analysis, you'll land in one of four situations:
What to do with the answer
If the SEO is working
Document specifically what worked — which pages, which changes, which queries — so you can replicate the approach. Ask your consultant to apply the same methodology to the next set of pages and set expectations for what "working" looks like before they start, not after. This is how you build compounding SEO results instead of one-off wins.
If the SEO isn't clearly working
Don't immediately fire your consultant. First, check whether enough time has passed — meaningful SEO results typically take 4–6 months, and the holdout analysis is only reliable with at least 90 days of post-work data. If the timeline is right and the signal is flat, have a direct conversation: what specifically has been done, what was the expected outcome, and why does the data show treated pages moving similarly to untouched pages?
A consultant who has been doing genuine work will have specific answers. A consultant who has been sending reports without executing will struggle to answer that question concretely. The vetting framework applies retroactively as well as prospectively.
If you want someone to run this analysis for you
The analysis above is doable in GSC with a spreadsheet. But separating signal from noise accurately — controlling for seasonality, identifying confounders, building the holdout comparison correctly — takes time and familiarity with the data. If you want an independent, honest verdict on whether your past SEO investment produced real results, that's exactly what the SEO Impact Audit delivers.
The SEO ROI Calculator estimates what better rankings could mean in dollars — across three growth scenarios, based on your actual traffic and conversion numbers.
Most SEO reporting is not lying to you — it's just not designed to answer the question you actually care about. "Did this work?" is a causal question. Standard SEO reports answer a correlation question: "did things get better while we were working?" Those are different questions with different answers. The holdout method is how you get the honest one.