Measurement and Attribution Under US Privacy Constraints

Sharing is caring!

Every advertising platform reports on its own performance, using its own attribution, and each one claims the conversions it can see. Add the claims together and most companies find they sold considerably more than they actually sold. That arithmetic failure sits underneath nearly every measurement problem in US marketing, and nineteen or more state privacy regimes degrading the underlying signal has made it worse rather than better. The response is not a better attribution model. It is measuring things the platforms do not control.

A capability page from Digital, Ecommerce & Performance Marketing in the United States. This page ties together the measurement threads running through the other capability pages. Last reviewed August 2026.

19+State privacy regimes degrading signal
56%Of US brands changed strategy for privacy
$361.9BUS digital ad spend being measured
$62BRetail media, where purchase is observable
>100%Typical sum of platform-claimed conversions
91.5%Of display bought programmatically

1. The double-counting problem

A customer sees a social ad, later clicks a search ad, and buys. Both platforms record a conversion. Neither is lying — each reports what it observed within its own attribution window — but the business had one sale.

Add up the platform reports and you outsold yourself Illustrative of the mechanism, not measured data Search claims Social claims Retail media claims Affiliate claims Actual orders the only real number Nobody is lying. Each platform reports what it saw inside its own window. Illustrative. The size of the overlap varies by channel mix, attribution windows and purchase cycle length.

Illustrative of overlapping platform attribution claims. The magnitude varies considerably by channel mix and attribution window settings; the mechanism is universal.

Your order count is the only number in the entire reporting stack that nobody is incentivised to inflate. Start there and work backwards.

2. Attribution is not measurement

These two words get used interchangeably and mean different things. Attribution assigns credit for a conversion that happened. Measurement establishes whether the conversion would have happened anyway.

QuestionAttribution answersMeasurement answers
Who gets credit?YesNot directly
Would it have happened anyway?NoYes
Should I spend more here?Implies an answerActually answers it
What happens if I stop?Cannot sayCan be tested
Speed of answerImmediateWeeks
Who provides itThe platform selling the mediaYou

Distinction between attribution and incrementality measurement. Operational framing.

The last row is the important one. Attribution arrives free from a party with a commercial interest in the answer. Measurement costs you time and volume, and it is the only version that survives scrutiny.

3. The three questions worth answering

Most measurement programmes fail because they try to answer everything. Three questions cover almost all real decisions.

QuestionMethodFrequency
Is this channel producing incremental sales?Geo holdoutOnce or twice a year per channel
What is our real cost per order?Contribution margin against total spendMonthly
What happens at the margin?Budget step testQuarterly

Prioritised measurement questions. Operational judgement — the third is the most neglected and often the most useful for budget decisions.

The third question deserves attention. Average return tells you nothing about what the next dollar does. A channel returning well on average may be saturated, with incremental spend producing far less than the average implies.

4. Geo holdout testing

Geographic holdouts are the most defensible measurement available to most advertisers, because they are platform-independent and measure total business outcome rather than attributed conversions.

Design elementRequirementCommon failure
Matched marketsSimilar baseline behaviourComparing unlike regions
Baseline periodMeasured before the testRetrofitting a control
DurationLonger than the purchase cycleStopping too early
IsolationNothing else changesA promotion runs mid-test
Outcome metricTotal sales, not attributedMeasuring platform conversions
ScaleEnough volume to detect changeToo small to be conclusive

Design requirements for geographic holdout testing. Operational guidance; statistical design should be validated for your volume before relying on the result.

The most common failure is the second row. A control group chosen after the campaign has run is not a control group, and no amount of analysis fixes that.

5. Incrementality on branded terms

Branded search is the single highest-value incrementality test available, and the one most companies avoid because the result is often uncomfortable.

People searching your brand name have already decided to find you. Paying to appear above your own organic result may be capturing demand you already owned. The test is simple: pause branded paid search for a defined period and watch total conversions rather than paid conversions.

If paid brand conversions fall 80% and total conversions fall 4%, you have found a budget line that was mostly buying traffic you already had.

There are legitimate reasons to keep bidding — competitors bidding on your name, controlling the message, protecting against misleading ads. But those are strategic reasons, and they should be chosen knowingly rather than justified by a conversion count that was never incremental.

6. Marketing mix modelling, honestly

Marketing mix modelling has returned to fashion because it needs no user-level tracking, which makes it resilient to privacy fragmentation. That is a genuine advantage and it comes with genuine limits.

StrengthLimitation
No user-level data requiredNeeds substantial historical data
Covers offline and untracked channelsCoarse; cannot see campaign detail
Whole-business viewSlow to produce and refresh
Resistant to signal lossCorrelational, not experimental
Board-friendly outputSensitive to modelling choices

Assessment of marketing mix modelling in current conditions. Operational judgement; model quality depends heavily on data history and specification.

The useful position is that modelling and experimentation answer different questions and validate each other. A model that disagrees with a clean geo holdout should be re-examined, not defended.

7. The measurement stack that works

LayerPurposeCadence
Actual orders and revenueThe ground truthDaily
Contribution margin per orderWhether growth is profitableMonthly
Platform reportingOptimisation signal onlyDaily, never summed
Self-reported attributionCatches untracked influenceContinuous
Incrementality testsCausal reads by channelRolling programme
Mix modellingWhole-business allocationQuarterly or annually

Layered measurement approach. The third row carries the key instruction: platform reporting is useful for optimising within a platform and should never be aggregated across platforms as a revenue claim.

8. What to report to a board

Marketing reporting frequently fails upward: it presents platform metrics to people who need business metrics, which erodes credibility every time the two diverge.

Do not reportReport instead
Summed platform ROASTotal revenue against total marketing cost
Attributed conversionsActual orders
Impressions and reachCost per acquired customer
Channel-level ROAS in isolationContribution margin after acquisition
Lead volumePipeline or revenue created
Engagement rateIncrementality test results

Reporting guidance. Operational judgement based on the divergence between platform-reported and business-reported outcomes.

9. What this page does not cover

Not coveredWhy
Statistical test designRequires proper statistical review
Specific MMM methodologiesSpecialist discipline
Analytics platform configurationVendor-specific and versioned
Consent implementationLegal and technical specialism
Whether a data use is lawfulDepends on state and practice

Scope statement. Test design in particular benefits from statistical review — an underpowered experiment produces a confident-looking result that means nothing.

10. The 90-day measurement rebuild

Ground truth first, models last: 90 days Day 0 Day 30 Day 60 Day 90 Reconcile platform claims to real orders Add self-reported attribution field Branded search holdout Design first geo holdout properly Run and read the test Rebuild board reporting Red = ground truth, amber = experiments, green = results, grey = reporting. Indicative.

Indicative sequencing. Reconciliation comes first because it is free, immediate, and usually reveals the size of the problem better than any argument about methodology.

11. Mistakes to avoid

MistakeWhy it happensWhat it costs
Summing conversions across platformsEach report looks authoritativeClaims more sales than occurred
Treating attribution as measurementThe words get conflatedNever learns what is incremental
Retrofitting a control groupTest was not plannedResult is not interpretable
Judging on average returnIt is the reported numberIgnores what the next dollar does
Avoiding the branded search testThe answer may be unwelcomeProtects a budget line indefinitely
Defending a model against an experimentInvestment in the modelChooses comfort over evidence

Recurring errors in marketing measurement; illustrative.

12. What changes in 2027

Modelling replaces tracking further. As state privacy regimes multiply without a federal standard, user-level measurement continues shrinking and modelled or experimental approaches become the default rather than the supplement.

Retail media keeps offering the cleanest read. Closed-loop environments where the retailer observes purchase remain the strongest attribution available — bounded, as ever, by that retailer’s footprint.

Experimentation becomes routine. As platform-reported numbers become less defensible, running structured holdouts moves from advanced practice to something mid-market advertisers do as a matter of course.

Key Takeaways

  • Never sum conversions across platforms. Each claims what it saw in its own window; added together they exceed your actual sales.
  • Your order count is the only number nobody is incentivised to inflate. Start there and reconcile backwards.
  • Attribution assigns credit; measurement establishes causality. The first arrives free from a party selling you media.
  • Geo holdouts are the most defensible method available because they are platform-independent and measure total business outcome.
  • A control group chosen after the campaign is not a control group. Design the test before spending.
  • The branded search holdout is the highest-value test and the most avoided, because the result is frequently uncomfortable.
  • Average return says nothing about the next dollar. Test at the margin before scaling a channel.

Frequently Asked Questions

Why do my platform reports add up to more sales than I made?

Because each platform reports conversions it observed within its own attribution window, and a single customer often touches several channels. No platform is misreporting; the totals simply cannot be added together as though each conversion were distinct.

What is the difference between attribution and incrementality?

Attribution assigns credit for a conversion that happened. Incrementality establishes whether it would have happened anyway. Only the second answers whether spending more is worthwhile, and only the second requires you to run a test rather than read a report.

How do I run a geo holdout?

Pick matched markets with similar baseline behaviour, measure that baseline before starting, run for longer than your purchase cycle, change nothing else during the test, and compare total sales rather than attributed conversions. Validate the design statistically for your volume.

Should I stop bidding on my own brand name?

Test it before deciding. Pause branded paid search for a defined period and watch total conversions rather than paid conversions. There are legitimate strategic reasons to keep bidding, but they should be chosen knowingly rather than justified by conversions that were never incremental.

Is marketing mix modelling worth doing?

It has real value because it requires no user-level data, which makes it resilient to privacy fragmentation. But it is correlational and coarse. Use it alongside experiments, and if a model disagrees with a clean holdout test, re-examine the model.

What should I report to leadership?

Business metrics: total revenue against total marketing cost, actual orders, cost per acquired customer, contribution margin after acquisition, and incrementality results. Summed platform ROAS erodes credibility every time it diverges from the finance numbers.

Is platform reporting useless then?

No — it is essential for optimising within a platform, since the algorithm needs conversion signal to learn from. The error is treating it as a revenue claim or aggregating it across platforms as though the numbers were independent.

What is the cheapest measurement improvement?

Reconciling platform-claimed conversions against your actual order count. It costs nothing, takes an afternoon, and usually demonstrates the scale of the problem more persuasively than any methodological argument.

How often should incrementality tests run?

As a rolling programme rather than a one-off — roughly once or twice a year per major channel, since market conditions, competition and saturation all change. A test result from two years ago describes a market that no longer exists.

Conclusion

Marketing measurement in the US has arrived somewhere genuinely awkward: the tracking that made attribution feel scientific has degraded, and the platforms still producing confident numbers are the ones selling the media. Meanwhile budgets are cooling and costs are rising, which makes the quality of these decisions matter more than it did when everything was cheap.

The way through is not a better model. It is accepting that the most trustworthy number in the business is the order count, that the only way to learn what a channel truly contributes is to turn it off somewhere and watch, and that a biased self-reported field on a form frequently reveals more than a dashboard built on partial data. That is a less satisfying answer than a unified attribution platform. It is also the one that holds up when someone from finance asks a hard question.

Work With Me

If your channel reports look healthy and your finance numbers disagree, the reconciliation between them is where the real conversation starts.

Comments

comments

Sharing is caring!

Leave a Reply