← All playbooks·Digital attribution
Playbooks · Digital attribution
Measure brand lift between exposed and control groups
This job proves whether a brand campaign moved awareness, recall, or intent among the people it reached, versus people it didn't. It feeds the go/no-go call on renewing or scaling the flight, and the diagnostic split feeds creative and placement optimization within it.
What you need first
- Campaign flight dates and the platform's delivery/exposure log, from the DSP or ad server
- Minimum detectable effect and required sample size per cell, from the platform's or vendor's brand lift power calculator (e.g. Kantar, Dynata, or the walled garden's own tool)
- Control group method, ghost ads/PSA or geo holdout, from the brand lift product spec of the platform running the study
- Baseline awareness, recall, or intent benchmark for the category, from the prior tracking wave or a syndicated tracker
- Media budget and reach forecast, from the media plan
- Significance threshold and confidence level agreed with the client, from the measurement brief
The procedure
- Define the exposed and control cells using ghost ads/PSA or a geo holdout, sized against the platform's minimum detectable effect calculator, producing two audience pools comparable on reach and demo mix
- Set survey questions for aided awareness, ad recall, and purchase intent that match the client's existing brand tracker wording, producing a comparable question set
- Launch the flight with the brand lift tag firing across both cells, producing raw exposure counts and survey response counts per cell
- Hold reporting until the platform's minimum sample threshold is hit per cell, producing a topline result stable enough to read
- Calculate absolute lift (exposed% minus control%) and relative lift (absolute lift divided by control%), producing the headline lift figure per metric
- Run a two-proportion significance test on exposed versus control, producing a p-value and confidence interval per metric
- Segment lift by frequency band, creative, or placement where cell sizes allow, producing a diagnostic breakdown for mid-flight optimization
- Write the result up against the pre-agreed success threshold, producing the go/no-go recommendation for the next flight
Worked through with numbers
Netherlands campaign, €150k budget, 2.4M unique reach forecast. Exposed cell returns 1,850 survey responses, control cell 1,720, both above the platform's minimum sample threshold. Aided awareness: 777/1,850 = 42% exposed, 602/1,720 = 35% control. Absolute lift = 42% - 35% = 7 points. Relative lift = 7/35 = 20%. Pooled proportion p = (777+602)/(1850+1720) = 1379/3570 = 0.386. Standard error = sqrt(0.386 x 0.614 x (1/1850 + 1/1720)) = sqrt(0.237 x 0.00112) = sqrt(0.000266) = 0.0163. Z = 0.07/0.0163 = 4.29, p < 0.0001. Read it as a real, statistically solid 20% relative gain in aided awareness, strong enough to justify scaling the flight, but check the ad recall and intent metrics move in the same direction before calling it a clean win.
Where it goes wrong
- Compare exposed against a true control that could have seen the ad but didn't, using ghost ads or a geo holdout, rather than against the general population, since a population comparison inflates lift with selection bias
- Wait for the platform's minimum sample threshold before reading toplines, since early reads on partial samples can swing the lift number by double digits in either direction
- Rely on the platform's own deduplication for cell assignment, since cross-device and cookie churn will leak exposed users into the control cell if you try to match IDs yourself
- Report the confidence interval alongside relative lift, since a 20% relative lift on a 7-point absolute gap reads very differently from a 20% lift on a 2-point gap and the client needs both numbers to judge it
How to know it is right
The result is right when the p-value clears the agreed threshold, the control cell's demo composition matches the exposed cell within a few points, and the lift direction holds across at least two of the three metrics, not just the headline one.
Terms used