Diagnose a Weak Design

Work from failure mechanism to remedy.

SymptomLikely issueAction
Poor pre-period fitDonors cannot reproduce treated dynamicsRevisit eligibility, geography level, outcome, and comparable history.
Coarse p-value granularityToo few effective placebo assignmentsAdd eligible controls or reduce treated count only if the design permits it.
Dominant fitted donor weightCounterfactual depends on one geographyAudit that donor and run exclusion sensitivity.
High power failure rateSparseSC or DGP instabilityInspect exceptions, rank, panel completeness, and placebo feasibility.
High grid-based MDENoise or weak counterfactual relative to plausible liftRedesign duration, outcome, treated scale, or method before launch.
Interference signalOutcome changes among controls are compatible with contaminationInvestigate exposure using campaign and geographic evidence; the screen is not causal proof.
Result partialMissing uncertainty or warningsResolve the stated fields before decision use.

Do not tune exclusions, dates, or donors by searching for significance. If the remedy changes the design, rerun power and record the new specification.