Seven Signs a Success Story Is Manufacturing Certainty

Reconstruct the claim from selection through headline

Capture the case purpose, eligible population, invitation, consent or permission, baseline, intervention, support, external events, evidence, outcome, analysis, edits, headline, relationships, publication, and follow-up. Write the strongest conclusion a reasonable reader may draw from the complete presentation.

Mark each sign observed, absent, or unresolved. Missing records do not prove fabrication, and one case rarely supports broad attribution. Do not contact or identify participants unnecessarily. This is an editorial diagnosis, not a scientific validation or legal investigation.

Evidence: U.S. Department of Health and Human Services Office for Human Research Protections; U.S. Federal Trade Commission; Society of Professional Journalists

Sign 1: the project starts with a verdict to prove

The brief asks for a dramatic success, return figure, transformation, or endorsement rather than a bounded learning question. Interview prompts search only for benefits, and contradictory experience is treated as off-topic. The case becomes a vehicle for a preselected claim.

Recover the original brief and question set. Rewrite the purpose as an inspectable reader decision, list disconfirming evidence, and define an inference ceiling. If the campaign cannot tolerate a mixed or negative result, it is not a credible case-study process.

Evidence: Society of Professional Journalists; U.S. Office of Management and Budget / Performance.gov

Sign 2: selection begins after the winners are known

Only high performers, satisfied respondents, unusually engaged users, or customers nominated by sales are invited, while the page implies a broad customer pattern. Incentives may depend on favorable sentiment, or criticism may be routed away from publication. A selected success can still teach, but its selection must be visible.

Reconstruct eligibility, invitation, response, decline, exclusion, incentive, and denominator where data exists. Do not invent a response rate. Label the artifact as a selected example and remove prevalence language when representativeness is unsupported.

Evidence: U.S. Federal Trade Commission; Society of Professional Journalists

Signs 3 and 4: the baseline is vague and several causes become one

Sign 3 appears when the starting state, prior trend, measurement window, product version, or constraints are absent. Sign 4 appears when training, staff support, process change, seasonality, budget, market conditions, or other interventions occur alongside the named product but disappear from attribution.

Build a timeline with sources and actors. Separate what changed, when, and who contributed. A before-and-after pair without comparable measurement cannot establish the product caused the difference. Keep alternative explanations and missing observations in the visible limitations.

• Starting value or condition undefined.
• Outcome window selected after the result.
• Unusual vendor support omitted.
• External change collapsed into product impact.

Evidence: Society of Professional Journalists; U.S. Office of Management and Budget / Performance.gov

Sign 5: the outcome is a proxy, a peak, or a short window

Clicks substitute for customer value, completion substitutes for retained skill, revenue omits cost, satisfaction represents one transaction, or the best week is presented as sustained improvement. Definitions and time horizons drift between evidence and headline. Qualitative experience is converted into an unsupported percentage.

Write each outcome, source, calculation, population, missing data, window, and relationship to the decision. Use transaction, journey, and relationship feedback at their proper level. OMB Section 280 provides a federal customer-experience reference for those levels, not a private-sector evaluation mandate.

Evidence: U.S. Office of Management and Budget / Performance.gov; Society of Professional Journalists

Sign 6: one account becomes causation and typicality

Language moves from “the participant reported” to “the product delivers,” or from “can” to “will.” A dramatic story, visual, or title may make the result look ordinary even when a qualifier says outcomes vary. Consequential claims receive no specialist scrutiny.

Separate observation, report, interpretation, causal hypothesis, and typical-result claim. Trace each to appropriate evidence. The FTC review and testimonial rule Q&A supplies U.S. context for testimonial integrity; it does not itself validate the case or substitute for substantiation.

Evidence: U.S. Federal Trade Commission; Society of Professional Journalists

Sign 7: permission, relationships, and correction disappear after launch

The subject did not understand commercial reuse, free product or affiliate relationships are remote, material edits lack a log, withdrawal requests have no route, or obsolete outcomes continue across partner assets. A case becomes frozen marketing even when the product and evidence change.

Create a propagation map and compare approved consent or permission with every use. Correct the first misleading transformation, then all derivatives. Recheck by 2027-02-10 and after consent, relationship, product, evidence, outcome, or law changes. HHS consent guidance remains limited to regulated research and is used only as a process reference.

Evidence: U.S. Department of Health and Human Services Office for Human Research Protections; U.S. Federal Trade Commission; Society of Professional Journalists