Counterfactual Impact Audit
Compare your contribution with what would happen if someone else took your place
- Difficulty
- Advanced
- Time to result
- ~weeks to results
- Steps
- 6
- Confidence
- 93%
Ali defines impact counterfactually: compare the world with your contribution against the plausible world without it. A role can produce obvious good while adding less than it appears if another qualified person would readily fill the same place. Conversely, a person's unusual combination of skills or audience may produce more additional value in a less conventionally prestigious role. Ali applies this reasoning to medicine and online education, arguing that he felt more replaceable as a junior doctor than as the creator of his particular teaching channel. The episode also includes numerical charity and medical-impact claims that are not sourced in the transcript; this framework does not treat those figures as established facts. A sound audit documents substitutes, distinctive advantages, expected outcomes, and uncertainty before comparing options.
Origin
Extracted from The Diary of a CEO
Core principles
- 01Visible good is not the same as additional good
- 02Replaceability changes the value of a contribution
- 03Distinctive skills can create greater incremental impact
- 04Impact estimates should remain explicit about uncertainty
How to run it
- 1
Define the target outcome
State the beneficial change you want the career, project, or donation to produce.
Watch out Avoid using 'impact' without a measurable or observable direction.
- 2
Build the no-action baseline
Describe what would plausibly happen if you did not take this role or fund this option.
Pro tip Include existing institutions, applicants, and alternative providers.
Watch out Do not assume nothing happens without you.
- 3
Estimate replacement
Assess whether another person or resource would produce a similar outcome in your absence.
Watch out Replacement estimates are uncertain and should be labeled as such.
- 4
Identify distinctive leverage
List skills, access, audience, capital, or experience that make your contribution unusually hard to replace.
Pro tip Look for combinations of capabilities rather than prestige.
- 5
Compare additional outcomes
Estimate the difference each option adds above its baseline, including possible harms and opportunity costs.
Watch out Do not import unsourced numerical claims as facts.
- 6
Choose and revisit
Select the stronger counterfactual contribution, record the assumptions, and reassess when evidence changes.
In the wild
Ali argues that another trained applicant could likely have occupied his junior medical role, while his specific YouTube channel combined teaching ability and audience in a less replaceable way. He therefore believed online education might be his stronger counterfactual contribution, while acknowledging that this was his own argument rather than a settled fact.
→ The career comparison focuses on additional contribution and replaceability rather than occupational prestige.
Common mistakes
Counting visible activity as impact
An action's total output can overstate the difference caused by the decision-maker if a substitute would have produced it anyway.
Assuming personal uniqueness
Distinctive leverage needs evidence; confidence or audience size alone does not prove greater net impact.
Using unsupported precision
The transcript mentions specific impact figures without supplying evidence, so they should not be treated as established inputs.
Is it for you?
Best for
It is best for choosing among impact-oriented paths where replacement and comparative advantage differ.
Not ideal for
It is not ideal when outcomes, substitutes, or harms cannot be estimated with enough confidence to support a decision.
From the transcript
“I think of impact in terms of like counterfactual impact”
“What is my impact compared to if I didn't exist?”
From the episode
Productivity Expert: How To Finally Stay Productive: Ali Abdaal