Measure-Before-You-Believe Efficacy Filter
Require a logical mechanism and a measurable organism-level result.
- Difficulty
- Easy
- Time to result
- ~weeks to results
- Steps
- 6
- Confidence
- 97%
The Measure-Before-You-Believe filter begins with a causal claim: if an intervention truly improves a biological pathway, what organism-level output should change? Establish that output before treatment, apply a defined protocol, and repeat the same measurement afterward. For a growth-hormone peptide, serum IGF-1 can serve as a stable downstream marker. For a purported mitochondrial optimizer, resting metabolic rate may test a claimed increase in fuel utilization. A mechanistically interesting intervention that produces no meaningful human-level change should be downgraded, even if tiny cellular effects remain possible. The filter also recognizes a marketing hazard: products tied to outcomes that cannot be quantified are difficult for consumers to disprove. The output is a disciplined keep, modify, or discard decision based on measurable efficacy.
Origin
Extracted from Habits & Hustle during Dr. Jonathan Schoeff's comparison of measurable growth-hormone peptides with MOTS-c and other difficult-to-verify longevity products.
Core principles
- 01A proposed intervention should follow a logical biological mechanism.
- 02The claimed effect should produce a measurable organism-level change.
- 03Baseline and follow-up measurements are necessary to attribute change.
- 04Unmeasurable claims are unusually easy to market and difficult to falsify.
- 05Small theoretical activity is not the same as meaningful human benefit.
How to run it
- 1
Write the Mechanistic Claim
Describe what biological pathway the intervention is supposed to change and how that should affect the whole person.
Pro tip Use an explicit input-to-process-to-output statement.
Watch out A scientific-sounding pathway without a predicted output is not yet a testable claim.
- 2
Select a Valid Output
Choose a biomarker, performance test, or physiological measure that should change if the claim is meaningful.
Pro tip Favor stable downstream measures over volatile direct measurements.
Watch out Do not choose an output merely because it is easy to collect.
- 3
Capture Baseline Data
Measure the output before exposure under repeatable conditions.
Pro tip Use multiple baseline readings when the measure varies substantially day to day.
Watch out Without a baseline, later improvement cannot be confidently attributed.
- 4
Run a Defined Protocol
Specify product, dose, frequency, and duration while limiting avoidable confounders.
Pro tip Choose an evaluation interval long enough for the proposed mechanism to act.
Watch out Changing several interventions simultaneously makes attribution difficult.
- 5
Retest and Compare
Repeat the original test under comparable conditions and compare the result with the predicted change.
Pro tip Look for a meaningful organism-level effect, not merely statistical or theoretical activity.
Watch out Subjective enthusiasm should not override contradictory measurements.
- 6
Decide From the Evidence
Continue, modify, or stop the intervention according to whether the expected benefit appeared and justified its cost and risk.
Pro tip Document a stopping rule before starting.
Watch out Do not rescue a failed result with an untestable claim that something small might still be happening.
In the wild
A clinician measures IGF-1, begins a six-week tesamorelin protocol, and repeats IGF-1 under comparable conditions. A large expected increase supports biological efficacy, while a nominal change would weaken the case for continuing the intervention.
→ The product is judged by a measurable downstream effect rather than reputation.
A person measures resting metabolic rate weekly while using a high-dose mitochondrial peptide. The measure does not change, so the intervention is not credited with meaningful improvement in whole-body fuel utilization.
→ An appealing mechanism is rejected when it fails to create the predicted organism-level result.
Common mistakes
Picking an Unmeasurable Promise
Claims with no valid outcome measure allow ineffective products to evade falsification.
Confusing Mechanism With Benefit
Activity at a small biological scale does not prove that the intervention meaningfully changes the person.
Testing Without a Baseline
A follow-up number alone cannot show whether the intervention produced a change.
Is it for you?
Best for
It is best for evaluating peptides, supplements, devices, and other interventions that make testable physiological claims.
Not ideal for
It is not ideal when the desired outcome is inherently subjective or when no valid measurement yet exists.
From the transcript
“If you can't measure or quantify something, it's real hard to prove that something is or isn't working.”
“The common threat is you can measure a difference. There is an organism level effect.”
“but if it's not having a meaningful impact on the human, why are you taking it?”
From the episode
Episode 575: Dr. Jonathan Schoeff: Peptides and the Marketing Behind Modern Longevity - Part 2
Dr. Jonathan Schoeff