Content Portfolio Testing Loop
Test formats broadly, then multiply the proven winners
- Difficulty
- Easy
- Time to result
- ~weeks to results
- Steps
- 5
- Confidence
- 97%
The Content Portfolio Testing Loop uses publishing volume as market research. Instead of assuming a preferred format will work, create a portfolio of distinct approaches: interviews, talking-head videos, day-in-the-life posts, client stories, or other relevant pillars. Publish enough of each format to let platforms return comparative evidence. The purpose of quantity is not permanent output volume; it is to expose which ideas repeatedly outperform. Remove personal attachment from the review, cut the formats that fail to connect, and concentrate production on the one or two patterns that consistently win. Then increase those winners threefold, fivefold, or tenfold while continuing to test variations within them. The loop converts early creative breadth into a focused niche supported by observed audience behavior rather than intuition alone.
Origin
School of Hard Knocks tried seven or eight content types before its first interview reached 100,000 views and subsequent interviews kept outperforming the alternatives.
Core principles
- 01Quantity creates the data needed to discover quality
- 02Early variety reveals audience preference
- 03Platforms provide evidence through relative performance
- 04Winning formats deserve disproportionate investment
How to run it
- 1
Build a format portfolio
Choose several formats or content pillars that express the same underlying brand from meaningfully different angles. Make each distinct enough to produce a useful comparison.
Pro tip Include differences in structure, not just different topics inside the same talking-head format.
Watch out One format tested once is not reliable evidence.
- 2
Publish for signal
Produce enough examples to observe how each format performs. Treat the initial quantity as an experiment rather than a permanent cadence.
Pro tip Keep basic production standards consistent so quality differences do not overwhelm the format test.
Watch out Do not change every variable at once.
- 3
Read relative performance
Compare the formats and identify which ones repeatedly earn stronger audience response. Look for consistency rather than one isolated spike.
Pro tip Cold-audience performance is a useful check against results inflated by existing followers.
Watch out Personal preference is not a substitute for platform evidence.
- 4
Prune the weak formats
Stop or reduce formats that repeatedly fail to connect. Preserve the resources and attention for approaches showing a real signal.
Watch out Do not call a format dead before publishing enough comparable attempts.
- 5
Multiply the winner
Increase output in the strongest format by three, five, or ten times. Continue testing hooks, subjects, and execution within that proven structure.
Pro tip Scale the pattern that won, not a frozen copy of one successful post.
Watch out A niche can still decay if its execution stops evolving.
In the wild
School of Hard Knocks began by trying multiple kinds of business content. Interviews were only the seventh or eighth format tested, but the first interview earned 100,000 views and later interviews continued to outperform. The team treated that repeated response as a signal, made interviews the core format, and expanded it rather than staying attached to its original business-advice content.
→ The interview format became the foundation of a channel with 22 million followers.
Common mistakes
Choosing a niche before testing
Committing to the first format can trap a creator in an approach the audience has not validated.
Scaling a single spike
One unusually strong post may be noise; look for repeated outperformance before concentrating resources.
Confusing quantity with the goal
Volume is useful for collecting data early, not a reason to publish weak work indefinitely.
Is it for you?
Best for
New or repositioning creators who do not yet know which format or content pillar resonates.
Not ideal for
Established channels with a proven format when broad experimentation would confuse a tightly defined audience.
From the transcript
“early on I like to say quantity breeds quality. The more you post, the more data that you're going to get from the platforms”
“early on test different formats, test different content pillars. Don't just do one.”
“Three of them are just not hitting, but these two are doing very well. Okay, let's double down. Let's 3x, 5x, 10x that winning type…”
From the episode
Episode 547: James Dumoulin: The Kid Who Built an 8-Figure Business By Asking Billionaires How Much They Make
James Dumoulin