Note 56 | Design Experiments to Give Assumptions a Chance to Fail
These are Robin Shen’s original reading notes and commentary, written in his own words after reading Bill Aulet’s Disciplined Entrepreneurship: 24 Steps to a Successful Startup. They are not the original book, excerpts from it, or an official publication. Methods and concepts from the book are attributed to Bill Aulet; other sources are identified where stated. For reference only; not investment advice.
English translation of Robin’s Chinese reading notes and commentary. Passages are paraphrased, not verified verbatim quotations from the original English edition.
Chapter 27 separates technical feasibility, largely addressed at Step 22, from whether the business plan works in reality. Aulet emphasizes attempts to disprove assumptions. A successful experiment increases confidence, not certainty. Passing individual tests does not establish that customers will buy the complete product.
Specify supporting and rejecting outcomes in advance. Without that discipline, almost any result can be interpreted as confirmation. Experiments combining many assumptions are harder to interpret and invite retrospective bias, so separate them where possible. Some tests need only a supplier phone call to verify price. For influential customers, observe commitments such as prepayment, deposits, letters of intent, or pilot agreement—not compliments alone. Remain in inquiry mode and do not imply that a finished product is already for sale.
The Ethernet anecdote distinguishes theory from practice. Bob Metcalfe recounts the late co-inventor David Boggs responding at a trade show to models suggesting Ethernet could not work: actual networks were already running. Tested reality matters more to an entrepreneur than untested theory.
Experiments are valuable because they expose problems while correction is cheap. A rejected hypothesis often teaches more than apparent confirmation.
Three actions: Pick one cost assumption, verify the price by phone this week, and define the percentage deviation that would reject it before calling. Ask the most important lighthouse customer for an observable, reversible commitment instead of verbal interest. Do not start an experiment until its support and rejection criteria are written down.
#DisciplinedEntrepreneurship
These are reading notes and reflections based on my personal understanding. I recommend reading them alongside the original book for the full context.
Comments
What do you think? Share your experience or questions.
Sign in to comment, reply or like. Sign in / Sign up
Loading comments…