Note 14 | Qualitative Before Quantitative; Behavior Before Words
These are Robin Shen’s original reading notes and commentary, written in his own words after reading Bill Aulet’s Disciplined Entrepreneurship: 24 Steps to a Successful Startup. They are not the original book, excerpts from it, or an official publication. Methods and concepts from the book are attributed to Bill Aulet; other sources are identified where stated. For reference only; not investment advice.
English translation of Robin’s Chinese reading notes and commentary. Passages are paraphrased, not verified verbatim quotations from the original English edition.
One common research mistake is starting with a survey. Aulet recommends qualitative exploration first, quantitative testing second. Use a few open-ended conversations to explore pain, fears, and motivations. Ask about a good day, a bad day, or the last time someone completed a task, then ask why. Later, use structured surveys and larger samples to confirm, reject, or defer hypotheses. Drazen Prelec notes that small samples can be better for forming hypotheses because this stage requires probing causes.
Aulet identifies five traps: no structured process, not actually meeting people, confirmation bias, selection bias, and social desirability bias. Friends may be polite rather than honest. Enthusiastic supporters may be unrepresentative. MIT Sloan’s Catherine Tucker suggests that research should surprise you; no surprise may mean no learning. Duncan Simester emphasizes measuring perceived value, actual value, and the gap between them.
Behavior matters more than statements. Observe people, immerse yourself in their setting, and use landing pages and A/B tests. Listen empathetically rather than pitching. Do not lead respondents or seek commitments during discovery. Customers do not design the product; you must understand their pain. The jobs-to-be-done perspective developed by Anthony Ulwick and popularized by Clayton Christensen likewise focuses on the measurable outcomes customers seek.
When founders say customers love the idea, I ask how many changed their behavior or would prepay. Approval is talk; payment and changed behavior are evidence.
Three actions: Conduct five open-ended interviews this week without a product deck, then form hypotheses. Define confirmation and rejection criteria in advance; do not move them midway through interviews. Follow positive statements with at least one behavioral signal: a deposit, an implemented trial, or willingness to introduce two peers.
#DisciplinedEntrepreneurship
These are reading notes and reflections based on my personal understanding. I recommend reading them alongside the original book for the full context.
Comments
What do you think? Share your experience or questions.
Sign in to comment, reply or like. Sign in / Sign up
Loading comments…