Skip to content

Quiz: Interpreting Validation Evidence

Test your understanding of reading lean-test results honestly with these review questions.

1. Priya's core problem was strongly validated, but her subscription solution collected weak payment signals. According to this chapter, what should Priya do?

  1. Abandon the concept entirely because no part of it has supporting evidence
  2. Pivot the solution — keep the validated problem, change the solution — while preserving what evidence supported
  3. Continue with the subscription solution since the problem itself is validated
  4. Keep testing the same subscription offer until payment signals eventually improve
Show Answer

The correct answer is B. A pivot decision means changing a specific, significant element of the concept — the customer, problem, solution, or pricing — while keeping the parts evidence has actually supported. Priya's problem was validated, but her solution wasn't, so the chapter treats this as a textbook pivot: keep the validated problem, redesign the solution, rather than restarting from nothing or persevering with an unvalidated offer.

Concept Tested: Pivot Decision

See: Glossary

2. What is a persevere decision?

  1. The choice to change a specific, significant element of the concept while keeping validated parts
  2. The choice to abandon an idea entirely due to a lack of supporting evidence
  3. The choice to run one more round of testing before making any decision
  4. The choice to continue with the current concept largely as designed because validation evidence consistently supports it
Show Answer

The correct answer is D. A persevere decision is the choice to continue with the current concept largely as designed, because the accumulated validation evidence consistently supports it. This is distinct from a pivot decision, which changes a specific element, and from the kill decision covered in Chapter 10, which abandons the concept entirely.

Concept Tested: Persevere Decision

See: Glossary

3. Priya has run several lean tests on her subscription idea and now needs to judge whether the accumulated evidence supports or contradicts her original hypothesis before deciding whether to pivot or persevere. Which term names the process Priya is engaged in?

  1. Concept validation — the overall process of determining whether a business concept is supported by real-world evidence, culminating in a specific status
  2. Build-measure-learn — the broader repeating cycle of building, measuring, and learning
  3. A validation milestone — the predefined point at which enough evidence has accumulated
  4. Rapid experimentation — running the loop quickly, in days rather than months
Show Answer

The correct answer is A. Concept validation is the overall process of determining whether a business concept is supported by real-world evidence, culminating in a specific status such as a validated concept or an invalid concept. Build-measure-learn (B) is the broader cycle that produces the evidence, a validation milestone (C) is the predefined checkpoint for judging it, and rapid experimentation (D) is about testing speed rather than judging accumulated evidence.

Concept Tested: Concept Validation

See: Glossary

4. How does this chapter define evidence of demand?

  1. Any signal that real customers actually want a solution, such as interest, engagement, or requests for more information
  2. An actual transfer of money from a customer, however small
  3. A predefined point at which enough evidence has accumulated to make a confident call
  4. The minimum unit of evidence needed to judge a single hypothesis
Show Answer

The correct answer is A. Evidence of demand is any signal that real customers actually want a solution — interest, engagement, or requests for more information. The chapter distinguishes this from a customer payment signal, which is a stronger, more specific form of evidence involving an actual transfer of money.

Concept Tested: Evidence Of Demand

See: Glossary

5. A prospective customer tells Jordan, "That sounds great, I'd definitely book that." Later, a different prospective customer hands Jordan a $40 deposit to reserve a driveway session. Which statement correctly applies this chapter's distinction between these two reactions?

  1. Both reactions count equally as customer payment signals since both express enthusiasm
  2. The verbal comment is a customer payment signal and the deposit is only evidence of demand
  3. The deposit is a customer payment signal, a stronger form of evidence that is far harder to fake than a verbal comment
  4. Neither reaction counts as real evidence until a validation milestone is reached
Show Answer

The correct answer is C. A customer payment signal is a stronger, more specific form of evidence of demand: an actual transfer of money, even a small deposit, which is far harder to fake or misread than a verbal "I'd probably buy that." A stranger can say something sounds great at no cost to them, but handing over money is a dramatically more honest signal.

Concept Tested: Customer Payment Signal

See: Glossary

6. Which statement best explains the build-measure-learn loop as this chapter describes it?

  1. It requires building a finished product before any customer feedback is collected
  2. It is a repeating cycle of building the smallest possible test, measuring real customer behavior, and learning something that shapes the next build
  3. It replaces the need for a test hypothesis once a founder has enough experience
  4. It only applies after a concept has already reached a validation milestone
Show Answer

The correct answer is B. Build-measure-learn is the repeating cycle of building the smallest possible test, measuring what real customers actually do in response, and learning something that shapes the next build. The chapter identifies this as the same loop underneath every Field Discovery Window since Chapter 2, powered by rapid experimentation and low-capital testing.

Concept Tested: Build-Measure-Learn

See: Glossary

7. Jordan wants to test whether neighbors will pay for driveway grooming sessions. Which setup best represents a smallest testable version of that test?

  1. Offering a $40 paid driveway session to five specific neighbors and tracking how many pay a deposit
  2. Offering free grooming to every neighbor on the block to maximize goodwill
  3. Asking one neighbor, in the abstract, whether they like dogs
  4. Building a fully booked grooming business across the entire town before collecting any feedback
Show Answer

The correct answer is A. A smallest testable version is the minimum evidence needed to judge a single hypothesis, sized so the result is neither too small to mean anything nor so large it stops being a lean test. Offering a specific paid session to five specific neighbors directly tests a falsifiable hypothesis like "at least 2 of 5 neighbors will pay a $40 deposit," unlike free giveaways, vague opinions, or a full-scale build-out.

Concept Tested: Smallest Testable Version

See: Glossary

8. A founder has run several lean tests. Which pattern of results would this chapter classify as a validated concept?

  1. A single customer expressed mild interest, but no one has been asked to pay
  2. The founder feels confident about the idea despite mixed test results
  3. Evidence is still being collected and no validation milestone has been reached yet
  4. Accumulated evidence, especially customer payment signals, consistently supports the original hypothesis
Show Answer

The correct answer is D. A validated concept is one where accumulated evidence — especially customer payment signals — consistently supports the original hypothesis. Founder confidence alone, a single interested comment, or incomplete testing do not meet that bar; the chapter insists on reading the evidence itself rather than how the founder feels about the idea.

Concept Tested: Validated Concept

See: Glossary

9. Which situation best illustrates an invalid concept, as this chapter defines it?

  1. A founder decides to pivot the customer definition after weak signals
  2. A test hypothesis has not yet been written down
  3. Evidence consistently contradicts the hypothesis, regardless of how appealing the idea still feels to the founder
  4. A validation milestone has not yet been reached because testing just began
Show Answer

The correct answer is C. An invalid concept is one where the evidence consistently contradicts the original hypothesis, regardless of how appealing the idea still feels to its founder. This is a status reached through concept validation, distinct from simply not having tested enough yet or from deciding to pivot in response to weak signals.

Concept Tested: Invalid Concept

See: Glossary

10. What does low-capital testing mean in this chapter?

  1. Running the build-measure-learn loop with as little money as possible
  2. Running the build-measure-learn loop as quickly as possible, in days rather than months
  3. Testing only concepts that require no customer contact at all
  4. Waiting until enough capital is raised before running any test
Show Answer

The correct answer is A. Low-capital testing means running the build-measure-learn loop with as little money as possible. Jordan's $40 driveway sessions cost almost nothing to run, which is exactly what let three of them happen inside a single Field Discovery Window. This is distinct from rapid experimentation, which is about testing quickly rather than cheaply.

Concept Tested: Low-Capital Testing

See: Glossary

11. How does rapid experimentation differ from low-capital testing, according to this chapter?

  1. Rapid experimentation replaces the need for a test hypothesis, while low-capital testing does not
  2. Rapid experimentation is only used after a concept is validated, while low-capital testing is used before
  3. Rapid experimentation and low-capital testing are two names for the same practice
  4. Rapid experimentation is about running the loop quickly, in days rather than months, while low-capital testing is about running it with as little money as possible
Show Answer

The correct answer is D. Rapid experimentation means running the build-measure-learn cycle quickly, in days rather than months, so a wrong direction gets corrected cheaply. Low-capital testing means running it with as little money as possible. The two habits are related but distinct — one is about speed, the other about cost — and both power the same loop.

Concept Tested: Rapid Experimentation

See: Glossary

12. Which of the following is written as a proper test hypothesis, in the sense this chapter uses the term?

  1. "People will probably like this idea"
  2. "At least 2 of 5 neighbors will pay a $40 deposit for a driveway session"
  3. "This business will eventually succeed"
  4. "Grooming is a good industry to enter"
Show Answer

The correct answer is B. A test hypothesis is the specific, falsifiable prediction a lean test is designed to check. "At least 2 of 5 neighbors will pay a $40 deposit for a driveway session" can be proven wrong by the actual result. The other options are vague sentiments that can't be falsified, so the chapter says they don't qualify as a test hypothesis at all.

Concept Tested: Test Hypothesis

See: Glossary

13. A founder has been testing the same concept for months, saying "let's just run one more test" each time results are mixed. What is this founder missing, according to this chapter's discussion of validation milestones?

  1. A validation milestone requires a customer payment signal, and interest alone is never enough
  2. A validation milestone can only be reached after a pivot decision has already been made
  3. A validation milestone is a specific, predefined point at which enough evidence has accumulated to make a confident call, rather than testing indefinitely out of hesitation
  4. A validation milestone is reached automatically once the build-measure-learn loop has run three times
Show Answer

The correct answer is C. A validation milestone is a specific, predefined point at which enough evidence has accumulated to make a confident call, rather than continuing to test indefinitely out of hesitation. A founder who keeps deferring the decision with "one more test" hasn't set that predefined point, so the evidence never gets to actually settle anything.

Concept Tested: Validation Milestone

See: Glossary