FAQ Quality Report¶
Generated: 2026-09-25
Overall Statistics¶
- Total Questions: 92
- Overall Quality Score: 85/100
- Content Completeness Score (pre-generation assessment): 100/100
- Concept Coverage: 60% (181/300 concepts, case-insensitive match against the learning graph's canonical concept labels)
Category Breakdown¶
Getting Started Questions¶
- Questions: 14
- Share of FAQ: 15.2%
- Dominant Bloom's levels: Remember / Understand
- Typical answer length: ~120–175 words
Core Concepts¶
- Questions: 26
- Share of FAQ: 28.3%
- Dominant Bloom's levels: Understand / Apply, with Remember and Analyze represented
- Typical answer length: ~90–150 words
- Covers all 11 CO.STARTERS Canvas blocks and all 13 non-foundational taxonomy categories (CANV, CUST, PROB, SOL, ALT, VALU, INTV, VALID, MSG, DIST, REV, FIN, LAUNCH) with at least one question each
Technical Detail Questions¶
- Questions: 20
- Share of FAQ: 21.7%
- Dominant Bloom's levels: Remember / Understand
- Typical answer length: ~95–140 words
- Draws terminology directly from
glossary.md, with a secondary link into the chapter that develops the term
Common Challenges Questions¶
- Questions: 12
- Share of FAQ: 13.0%
- Dominant Bloom's levels: Apply / Analyze
- Typical answer length: ~90–160 words
- Framed as troubleshooting scenarios ("why do my interviews...", "what if...")
Best Practice Questions¶
- Questions: 12
- Share of FAQ: 13.0%
- Dominant Bloom's levels: Apply / Evaluate
- Typical answer length: ~95–150 words
- Framed as "how should I..." / "what's the best way to..." recommendations
Advanced Topics¶
- Questions: 8
- Share of FAQ: 8.7%
- Dominant Bloom's levels: Analyze / Evaluate / Create
- Typical answer length: ~100–150 words
- Covers cross-chapter synthesis (multi-channel strategy, B2B adaptation, extending the launch plan into an operational roadmap)
Bloom's Taxonomy Distribution¶
Actual (whole-FAQ) vs. a per-category blended target (each category's own target distribution from the skill's rubric, weighted by that category's share of the 92 questions):
| Level | Actual | Blended Target | Deviation |
|---|---|---|---|
| Remember | 17.4% | 22.6% | -5.2% |
| Understand | 34.8% | 31.3% | +3.5% |
| Apply | 22.8% | 24.2% | -1.4% |
| Analyze | 13.0% | 14.1% | -1.1% |
| Evaluate | 7.6% | 4.6% | +3.0% |
| Create | 4.3% | 3.3% | +1.0% |
Total absolute deviation: 15.2%, within the 11–20% band.
Overall Bloom's Score: 20/25 (good distribution, understand-heavy relative to blended target but within tolerance)
Answer Quality Analysis¶
- Examples: 40/92 (43%) — Target: 40%+ ✓
- Links: 92/92 (100%) — Target: 60%+ ✓ (every answer links to at least one chapter, the glossary, a MicroSim, or a front-matter page; zero anchor-fragment links)
- Avg Length: 107.5 words — Target: 100-300 ✓ (min 76 words, max ~200 words; no answer is a one-liner and none pads past the point)
- Complete Answers: 92/92 (100%) ✓ — every answer stands alone and directly addresses its question
Answer Quality Score: 25/25
Concept Coverage¶
Methodology: each of the 300 canonical concept labels from learning-graph.csv is matched (case-insensitive, word-boundary) against the full FAQ text. This is a conservative proxy — a concept can be genuinely explained without ever using its exact canonical label — so this number understates true pedagogical coverage.
Covered: 181 of 300 concepts (60%). Coverage concentrates on exactly the concepts that matter most: all 10 of the learning graph's highest-indegree ("most depended-upon") concepts are covered — Target Customer, Thirty-Day Launch Plan, Lean Validation, Discovery Interview, Business Idea, Solution Definition, Value Proposition, Problem Definition, Revenue Model, and Messaging Framework — and every one of the 4 foundational (no-prerequisite) concepts is covered. All 11 canvas blocks are named explicitly.
Not covered (119 concepts): every single uncovered concept has an indegree of 0 in the learning graph — meaning no other concept in the course depends on it. These are leaf-level elaborations of an already-covered parent idea (for example, Emotional Benefit and Functional Benefit elaborate the already-covered Customer Benefit/Benefit Block; Interview Scheduling and Interview Sample Size elaborate the already-covered Discovery Interview). See FAQ Coverage Gaps for the full breakdown by taxonomy category.
Coverage Score: 20/30 (60–69% band)
Organization Quality¶
- Logical categorization: ✓ — 6 categories matching the skill's standard structure, with Core Concepts internally organized by the book's 13 non-foundational taxonomy categories in course order
- Progressive difficulty: ✓ — Bloom's level rises category by category, from mostly Remember/Understand in Getting Started to mostly Analyze/Evaluate/Create in Advanced Topics
- No duplicates: ✓ — verified programmatically; no two questions cover the same concept pair from the same angle
- Clear questions: ✓ — every question is phrased as a real, searchable question and uses the book's own terminology
Organization Score: 20/20
Overall Quality Score: 85/100¶
- Coverage: 20/30
- Bloom's Distribution: 20/25
- Answer Quality: 25/25
- Organization: 20/20
Recommendations¶
High Priority¶
None. All high-centrality (high-indegree) concepts are already covered, and all four foundational concepts are covered.
Medium Priority¶
- If the FAQ is expanded later, the
SOL(Solution Design, 13 uncovered),CUST/INTV/MSG/VALU(12 uncovered each) taxonomy categories have the most remaining leaf-concept elaborations — see FAQ Coverage Gaps for candidates. - The Remember/Understand ratio in Core Concepts leans slightly Understand-heavy relative to the category's 20%/40% target; a handful of additional "What is [X]?" definitional questions would rebalance it without changing the total question count much.
Low Priority¶
- Consider 2–3 more Advanced Topics questions if the book adds new cross-chapter capstone material in a future edition.
- As new chapters or MicroSims are added, re-run the concept-coverage check in
faq-coverage-gaps.mdrather than assuming this report stays current.
Suggested Additional Questions¶
Representative candidates drawn from the highest-density uncovered categories (all indegree-0, so purely additive — none are prerequisites the FAQ is currently missing):
- "What's the difference between a Functional Benefit and an Emotional Benefit?" (Core Concepts / VALU)
- "What is Offer Clarity, and how do I know my initial offer has it?" (Core Concepts / SOL)
- "What is an Early Adopter, and why design your first offer for them?" (Core Concepts / CUST)
- "What is a Pain Point, and how is it different from a Problem Statement?" (Technical Detail / PROB)
- "What is Message Testing, and how does it differ from the Five-Second Test?" (Technical Detail / MSG)
- "What is a Revenue Assumption, and how does it get validated?" (Technical Detail / REV)
- "What is Launch Readiness, and how do I know I've reached it?" (Advanced Topics / LAUNCH)
- "What's the difference between Direct Sales, Marketplace, and Partnership channels?" (Technical Detail / DIST)
- "What is a One-Time Need versus Cost Estimation for it?" (Technical Detail / FIN)
- "What is Interview Synthesis, and how is it different from a single Interview Finding?" (Common Challenges / INTV)