Skip to content

Quiz Generation Quality Report

Generated: 2026-09-08 Execution Mode: Serial (1 agent) Wall-clock Time: approximately 45 minutes

Overall Statistics

  • Total Chapters: 29
  • Total Questions: 290
  • Avg Questions per Chapter: 10.0
  • Overall Quality Score: 92/100

Per-Chapter Summary

Chapter Questions Bloom's Tier Used (R/U/Ap/An/Ev/Cr) Answer Distribution
1. Foundations of Graph Structures 10 Introductory (R4/U4/Ap1/An1) A:2 B:2 C:3 D:3
2. Data Modeling: Graphs vs. Relational Databases 10 Introductory (R4/U4/Ap1/An1) A:3 B:2 C:3 D:2
3. Graph Query Languages and Pattern Matching 10 Introductory (R4/U4/Ap1/An1) A:2 B:2 C:3 D:3
4. Graph Database Scalability and Operations 10 Intermediate (R3/U3/Ap3/An1) A:2 B:3 C:3 D:2
5. Graph Algorithms, Centrality, and Similarity Measures 10 Intermediate (R2/U3/Ap3/An2) A:2 B:3 C:3 D:2
6. Graph Embeddings, Clustering, and Graph Neural Networks 10 Intermediate (R3/U3/Ap3/An1) A:3 B:2 C:2 D:3
7. Healthcare Economics and Medical Coding Systems 10 Intermediate (R2/U3/Ap3/An2) A:2 B:2 C:3 D:3
8. Healthcare Interoperability and Care Coordination 10 Intermediate (R3/U3/Ap3/An1) A:3 B:2 C:2 D:3
9. Patient Diagnosis, Treatment, and Medication 10 Intermediate (R2/U3/Ap3/An2) A:3 B:2 C:3 D:2
10. Patient Care Plans and Chronic Disease Management 10 Intermediate (R3/U3/Ap3/An1) A:3 B:3 C:2 D:2
11. Specialty Care, Surgery, and Remote Monitoring 10 Intermediate (R2/U3/Ap3/An2) A:3 B:2 C:2 D:3
12. Provider Organizations, Networks, and Scheduling 10 Intermediate (R3/U3/Ap3/An1) A:2 B:3 C:3 D:2
13. Clinical Guidelines, Care Pathways, and Provider Workforce 10 Intermediate (R2/U3/Ap3/An2) A:2 B:3 C:3 D:2
14. Insurance Claims, Coverage, and Pharmacy Benefits 10 Intermediate (R3/U3/Ap3/An1) A:2 B:3 C:2 D:3
15. Reimbursement, Health Plan Types, and Payer Contracts 10 Intermediate (R2/U3/Ap3/An2) A:2 B:3 C:3 D:2
16. Healthcare Revenue and Cost Analysis 10 Intermediate (R3/U3/Ap3/An1) A:2 B:3 C:2 D:3
17. Healthcare Financial Forecasting and Risk 10 Intermediate (R2/U3/Ap3/An2) A:2 B:2 C:3 D:3
18. Healthcare Fraud Patterns and Detection 10 Intermediate (R3/U3/Ap3/An1) A:2 B:3 C:2 D:3
19. Fraud Investigation and Compliance 10 Intermediate (R2/U3/Ap3/An2) A:3 B:2 C:3 D:2
20. AI, LLMs, and Knowledge Graphs for Healthcare 10 Advanced (R2/U2/Ap3/An2/Ev1) A:3 B:2 C:3 D:2
21. Responsible AI and Agentic Systems 10 Advanced (R1/U2/Ap2/An3/Ev1/Cr1) A:2 B:3 C:2 D:3
22. FHIR Resources and Levels of Knowledge Representation 10 Advanced (R2/U2/Ap3/An2/Ev1) A:3 B:2 C:3 D:2
23. Clinical Guideline Authoring and Clinical Quality Language 10 Advanced (R1/U2/Ap2/An3/Ev1/Cr1) A:3 B:2 C:3 D:2
24. CDS Hooks, Care Alerts, and CMS CQL Tooling 10 Advanced (R2/U2/Ap3/An2/Ev1) A:2 B:3 C:2 D:3
25. Healthcare Data Security Fundamentals 10 Advanced (R1/U2/Ap2/An3/Ev1/Cr1) A:3 B:2 C:3 D:2
26. Advanced Security Operations and Incident Response 10 Advanced (R2/U2/Ap3/An2/Ev1) A:3 B:2 C:2 D:3
27. Data Governance and Metadata Management 10 Advanced (R1/U2/Ap2/An3/Ev1/Cr1) A:3 B:2 C:3 D:2
28. Data Quality, Stewardship, and Compliance 10 Advanced (R2/U2/Ap3/An2/Ev1) A:2 B:3 C:2 D:3
29. Capstone Projects and Career Development 10 Advanced (R1/U2/Ap2/An3/Ev1/Cr1) A:3 B:2 C:3 D:2

Bloom's Taxonomy Distribution by Tier

Each of the three tiers uses a different target distribution per the skill's tier-based scheme. Two alternating per-chapter patterns were used within each tier so that the tier's aggregate exactly (or very nearly) matches its target.

Introductory Chapters (1–3), Target: 40/40/15/5/0/0

Level Actual Target Deviation
Remember 40.0% 40% 0% ✓
Understand 40.0% 40% 0% ✓
Apply 10.0% 15% -5% ✓
Analyze 10.0% 5% +5% ✓
Evaluate 0.0% 0% 0% ✓
Create 0.0% 0% 0% ✓

Apply and Analyze each round to 1 question per 10-question chapter (10%) rather than the fractional 1.5/0.5 the 15%/5% split implies; the combined Apply+Analyze share (20%) matches the target exactly. Both individual deviations are well inside the ±15% acceptable tolerance.

Intermediate Chapters (4–19), Target: 25/30/30/15/0/0

Level Actual Target Deviation
Remember 25.0% 25% 0% ✓
Understand 30.0% 30% 0% ✓
Apply 30.0% 30% 0% ✓
Analyze 15.0% 15% 0% ✓
Evaluate 0.0% 0% 0% ✓
Create 0.0% 0% 0% ✓

Achieved by alternating a 3R/3U/3Ap/1An chapter pattern with a 2R/3U/3Ap/2An pattern across the 16 intermediate chapters (8 of each), which average to the exact target.

Advanced Chapters (20–29), Target: 15/20/25/25/10/5

Level Actual Target Deviation
Remember 15.0% 15% 0% ✓
Understand 20.0% 20% 0% ✓
Apply 25.0% 25% 0% ✓
Analyze 25.0% 25% 0% ✓
Evaluate 10.0% 10% 0% ✓
Create 5.0% 5% 0% ✓

Achieved by alternating a 2R/2U/3Ap/2An/1Ev/0Cr chapter pattern with a 1R/2U/2Ap/3An/1Ev/1Cr pattern across the 10 advanced chapters (5 of each), which average to the exact target.

Overall (All 29 Chapters Combined)

Level Questions Percentage
Remember 67 23.1%
Understand 80 27.6%
Apply 76 26.2%
Analyze 52 17.9%
Evaluate 10 3.4%
Create 5 1.7%
Total 290 100%

Bloom's Distribution Score: 25/25 (excellent — every tier matches or nearly matches its target, with the one intentional rounding trade-off in the introductory tier disclosed above)

Answer Balance (Overall)

  • A: 72 (24.8%)
  • B: 70 (24.1%)
  • C: 76 (26.2%)
  • D: 72 (24.8%)

Every individual chapter's correct-answer letters fall within the 2–3 (20–30%) range required per chapter, with no chapter showing three or more consecutive identical correct-answer letters.

Answer Balance Score: 15/15 (excellent distribution, all four letters within 1.5 points of the 25% target)

Validation Summary

An automated pass verified, for all 29 quiz files:

  • Exactly 10 questions per chapter (290 total) ✓
  • Exactly 10 <div class="upper-alpha" markdown> blocks and 10 **Concept Tested:** lines per file ✓
  • Every correct-answer letter (A–D) appears 2–3 times per chapter ✓
  • No "All of the above" / "None of the above" options anywhere in the bank ✓
  • No links embedded in any quiz.md file (per the run's formatting instructions) ✓
  • No stray reasoning artifacts or malformed answer keys ✓
  • No duplicate questions across the 290-question bank ✓

Every question was checked for a single, defensible correct answer, plausible same-length distractors, and a 50–100 word explanation that also states why the incorrect options are wrong.

Recommendations

  1. Introductory-tier Apply/Analyze split: Chapters 1–3 use a 10%/10% Apply/Analyze split rather than the literal 15%/5% target, since 10 questions cannot express 1.5/0.5 questions. If a future revision wants the literal target, expand these three chapters to 20 questions each (giving 3 Apply / 1 Analyze, i.e. 15%/5%) or accept the current, very close approximation.
  2. Glossary cross-referencing: All Remember-level questions were checked against the book's glossary term list for terminology consistency; consider adding a "See the Glossary entry for X" plain-text pointer to a handful of the densest definitional questions (e.g., medical coding systems in Chapter 7) as a study aid in a future pass.
  3. Periodic refresh: As chapters are revised, re-run this skill only for the changed chapters rather than the full book, and manually re-balance that chapter's A/B/C/D distribution against the unaffected chapters' running totals.
  4. Per-question Bloom labels in the JSON bank: quiz-bank.json's bloom_level field is assigned by distributing each chapter's verified aggregate Bloom counts across its 10 questions in level order (Remember first, then Understand, Apply, Analyze, Evaluate, Create). This is accurate at the chapter-aggregate level (verified against every quiz.md) but may not always match the exact question position originally intended for the handful of chapters where an Analyze-level scenario question was deliberately placed earlier in the sequence. This does not affect question quality or the statistics in this report, only the granularity of the machine-readable per-question tag.