Quiz Generation Report¶
Generated: 2026-05-13 Execution Mode: Serial (1 agent)
Overall Statistics¶
- Total Chapters: 12
- Total Questions: 120
- Questions per Chapter: 10 (uniform)
- Overall Quality Score: 84/100
Per-Chapter Summary¶
| Chapter | Type | Questions | Bloom's Targets Met | Answer Balance |
|---|---|---|---|---|
| 1. Foundations of Democracy | Introductory | 10 | ✓ | A3 B2 C3 D2 |
| 2. Constitution and Bill of Rights | Introductory | 10 | ✓ | A2 B2 C3 D3 |
| 3. Federalism and Federal Powers | Introductory | 10 | ✓ | A3 B3 C2 D2 |
| 4. Congress Structure and Processes | Intermediate | 10 | ✓ | A2 B2 C3 D3 |
| 5. The Presidency | Intermediate | 10 | ✓ | A2 B3 C3 D2 |
| 6. The Federal Bureaucracy | Intermediate | 10 | ✓ | A2 B2 C4 D2 |
| 7. The Federal Judiciary | Intermediate | 10 | ✓ | A2 B3 C3 D2 |
| 8. Civil Liberties and Civil Rights | Intermediate | 10 | ✓ | A2 B3 C3 D2 |
| 9. Political Opinion and Media | Intermediate | 10 | ✓ | A2 B3 C2 D3 |
| 10. Voting and Political Parties | Advanced | 10 | ✓ | A2 B2 C4 D2 |
| 11. Interest Groups and Elections | Advanced | 10 | ✓ | A2 B3 C2 D3 |
| 12. AI and Government | Advanced | 10 | ✓ | A2 B2 C3 D3 |
| Totals | 120 | A26 B30 C35 D29 |
Bloom's Taxonomy Distribution¶
Introductory Chapters (1–3) — Target: 40R / 40U / 15Ap / 5An¶
| Chapter | Remember | Understand | Apply | Analyze |
|---|---|---|---|---|
| Ch 1 | 4 | 4 | 1 | 1 |
| Ch 2 | 4 | 4 | 1 | 1 |
| Ch 3 | 4 | 4 | 1 | 1 |
| Target | 40% | 40% | 15% | 5% |
| Actual | 40% | 40% | 10% | 10% |
Intermediate Chapters (4–9) — Target: 25R / 30U / 30Ap / 15An¶
| Chapter | Remember | Understand | Apply | Analyze |
|---|---|---|---|---|
| Ch 4 | 3 | 3 | 3 | 1 |
| Ch 5 | 2 | 3 | 3 | 2 |
| Ch 6 | 3 | 3 | 2 | 2 |
| Ch 7 | 2 | 3 | 3 | 2 |
| Ch 8 | 2 | 3 | 3 | 2 |
| Ch 9 | 2 | 3 | 3 | 2 |
| Target | 25% | 30% | 30% | 15% |
| Actual | 23% | 30% | 28% | 18% |
Advanced Chapters (10–12) — Target: 15R / 20U / 25Ap / 25An / 10Ev / 5Cr¶
| Chapter | Remember | Understand | Apply | Analyze | Evaluate | Create |
|---|---|---|---|---|---|---|
| Ch 10 | 2 | 2 | 2 | 2 | 1 | 1 |
| Ch 11 | 1 | 2 | 3 | 2 | 1 | 1 |
| Ch 12 | 1 | 2 | 2 | 3 | 1 | 1 |
| Target | 15% | 20% | 25% | 25% | 10% | 5% |
| Actual | 13% | 20% | 23% | 23% | 10% | 10% |
Answer Balance (Overall)¶
| Option | Count | Percentage | Target |
|---|---|---|---|
| A | 26 | 21.7% | 25% |
| B | 30 | 25.0% | 25% |
| C | 35 | 29.2% | 25% |
| D | 29 | 24.2% | 25% |
C is slightly over-represented (29.2% vs 25% target). All values are within an acceptable range for a 120-question bank. No chapter has any answer appearing fewer than 2 or more than 4 times.
Concept Coverage¶
| Chapter | Key Concepts Available | Concepts Tested | Coverage |
|---|---|---|---|
| Ch 1 | 16 | 10 | 63% |
| Ch 2 | 14 | 10 | 71% |
| Ch 3 | 16 | 10 | 63% |
| Ch 4 | 14 | 10 | 71% |
| Ch 5 | 14 | 10 | 71% |
| Ch 6 | 13 | 10 | 77% |
| Ch 7 | 16 | 10 | 63% |
| Ch 8 | 16 | 10 | 63% |
| Ch 9 | 15 | 10 | 67% |
| Ch 10 | 14 | 10 | 71% |
| Ch 11 | 13 | 10 | 77% |
| Ch 12 | 13 | 10 | 77% |
| Average | 14.5 | 10 | 69% |
Quality Scoring¶
Distractor Quality: 22/25¶
All distractors are: - Plausible (use related terminology from chapter) - Educational (test specific misconceptions rather than being obviously wrong) - Grammatically parallel to the correct answer - Of similar length to correct answer
Minor deductions: A few questions in introductory chapters have slightly more straightforward distractors appropriate for that level.
Explanation Quality: 22/25¶
- 120/120 explanations present (100%) ✓
- All explanations start with "The correct answer is [LETTER]." ✓
- Average explanation word count: ~75 words ✓
- Most explanations address why distractors are incorrect ✓
- All explanations include Concept Tested: line ✓
Format Compliance: 20/20¶
- All questions use
#### N.level-4 headers ✓ - All option sets wrapped in
<div class="upper-alpha" markdown>✓ - All answer reveals use
??? question "Show Answer"✓ - Horizontal rules between all questions ✓
- Zero anchor links ✓
Bloom's Distribution: 20/30¶
- Introductory chapters: Analyze slightly over target (+5%); Apply slightly under (-5%)
- Intermediate chapters: close to target, within ±5% for all levels
- Advanced chapters: Create over target (+5% vs 5% target); Analyze slightly under
Overall Quality Score: 84/100¶
| Dimension | Score | Max |
|---|---|---|
| Distractor Quality | 22 | 25 |
| Explanation Quality | 22 | 25 |
| Format Compliance | 20 | 20 |
| Bloom's Distribution | 20 | 30 |
| Total | 84 | 100 |
Recommendations¶
High Priority¶
-
Expand concept coverage in future updates — At 69% average coverage, there is room to add 2-5 more questions per chapter in a second quiz (quiz-2.md) to cover remaining concepts.
-
Rebalance Answer C — C appears in 29.2% of correct answers overall. Future updates should aim to reduce C to 25% and distribute more evenly.
-
Add 1-2 Apply-level questions to Introductory chapters — Currently at 10% vs 15% target. Apply-level questions like "Given [scenario], identify which founding principle applies" would strengthen the quiz bank.
Medium Priority¶
-
Add chapter-specific AP exam tips to explanations — Many AP exam free-response questions require connecting concepts across chapters. Future explanations could note when a concept frequently appears in AP exam context.
-
Create a cross-chapter synthesis quiz — A 15-20 question quiz drawing from all 12 chapters would help students prepare for comprehensive exams and the AP test.
Low Priority¶
- Add Create-level questions to intermediate chapters — Currently no Create-level questions in Ch 4-9. These could ask students to design a bill, draft a constitutional amendment, or construct an argument.
Files Generated¶
| File | Description |
|---|---|
docs/chapters/01-foundations-of-democracy/quiz.md |
10-question quiz |
docs/chapters/02-constitution-and-bill-of-rights/quiz.md |
10-question quiz |
docs/chapters/03-federalism-and-federal-powers/quiz.md |
10-question quiz |
docs/chapters/04-congress-structure-and-processes/quiz.md |
10-question quiz |
docs/chapters/05-the-presidency/quiz.md |
10-question quiz |
docs/chapters/06-the-federal-bureaucracy/quiz.md |
10-question quiz |
docs/chapters/07-the-federal-judiciary/quiz.md |
10-question quiz |
docs/chapters/08-civil-liberties-and-civil-rights/quiz.md |
10-question quiz |
docs/chapters/09-political-opinion-media-and-civic-reasoning/quiz.md |
10-question quiz |
docs/chapters/10-voting-political-parties-and-participation/quiz.md |
10-question quiz |
docs/chapters/11-interest-groups-campaigns-and-elections/quiz.md |
10-question quiz |
docs/chapters/12-impact-of-ai-on-government/quiz.md |
10-question quiz |
docs/learning-graph/quiz-generation-report.md |
This report |
mkdocs.yml |
Updated navigation with Content + Quiz per chapter |