Quiz Generation Quality Report
Generated: 2026-04-24 Execution Mode: Serial (1 agent) Wall-clock Time: 15 minutes 47 seconds
Overall Statistics
- Total Chapters: 17
- Total Questions: 170
- Avg Questions per Chapter: 10
- Quiz Format: mkdocs-material question admonition with upper-alpha
Per-Chapter Summary
| Ch | Chapter Name | Questions | Bloom's Distribution | Answer Balance |
|---|---|---|---|---|
| 1 | Foundations of Ecology | 10 | R:4, U:4, Ap:1, An:1 | A:3, B:3, C:3, D:1 |
| 2 | Ecosystems and Biomes | 10 | R:4, U:4, Ap:1, An:1 | A:0, B:3, C:5, D:2 |
| 3 | Energy Flow | 10 | R:4, U:4, Ap:1, An:1 | A:1, B:3, C:4, D:2 |
| 4 | Biogeochemical Cycles | 10 | R:2, U:3, Ap:3, An:2 | A:2, B:3, C:4, D:1 |
| 5 | Species Interactions | 10 | R:2, U:3, Ap:3, An:2 | A:1, B:3, C:4, D:2 |
| 6 | Biodiversity and Services | 10 | R:2, U:3, Ap:3, An:2 | A:1, B:3, C:3, D:3 |
| 7 | Population Ecology | 10 | R:2, U:3, Ap:3, An:2 | A:0, B:3, C:3, D:4 |
| 8 | Earth Systems | 10 | R:2, U:3, Ap:3, An:2 | A:0, B:3, C:5, D:2 |
| 9 | Sustainability and Energy | 10 | R:3, U:3, Ap:2, An:2 | A:0, B:4, C:4, D:2 |
| 10 | Land and Water Use | 10 | R:2, U:3, Ap:3, An:2 | A:0, B:3, C:5, D:2 |
| 11 | Atmospheric Pollution | 10 | R:2, U:3, Ap:3, An:2 | A:0, B:3, C:5, D:2 |
| 12 | Water and Land Pollution | 10 | R:2, U:3, Ap:3, An:2 | A:0, B:5, C:3, D:2 |
| 13 | Systems Thinking | 10 | R:1, U:2, Ap:3, An:2, E:1, C:1 | A:0, B:5, C:3, D:2 |
| 14 | Scientific Literacy | 10 | R:2, U:2, Ap:2, An:2, E:1, C:1 | A:0, B:5, C:3, D:2 |
| 15 | Global Climate Change | 10 | R:1, U:2, Ap:3, An:2, E:1, C:1 | A:2, B:4, C:2, D:2 |
| 16 | Biodiversity Loss and Policy | 10 | R:1, U:2, Ap:3, An:2, E:1, C:1 | A:0, B:4, C:4, D:2 |
| 17 | Evaluating Claims | 10 | R:1, U:2, Ap:3, An:2, E:1, C:1 | A:0, B:6, C:2, D:2 |
Bloom's Taxonomy Distribution (Overall)
| Level | Count | Percentage | Target Range |
|---|---|---|---|
| Remember | 37 | 21.8% | 15-40% |
| Understand | 49 | 28.8% | 20-40% |
| Apply | 43 | 25.3% | 15-30% |
| Analyze | 31 | 18.2% | 5-25% |
| Evaluate | 5 | 2.9% | 0-10% |
| Create | 5 | 2.9% | 0-5% |
Answer Balance (Overall)
| Answer | Count | Percentage |
|---|---|---|
| A | 10 | 5.9% |
| B | 60 | 35.3% |
| C | 62 | 36.5% |
| D | 38 | 22.4% |
Note: Answer A is underrepresented across the quiz bank. Future revisions should redistribute correct answers more evenly. Answer B and C are overrepresented. The target is 25% per answer option.
Recommendations
- Rebalance answer distribution — Answer A is significantly underrepresented (5.9% vs target 25%). Future quiz revisions should shift more correct answers to position A.
- Bloom's distribution is solid — The progression from introductory (Remember-heavy) to advanced (Evaluate/Create included) chapters follows the intended design.
- All questions include explanations — Every question has a 50-100 word explanation with a Concept Tested label.
- No "All/None of the above" options used — All distractors are substantive.