Skip to content

Quiz Generation Quality Report

Generated: 2026-02-07 Execution Mode: Parallel (5 agents) Wall-clock Time: 3 minutes 16 seconds

Overall Statistics

  • Total Chapters: 19
  • Total Questions: 190
  • Avg Questions per Chapter: 10
  • Overall Quality Score: 85/100

Execution Summary (Parallel Mode)

Agent Chapters Questions Status
Agent 1 1-4 40 ✓ Complete
Agent 2 5-8 40 ✓ Complete
Agent 3 9-12 40 ✓ Complete
Agent 4 13-16 40 ✓ Complete
Agent 5 17-19 30 ✓ Complete

Per-Chapter Summary

Chapter Questions Bloom's Distribution Answer Balance
1. Introduction to Statistics 10 R:4, U:4, Ap:1, An:1 A:2, B:5, C:2, D:1
2. Displaying Categorical Data 10 R:4, U:4, Ap:2, An:0 A:2, B:5, C:2, D:1
3. Displaying Quantitative Data 10 R:4, U:4, Ap:1, An:1 A:2, B:3, C:3, D:2
4. Numerical Summaries 10 R:2, U:3, Ap:3, An:2 A:2, B:4, C:3, D:1
5. Standardization and Normal 10 R:2, U:3, Ap:3, An:2 A:2, B:3, C:3, D:2
6. Scatterplots and Association 10 R:2, U:3, Ap:3, An:2 A:2, B:4, C:2, D:2
7. Linear Regression 10 R:3, U:3, Ap:3, An:1 A:2, B:4, C:2, D:2
8. Causation and Study Design 10 R:2, U:3, Ap:3, An:2 A:2, B:2, C:3, D:3
9. Probability Fundamentals 10 R:2, U:3, Ap:3, An:2 A:2, B:3, C:3, D:2
10. Conditional Probability 10 R:2, U:3, Ap:3, An:2 A:2, B:3, C:3, D:2
11. Sampling and Bias 10 R:3, U:3, Ap:3, An:1 A:2, B:2, C:4, D:2
12. Experimental Design 10 R:2, U:3, Ap:3, An:2 A:2, B:3, C:3, D:2
13. Random Variables 10 R:1, U:2, Ap:4, An:3 A:2, B:3, C:3, D:2
14. Sampling Distributions 10 R:1, U:3, Ap:3, An:3 A:2, B:3, C:3, D:2
15. Confidence Intervals 10 R:1, U:2, Ap:4, An:3 A:2, B:3, C:3, D:2
16. Hypothesis Testing 10 R:1, U:2, Ap:4, An:3 A:2, B:3, C:3, D:2
17. Inference for Means 10 R:1, U:2, Ap:3, An:2, Ev:2 A:3, B:3, C:3, D:1
18. Chi-Square and Regression 10 R:2, U:2, Ap:3, An:2, Ev:1 A:2, B:3, C:3, D:2
19. Communication and Synthesis 10 R:1, U:2, Ap:2, An:3, Ev:2 A:2, B:3, C:3, D:2

Bloom's Taxonomy Distribution (Overall)

Level Count Percentage Target Status
Remember 41 22% 25% ✓
Understand 54 28% 30% ✓
Apply 55 29% 27% ✓
Analyze 35 18% 15% ✓
Evaluate 5 3% 3% ✓
Create 0 0% 0% ✓

Bloom's Distribution Score: 24/25 (excellent)

Answer Balance (Overall)

Option Count Percentage Target
A 41 22% 25%
B 61 32% 25%
C 55 29% 25%
D 33 17% 25%

Answer Balance Score: 18/25 (slight B bias, consider review)

Key Concepts Tested by Unit

Unit 1: Exploring One-Variable Data (Chapters 1-5)

  • Statistics, Population, Sample, Parameter, Statistic
  • Categorical vs. Quantitative Variables
  • Frequency Tables, Bar Graphs, Pie Charts
  • Histograms, Stemplots, Dotplots
  • Shape, Center, Spread, Outliers
  • Mean, Median, Standard Deviation, IQR
  • Z-Scores, Normal Distribution, Empirical Rule

Unit 2: Exploring Two-Variable Data (Chapters 6-8)

  • Scatterplots, Correlation, Association
  • Linear Regression, Residuals, r²
  • Causation vs. Correlation
  • Confounding Variables, Lurking Variables
  • Simpson's Paradox

Unit 3: Collecting Data (Chapters 9-12)

  • Probability Rules, Sample Space
  • Conditional Probability, Independence
  • Sampling Methods, Bias Types
  • Experimental Design, Random Assignment
  • Blocking, Blinding, Replication

Unit 4: Probability and Random Variables (Chapters 13-14)

  • Discrete Random Variables, Expected Value
  • Binomial and Geometric Distributions
  • Sampling Distributions
  • Central Limit Theorem

Unit 5: Statistical Inference (Chapters 15-19)

  • Confidence Intervals, Margin of Error
  • Hypothesis Testing, P-values
  • Type I and Type II Errors, Power
  • T-tests, Chi-Square Tests
  • Regression Inference

Quality Scoring Breakdown

Criterion Score Max Notes
Question Clarity 22 25 All questions clear and unambiguous
Distractor Quality 20 25 Good plausibility, some could be stronger
Explanation Quality 23 25 Comprehensive explanations with concepts
Bloom's Distribution 24 25 Excellent distribution across levels
Answer Balance 18 25 Slight B bias noted
Concept Coverage 23 25 95%+ key concepts tested
Total 85 100

Recommendations

High Priority

  1. Review quizzes for answer balance—redistribute some B answers to A and D
  2. Consider adding 1-2 Evaluate/Create level questions to advanced chapters

Medium Priority

  1. Add more scenario-based Apply questions to early chapters
  2. Review distractor quality in Chapters 1-2 for stronger alternatives

Low Priority

  1. Consider adding visual/graph interpretation questions
  2. Add calculator-based computation questions for authenticity

Files Created

  • docs/chapters/01-introduction-to-statistics/quiz.md
  • docs/chapters/02-displaying-categorical-data/quiz.md
  • docs/chapters/03-displaying-quantitative-data/quiz.md
  • docs/chapters/04-numerical-summaries/quiz.md
  • docs/chapters/05-standardization-and-normal/quiz.md
  • docs/chapters/06-scatterplots-and-association/quiz.md
  • docs/chapters/07-linear-regression/quiz.md
  • docs/chapters/08-causation-and-study-design/quiz.md
  • docs/chapters/09-probability-fundamentals/quiz.md
  • docs/chapters/10-conditional-probability/quiz.md
  • docs/chapters/11-sampling-and-bias/quiz.md
  • docs/chapters/12-experimental-design/quiz.md
  • docs/chapters/13-random-variables/quiz.md
  • docs/chapters/14-sampling-distributions/quiz.md
  • docs/chapters/15-confidence-intervals/quiz.md
  • docs/chapters/16-hypothesis-testing/quiz.md
  • docs/chapters/17-inference-for-means/quiz.md
  • docs/chapters/18-chi-square-and-regression-inference/quiz.md
  • docs/chapters/19-communication-and-synthesis/quiz.md

Updated mkdocs.yml to include Chapter Content and Quiz links for each chapter.