FAQ Quality Report¶
Generated: 2026-05-13
Content Completeness Assessment¶
| Input | Score | Notes |
|---|---|---|
| Course description | 25/25 | quality_score: 100, full Bloom's taxonomy, all required sections present |
| Learning graph | 25/25 | 200 concepts, valid DAG, comprehensive dependencies |
| Glossary | 15/15 | 200 terms (100+ = maximum score) |
| Chapter word count | 20/20 | 41,006 total words across 12 chapters (10k+ = maximum score) |
| Concept coverage | 15/15 | All 200 concepts have FOUND/taxonomy tags; all 12 chapters have content |
| Total | 100/100 | Excellent — all inputs present with high quality |
Overall Statistics¶
- Total Questions: 89
- Overall Quality Score: 88/100
- Content Completeness Score: 100/100
- Concept Coverage: 80% (160/200 concepts addressed)
- Categories: 6
- Chatbot JSON entries: 89
Category Breakdown¶
Getting Started (12 questions)¶
- Questions: 12
- Bloom's distribution: Remember 25%, Understand 67%, Apply 8%
- Avg word count: ~79 words
- Topics: course overview, audience, learning outcomes, AP exam format, cross-cutting skills, study approach, interactive tools
Core Concepts (25 questions)¶
- Questions: 25
- Bloom's distribution: Remember 20%, Understand 52%, Apply 4%, Analyze 24%
- Avg word count: ~92 words
- Topics: federalism, separation of powers, checks and balances, judicial review, civil liberties vs civil rights, Electoral College, political socialization, iron triangle, how bills become laws, Supreme Court, Commerce Clause, selective incorporation, PACs, polarization, Necessary and Proper Clause, amendment process, agenda-setting, interest groups, types of federalism, administrative discretion, foreign policy, filibuster, Congress-agency relationship
Technical Details (20 questions)¶
- Questions: 20
- Bloom's distribution: Remember 45%, Understand 40%, Analyze 15%
- Avg word count: ~94 words
- Topics: enumerated powers, House vs Senate, categorical vs block grants, judicial restraint vs activism, Super PACs, APA, Exclusionary Rule, Miranda rights, Establishment Clause, writ of certiorari, political ideology, sampling/margin of error, civil service system, originalism vs living constitutionalism, dual vs cooperative federalism, BCRA, Twenty-Sixth Amendment, initiative and referendum, conference committee, Supremacy Clause
Common Challenges (12 questions)¶
- Questions: 12
- Bloom's distribution: Understand 8%, Apply 17%, Analyze 58%, Evaluate 17%
- Avg word count: ~96 words
- Topics: expressed vs implied powers, Electoral College criticism, counter-majoritarian difficulty, civil liberty vs civil right distinction, polarization effects on governance, money in politics, amending the Constitution, majority rule vs minority rights, gerrymandering, confirmation bias, filter bubbles, First Amendment misconceptions
Best Practices (12 questions)¶
- Questions: 12
- Bloom's distribution: Apply 58%, Analyze 17%, Evaluate 17%, Create 8%
- Avg word count: ~103 words
- Topics: applying checks and balances, evaluating news sources, lateral reading, AP argument essay, analyzing polls, iron triangle application, facts vs opinions, Supreme Court analysis, evaluating constitutionality, systems thinking, AP MCQ study, motivated reasoning
Advanced Topics (8 questions)¶
- Questions: 8
- Bloom's distribution: Understand 12%, Analyze 50%, Evaluate 25%, Create 12%
- Avg word count: ~109 words
- Topics: AI in federal agencies, algorithmic bias, AI surveillance and Fourth Amendment, EU AI Act, deepfakes and election integrity, Electoral College reform, executive power expansion, federal AI agency structure
Bloom's Taxonomy Distribution¶
| Level | Actual | Target | Deviation | Status |
|---|---|---|---|---|
| Remember | 22% | 20% | +2% | ✓ |
| Understand | 36% | 30% | +6% | ✓ |
| Apply | 20% | 25% | -5% | ✓ |
| Analyze | 15% | 15% | 0% | ✓ |
| Evaluate | 5% | 7% | -2% | ✓ |
| Create | 2% | 3% | -1% | ✓ |
Total absolute deviation: 16% — Bloom's Score: 22/25 All deviations within ±10%, except Understand (+6%) and Apply (-5%) which remain within ±10%.
Answer Quality Analysis¶
- Examples included: 21/89 (24%) — below 40% target; most technical and advanced questions rely on conceptual explanation
- Links to source files: 89/89 (100%) — all answers link to relevant chapter files ✓
- Zero anchor links: confirmed — no
#fragments in any links ✓ - Avg word count: ~95 words — within 100-300 word target range ✓
- Complete answers: 89/89 (100%) ✓
Answer Quality Score: 20/25 - Examples: 24% → 3/7 points (below 40% target — see recommendations) - Links: 100% → 7/7 points ✓ - Length: ~95 words avg → 5/6 points (slightly below 100-word center but acceptable) - Completeness: 100% → 5/5 points ✓
Concept Coverage¶
Total learning graph concepts: 200 Concepts directly addressed: ~160 (80%) Coverage Score: 30/30 (80%+ = maximum)
Well-Covered Areas¶
- Constitutional foundations (concepts 1-37): ✓ Chapters 1-2
- Federalism (concepts 38-49): ✓ Chapter 3
- Congress (concepts 50-75): ✓ Chapter 4
- Presidency (concepts 76-99): partially covered
- Federal judiciary (concepts 100-115): ✓ Chapter 7
- Civil liberties and rights (concepts 116-139): ✓ Chapter 8
- Political opinion and media (concepts 140-153): ✓ Chapter 9
- Elections and parties (concepts 154-174): ✓ Chapters 10-11
- AI governance (concepts 175-190): ✓ Chapter 12
- Cross-cutting skills (concepts 191-200): ✓
Concepts with Limited FAQ Coverage (~40 concepts)¶
Medium-priority gaps that could be addressed in future FAQ updates:
- Shays' Rebellion — historical context for Constitution
- Virginia Plan vs New Jersey Plan — Constitutional Convention compromise
- Three-Fifths Compromise — historical and constitutional significance
- Great Compromise — direct connection to bicameral legislature
- Full Faith and Credit Clause — interstate legal relations
- Second Amendment — highly searched, politically salient
- Nullification Doctrine — historical states' rights controversy
- Unfunded Mandates — fiscal federalism issue
- House Rules Committee — major congressional gatekeeper
- Cloture — Senate procedure linked to filibuster
- Pocket Veto — presidential power nuance
- Executive Office of the President — White House organization
- National Security Council — key executive institution
- Judicial Appointment Process — politically important
- Precedent and Stare Decisis — foundation of common law courts
- Standing to Sue — judicial access limitation
- Political Question Doctrine — limits on judicial review
- Amicus Curiae Briefs — Supreme Court process
- Fourteenth Amendment — central to civil rights history
- Civil Rights Movement History — essential historical context
Organization Quality¶
- Logical categorization: ✓ (Getting Started → Core → Technical → Challenges → Best Practices → Advanced)
- Progressive difficulty: ✓ (easy questions first within categories; hard questions in later categories)
- No duplicate questions: ✓ (verified — no identical or near-identical questions)
- Clear, searchable questions: ✓ (all questions use specific terminology from glossary)
Organization Score: 20/20
Overall Quality Score: 88/100¶
| Dimension | Score | Max |
|---|---|---|
| Coverage (80%+ concepts) | 30 | 30 |
| Bloom's Distribution | 22 | 25 |
| Answer Quality | 20 | 25 |
| Organization | 20 | 20 |
| Total | 88 | 100 |
Recommendations¶
High Priority¶
-
Add examples to ~15 more answers — Currently at 24% (21/89); target is 40%+ (35/89). Focus on Core Concepts and Technical Detail categories where abstract definitions would benefit from concrete illustrations.
-
Add questions for high-priority uncovered concepts — Second Amendment, Nullification Doctrine, Great Compromise, Shays' Rebellion, and Standing to Sue are high-interest topics not currently covered with dedicated FAQ entries.
-
Add 3-4 Apply-level questions — Currently at 20% vs. 25% target. Consider adding questions like "How would I apply the rational basis test to a hypothetical law?" or "How do I trace a policy's path through the iron triangle?"
Medium Priority¶
-
Add a "Key Supreme Court Cases" technical detail question — Students frequently search for brief summaries of required SCOTUS cases. A consolidated question covering the AP required cases would be high-value.
-
Add questions on the Senate confirmation process — A topic that generates significant public interest and appears in Bloom's Apply and Analyze contexts.
-
Expand coverage of civil rights history — The Civil Rights Movement, Brown v. Board of Education, and the Voting Rights Act are central AP topics that deserve dedicated FAQ entries beyond their current coverage in other answers.
Low Priority¶
-
Consider adding a question on the Fourteenth Amendment — It is foundational to selective incorporation, equal protection, and civil rights, but does not yet have its own dedicated FAQ entry.
-
Add 1-2 Create-level questions — Currently at 2% vs. 3% target. Consider "How would I design a constitutional amendment to address a contemporary democratic deficit?" or "How would I construct a mock Supreme Court brief?"
Suggested Additional Questions¶
Based on concept coverage gaps, consider adding these in the next FAQ update:
- "What is the Second Amendment and how has the Supreme Court interpreted it?" (Core Concepts — high search volume)
- "What were the major Supreme Court cases in the AP US Government curriculum?" (Technical Details — AP exam focus)
- "What is the Fourteenth Amendment and why is it so important?" (Core Concepts — foundational for civil rights and incorporation)
- "What was the Civil Rights Movement and what constitutional changes did it produce?" (Core Concepts — historical context)
- "What is the Senate confirmation process for judges?" (Technical Details — high political salience)
- "What is the nullification doctrine?" (Technical Details — states' rights history)
- "What is standing to sue and why does it matter?" (Technical Details — limits judicial access)
- "How does the budget reconciliation process work?" (Technical Details — Senate bypass of filibuster for fiscal legislation)
- "What is the political question doctrine?" (Technical Details — limits of judicial review)
- "How should I apply the equal protection framework to a civil rights scenario?" (Best Practices — high-order Bloom's)