Chapter 5 Quiz — Idea Funnel: Gathering Ideas¶
Test your understanding of how educational institutions systematically collect, document, and begin evaluating AI use case ideas. Questions cover Remember, Understand, Apply, and Analyze levels of learning.
Questions¶
1. What is an Idea Funnel in the context of AI strategy, and why is the 'funnel' metaphor appropriate?
Answer: An Idea Funnel is a structured process for collecting a large volume of potential AI use case ideas at the input end and progressively narrowing them down to the most promising, feasible projects that move forward to implementation. The funnel metaphor is appropriate because many ideas enter at the top but only a few survive the evaluation, prioritization, and resource-allocation steps to emerge at the bottom as funded projects. This structure prevents both over-investment in poor ideas and the loss of genuinely valuable ones.
2. What is an Idea Registry, and why is maintaining one important for an AI strategy program?
Answer: An Idea Registry is a centralized, searchable database where all submitted AI use case ideas are recorded and tracked, including their status, submitter, evaluation scores, and disposition. Maintaining it is important because it creates organizational memory — ensuring that good ideas are not lost, that similar ideas from different submitters are recognized and connected, and that decision-makers can see the full pipeline rather than only the ideas currently under active discussion. It also demonstrates to staff that their submissions are taken seriously.
3. What information should be captured in Idea Metadata, and why does each field matter?
Answer: Idea Metadata is the structured information recorded about each submitted idea, typically including the submitter's name and role, the problem being solved, the proposed solution, estimated cost and benefit, affected stakeholders, and submission date. Each field matters because it enables consistent comparison across ideas: knowing the submitter's role contextualizes their perspective, a clear problem statement separates the symptom from the root cause, and estimated cost and benefit allow prioritization. Complete metadata makes the difference between a rich idea pipeline and a list of vague suggestions.
4. What makes a strong Problem Statement in an AI idea submission, and why is it better to define the problem before proposing the solution?
Answer: A strong Problem Statement clearly describes the current situation, identifies who is affected, quantifies the impact where possible (e.g., "teachers spend an average of four hours per week on this task"), and explains why existing approaches are insufficient. Defining the problem before proposing a solution ensures that the AI tool being considered actually addresses the root cause rather than a symptom. Many technology projects fail because teams jump to a solution before fully understanding the problem, resulting in tools that are technically functional but practically unhelpful.
5. What is Feasibility Assessment in the idea evaluation process, and what dimensions does it cover?
Answer: Feasibility Assessment evaluates whether an idea can realistically be implemented given the institution's current resources, technical capabilities, data availability, and timeline. Dimensions typically include technical feasibility (do the necessary AI capabilities exist?), organizational feasibility (does the district have the staff and change management capacity?), data feasibility (is the required data available and well-structured?), and financial feasibility (is the budget available?). An idea may be highly valuable in principle but infeasible in a specific district's context due to gaps in any of these dimensions.
6. What is Risk Scoring, and how does it help prioritize AI ideas in education?
Answer: Risk Scoring is the process of assigning a numerical or categorical rating to each AI idea based on the likelihood and severity of potential negative outcomes — such as data privacy violations, student harm, or failed implementation. Higher risk scores do not necessarily disqualify an idea, but they indicate that more safeguards, oversight, and resources will be needed. Pairing risk scores with benefit scores allows decision-makers to focus initial efforts on high-benefit, low-risk ideas — the so-called 'quick wins' that build confidence and organizational capability for tackling riskier initiatives later.
7. What is Benefit Scoring, and what types of benefit should be considered beyond cost savings?
Answer: Benefit Scoring assigns a quantitative or qualitative estimate of the positive value an AI idea would deliver if implemented successfully. Beyond direct cost savings, benefits should include improved student learning outcomes, reduced teacher workload and burnout, increased equity and access for underserved students, better parent communication, and enhanced administrative decision-making. Capturing the full range of benefits prevents organizations from only pursuing ideas with obvious financial returns while missing high-impact educational improvements.
8. What is AI Literacy Training in the context of an idea funnel, and why is it a prerequisite for effective idea generation?
Answer: AI Literacy Training prepares staff to understand what AI tools can and cannot do, so they can identify genuine opportunities rather than proposing either over-ambitious ideas that current AI cannot support or under-ambitious ones that miss important possibilities. Without baseline AI literacy, idea submissions tend to be either dismissively skeptical ("AI can't really help us") or naively optimistic ("AI will solve everything"). Training ensures that the ideas entering the funnel are grounded in realistic understanding of AI capabilities.
9. What is an Idea Submission Form, and what design principles make it effective?
Answer: An Idea Submission Form is the standardized template staff use to submit AI use case ideas to the idea registry. Effective design principles include asking for a clear problem statement before requesting a solution, keeping required fields minimal so submission is not burdensome, including optional fields for estimated impact so motivated submitters can provide richer data, and making the form accessible from common tools like email or a school intranet. A well-designed form increases both the quantity and the quality of ideas submitted.
10. What is an Expert Review Panel, and what expertise should be represented on it?
Answer: An Expert Review Panel is a group of knowledgeable reviewers who evaluate AI idea submissions beyond what automated scoring can assess — applying judgment about pedagogical soundness, legal compliance, technical viability, and cultural appropriateness. For an education context, the panel should include a curriculum specialist, a technology leader, a data privacy or legal advisor, a classroom teacher, and ideally a student or parent representative. Diverse expertise prevents narrowly technical or narrowly pedagogical judgments from dominating.
11. What is the purpose of an Idea Feedback Loop, and what happens when it is absent?
Answer: An Idea Feedback Loop is the process by which submitters receive acknowledgment of their submission, notification of its evaluation outcome, and explanation of why it was advanced or not selected. When the feedback loop is absent, staff lose motivation to submit future ideas because they feel their input disappears into a void. Over time this kills the culture of bottom-up innovation that an idea funnel is designed to cultivate. Even brief, standardized feedback messages significantly improve submitter engagement.
12. What are Idea Recognition Awards, and why are they more than just symbolic gestures?
Answer: Idea Recognition Awards are formal acknowledgments given to staff whose AI use case ideas are selected for implementation or produce significant results. They are more than symbolic because they signal organizational values — demonstrating that leadership prizes innovation and rewards risk-taking. In educational organizations where innovation is not traditionally a formal performance metric, visible recognition helps shift culture toward embracing experimentation. Awards also give other staff concrete examples of the types of ideas the organization is looking for.
13. What is a Scoring Rubric in the idea evaluation process, and how does it improve consistency?
Answer: A Scoring Rubric is a standardized set of criteria and rating scales used to evaluate all submitted ideas on the same dimensions — such as estimated impact, feasibility, strategic alignment, and risk. It improves consistency by ensuring that different reviewers apply the same standards rather than each using their own subjective judgment. Without a rubric, an idea's evaluation score may depend more on who reviewed it than on its actual merit, undermining staff trust in the process and producing a distorted project pipeline.
14. What is Cost Estimation in AI idea evaluation, and why is it difficult at the early idea stage?
Answer: Cost Estimation is the process of forecasting the financial resources required to implement an AI idea, including software, infrastructure, staff time, training, and ongoing operation. It is difficult at the early idea stage because the scope is often loosely defined, AI pricing is rapidly changing, and the true organizational costs — such as change management and staff retraining — are easy to undercount. Early estimates should be treated as rough order-of-magnitude figures and refined through discovery phases before resources are formally committed.
15. How does the Idea Funnel stage of Gathering Ideas relate to the later stage of Selecting Projects?
Answer: The Gathering Ideas stage is deliberately broad and inclusive — the goal is to cast a wide net and capture as many potential opportunities as possible from across the organization. The Selecting Projects stage is narrower and more rigorous — applying structured evaluation criteria to advance only the ideas with the strongest combination of impact, feasibility, and strategic fit. The two stages work together: a weak gathering stage produces too few ideas for meaningful selection, while a weak selection stage wastes resources on poor ideas that should have been filtered out.