Quiz: Research Design and Evidence Quality¶
Test your understanding of research design and evidence quality with these review questions.
1. Which definition best describes Research Cost?¶
- The money, labor, tools, incentives, and opportunity costs required to plan, conduct, analyze, and report a study.
- Moderated conversations with recruited human participants who discuss a topic together and provide qualitative evidence about their perceptions.
- The elapsed time from defining a study through collecting, analyzing, and communicating its findings.
- Specific questions a study is designed to answer through evidence rather than assumption or preference.
Show Answer
The correct answer is A. The money, labor, tools, incentives, and opportunity costs required to plan, conduct, analyze, and report a study. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward Traditional Focus Groups, Research Turnaround Time, Research Questions, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Research Cost
See: Research Cost
2. Which definition best describes Iterative Research?¶
- The number of participants, observations, or simulated profiles included in a study and considered when interpreting its evidence.
- Inquiry that judges how well an existing concept, experience, or marketing asset performs against defined criteria.
- Conditions treated as true for planning or interpretation even though they may not have been directly established by evidence.
- A repeated inquiry process in which findings from one cycle shape revisions and questions for the next cycle.
Show Answer
The correct answer is D. A repeated inquiry process in which findings from one cycle shape revisions and questions for the next cycle. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward Research Sample Size, Evaluative Research, Research Assumptions, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Iterative Research
See: Iterative Research
3. Which definition best describes Traditional Focus Groups?¶
- Open-ended inquiry used to discover patterns, questions, language, or hypotheses when the problem is not yet well defined.
- The defined boundaries of a study, including included audiences, materials, questions, contexts, and time period.
- Moderated conversations with recruited human participants who discuss a topic together and provide qualitative evidence about their perceptions.
- The degree to which a method produces sufficiently consistent measurements or findings when repeated under comparable conditions.
Show Answer
The correct answer is C. Moderated conversations with recruited human participants who discuss a topic together and provide qualitative evidence about their perceptions. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward Exploratory Research, Research Scope, Research Reliability, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Traditional Focus Groups
4. Which definition best describes Research Sample Size?¶
- Clear statements of what a study intends to learn, evaluate, compare, or decide.
- The degree to which evidence and methods support the interpretation or decision a study claims to support.
- A preliminary indication of a likely pattern or issue that guides exploration but is not treated as conclusive customer evidence.
- The number of participants, observations, or simulated profiles included in a study and considered when interpreting its evidence.
Show Answer
The correct answer is D. The number of participants, observations, or simulated profiles included in a study and considered when interpreting its evidence. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward Research Objectives, Research Validity, Directional Insight, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Research Sample Size
See: Research Sample Size
5. Which statement best explains Reproducible Results in this chapter's research context?¶
- It refers to this idea: Conditions treated as true for planning or interpretation even though they may not have been directly established by evidence.
- It refers to this idea: An assessment whose documented inputs, prompts, criteria, and procedures can be applied again in a consistent way.
- It refers to this idea: Findings that can be obtained again by another evaluator using the documented materials, settings, and procedure.
- It refers to this idea: One-to-one conversations with real customers designed to uncover experiences, motivations, language, needs, and decision processes.
Show Answer
The correct answer is C. Findings that can be obtained again by another evaluator using the documented materials, settings, and procedure. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Research Assumptions, Repeatable Evaluation, Customer Interviews, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Reproducible Results
See: Reproducible Results
6. Which statement best explains Customer Interviews in this chapter's research context?¶
- It refers to this idea: One-to-one conversations with real customers designed to uncover experiences, motivations, language, needs, and decision processes.
- It refers to this idea: An assessment whose documented inputs, prompts, criteria, and procedures can be applied again in a consistent way.
- It refers to this idea: Moderated conversations with recruited human participants who discuss a topic together and provide qualitative evidence about their perceptions.
- It refers to this idea: The money, labor, tools, incentives, and opportunity costs required to plan, conduct, analyze, and report a study.
Show Answer
The correct answer is A. One-to-one conversations with real customers designed to uncover experiences, motivations, language, needs, and decision processes. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Repeatable Evaluation, Traditional Focus Groups, Research Cost, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Customer Interviews
See: Customer Interviews
7. Which statement best explains Customer Surveys in this chapter's research context?¶
- It refers to this idea: Recorded information from actual customers or credible observations that supports or challenges a claim about customer behavior or experience.
- It refers to this idea: Standardized questions administered to a defined group to collect comparable self-reported attitudes, behaviors, or characteristics.
- It refers to this idea: The elapsed time from defining a study through collecting, analyzing, and communicating its findings.
- It refers to this idea: Inquiry that judges how well an existing concept, experience, or marketing asset performs against defined criteria.
Show Answer
The correct answer is B. Standardized questions administered to a defined group to collect comparable self-reported attitudes, behaviors, or characteristics. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Customer Evidence, Research Turnaround Time, Evaluative Research, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Customer Surveys
See: Customer Surveys
8. Which statement best explains Research Turnaround Time in this chapter's research context?¶
- It refers to this idea: Standardized questions administered to a defined group to collect comparable self-reported attitudes, behaviors, or characteristics.
- It refers to this idea: The elapsed time from defining a study through collecting, analyzing, and communicating its findings.
- It refers to this idea: Open-ended inquiry used to discover patterns, questions, language, or hypotheses when the problem is not yet well defined.
- It refers to this idea: The defined boundaries of a study, including included audiences, materials, questions, contexts, and time period.
Show Answer
The correct answer is B. The elapsed time from defining a study through collecting, analyzing, and communicating its findings. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Customer Surveys, Exploratory Research, Research Scope, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Research Turnaround Time
9. A marketing team encounters this situation: “Which proof points make first-time buyers trust the guarantee?” directs the study toward a specific answer. Which concept should guide its interpretation?¶
- Research Cost
- Research Objectives
- Research Validity
- Research Questions
Show Answer
The correct answer is D. Specific questions a study is designed to answer through evidence rather than assumption or preference. The situation calls for this concept because its defining purpose matches the action or evidence described. The alternatives instead point toward Research Cost, Research Objectives, Research Validity, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Research Questions
See: Research Questions
10. A marketing team encounters this situation: A checkout test measures whether customers can complete checkout, not whether they remember the brand a week later. Which concept should guide its interpretation?¶
- Evaluative Research
- Research Validity
- Research Assumptions
- Reproducible Results
Show Answer
The correct answer is B. The degree to which evidence and methods support the interpretation or decision a study claims to support. The situation calls for this concept because its defining purpose matches the action or evidence described. The alternatives instead point toward Evaluative Research, Research Assumptions, Reproducible Results, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.
Concept Tested: Research Validity
See: Research Validity