Skip to content

Quiz: AI Capabilities, Limitations, and Bias

Test your understanding of ai capabilities, limitations, and bias with these review questions.

1. Which definition best describes Persona Realism?

  1. Tasks an AI system can perform adequately under stated conditions, such as generating, classifying, comparing, or summarizing content.
  2. Plausible-sounding content generated without adequate factual support in the supplied evidence or reliable knowledge.
  3. A tendency to seek, interpret, or remember information in ways that favor an existing belief or desired conclusion.
  4. The degree to which a persona’s characteristics and responses form a plausible, evidence-grounded representation of a customer.
Show Answer

The correct answer is D. The degree to which a persona’s characteristics and responses form a plausible, evidence-grounded representation of a customer. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward AI Capabilities, Model Hallucination, Confirmation Bias, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Persona Realism

See: Persona Realism

2. Which definition best describes Response Variability?

  1. The degree to which a persona’s characteristics and responses form a plausible, evidence-grounded representation of a customer.
  2. A human tendency to favor an automated recommendation even when contrary evidence or judgment should prompt further review.
  3. Differences among outputs produced from the same or similar inputs because language model generation is probabilistic.
  4. The possibility that a persona or output reduces a group to oversimplified traits and produces unfair or misleading conclusions.
Show Answer

The correct answer is C. Differences among outputs produced from the same or similar inputs because language model generation is probabilistic. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward Persona Realism, Automation Bias, Stereotype Risk, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Response Variability

See: Response Variability

3. Which definition best describes AI Limitations?

  1. Systematic distortion in AI outputs arising from training data, design choices, prompts, evaluation methods, or deployment context.
  2. Known boundaries or failure tendencies that restrict how safely and accurately an AI system’s outputs can be used.
  3. Systematic preference for one culture’s assumptions or norms that misrepresents people from other cultural contexts.
  4. Reasoned interpretation by people who apply context, experience, ethics, and accountability to evidence and AI-generated suggestions.
Show Answer

The correct answer is B. Known boundaries or failure tendencies that restrict how safely and accurately an AI system’s outputs can be used. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward Model Bias, Cultural Bias, Human Judgment, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: AI Limitations

See: AI Limitations

4. Which definition best describes Responsible AI?

  1. A tendency to seek, interpret, or remember information in ways that favor an existing belief or desired conclusion.
  2. The design and use of AI with attention to accuracy, fairness, privacy, transparency, safety, and human accountability.
  3. Unwarranted certainty in a claim, score, or recommendation despite weak evidence, high uncertainty, or known methodological limits.
  4. Application of AI in ways that respect people, prevent foreseeable harm, protect information, and communicate limitations honestly.
Show Answer

The correct answer is B. The design and use of AI with attention to accuracy, fairness, privacy, transparency, safety, and human accountability. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward Confirmation Bias, False Confidence, Ethical AI Use, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Responsible AI

See: Responsible AI

5. Which statement best explains Model Bias in this chapter's research context?

  1. It refers to this idea: Unwarranted certainty in a claim, score, or recommendation despite weak evidence, high uncertainty, or known methodological limits.
  2. It refers to this idea: The design and use of AI with attention to accuracy, fairness, privacy, transparency, safety, and human accountability.
  3. It refers to this idea: Systematic distortion in AI outputs arising from training data, design choices, prompts, evaluation methods, or deployment context.
  4. It refers to this idea: Known boundaries or failure tendencies that restrict how safely and accurately an AI system’s outputs can be used.
Show Answer

The correct answer is C. Systematic distortion in AI outputs arising from training data, design choices, prompts, evaluation methods, or deployment context. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward False Confidence, Responsible AI, AI Limitations, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Model Bias

See: Model Bias

6. Which statement best explains Simulation Fidelity in this chapter's research context?

  1. It refers to this idea: The degree to which a simulation preserves the relevant characteristics and behavior of the real situation it represents.
  2. It refers to this idea: Active review and control by accountable people who can question, correct, reject, or escalate AI-supported work.
  3. It refers to this idea: Tasks an AI system can perform adequately under stated conditions, such as generating, classifying, comparing, or summarizing content.
  4. It refers to this idea: Plausible-sounding content generated without adequate factual support in the supplied evidence or reliable knowledge.
Show Answer

The correct answer is A. The degree to which a simulation preserves the relevant characteristics and behavior of the real situation it represents. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Human Oversight, AI Capabilities, Model Hallucination, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Simulation Fidelity

See: Simulation Fidelity

7. Which statement best explains Human Judgment in this chapter's research context?

  1. It refers to this idea: Clear disclosure of a study’s purpose, methods, sources, assumptions, limitations, and use of AI.
  2. It refers to this idea: Reasoned interpretation by people who apply context, experience, ethics, and accountability to evidence and AI-generated suggestions.
  3. It refers to this idea: The degree to which a persona’s characteristics and responses form a plausible, evidence-grounded representation of a customer.
  4. It refers to this idea: Systematic distortion in AI outputs arising from training data, design choices, prompts, evaluation methods, or deployment context.
Show Answer

The correct answer is B. Reasoned interpretation by people who apply context, experience, ethics, and accountability to evidence and AI-generated suggestions. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Research Transparency, Persona Realism, Model Bias, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Human Judgment

See: Human Judgment

8. Which statement best explains Research Transparency in this chapter's research context?

  1. It refers to this idea: The degree to which a simulation preserves the relevant characteristics and behavior of the real situation it represents.
  2. It refers to this idea: The process of identifying unsupported, invented, or contradictory statements in AI-generated content through checks against evidence.
  3. It refers to this idea: Systematic distortion caused when the included people, personas, examples, or evidence do not adequately represent the intended population.
  4. It refers to this idea: Clear disclosure of a study’s purpose, methods, sources, assumptions, limitations, and use of AI.
Show Answer

The correct answer is D. Clear disclosure of a study’s purpose, methods, sources, assumptions, limitations, and use of AI. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Simulation Fidelity, Hallucination Detection, Selection Bias, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Research Transparency

See: Research Transparency

9. A marketing team encounters this situation: The model can summarize interview notes and classify themes, but a researcher still verifies every quoted claim. Which concept should guide its interpretation?

  1. Hallucination Detection
  2. Selection Bias
  3. Feedback Credibility
  4. AI Capabilities
Show Answer

The correct answer is D. Tasks an AI system can perform adequately under stated conditions, such as generating, classifying, comparing, or summarizing content. The situation calls for this concept because its defining purpose matches the action or evidence described. The alternatives instead point toward Hallucination Detection, Selection Bias, Feedback Credibility, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: AI Capabilities

See: AI Capabilities

10. A marketing team encounters this situation: A critique cites the exact pricing sentence, explains the concern, and labels the persona response as synthetic. Which concept should guide its interpretation?

  1. Feedback Credibility
  2. Automation Bias
  3. Stereotype Risk
  4. Responsible AI
Show Answer

The correct answer is A. The degree to which feedback is believable and decision-relevant because its source, reasoning, evidence, and limitations are clear. The situation calls for this concept because its defining purpose matches the action or evidence described. The alternatives instead point toward Automation Bias, Stereotype Risk, Responsible AI, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Feedback Credibility

See: Feedback Credibility