Skip to content

Quiz: Prompt Testing and Research Dialogue

Test your understanding of prompt testing and research dialogue with these review questions.

1. Which definition best describes Prompt Failure Mode?

  1. A recurring way a prompt produces an incorrect, inconsistent, unsafe, or unusable response.
  2. Running defined cases against a prompt to find failures and measure whether revisions improve performance.
  3. A cycle of revising a prompt, testing it, reviewing failures, and retaining changes supported by results.
  4. The degree to which repeated outputs follow the same role, criteria, format, and reasoning expectations under comparable inputs.
Show Answer

The correct answer is A. A recurring way a prompt produces an incorrect, inconsistent, unsafe, or unusable response. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward Prompt Testing, Prompt Iteration, Response Consistency, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Prompt Failure Mode

See: Prompt Failure Mode

2. Which definition best describes Ambiguous Instructions?

  1. A controlled test of two or more prompts on the same cases using the same evaluation criteria.
  2. The priority order used to resolve directions from system, developer, user, and embedded content sources.
  3. Wording that permits multiple reasonable interpretations because the requested action, scope, criteria, priority, or expected result is unclear.
  4. Writing questions that do not suggest a preferred answer or imply that one response is more acceptable.
Show Answer

The correct answer is C. Wording that permits multiple reasonable interpretations because the requested action, scope, criteria, priority, or expected result is unclear. Recognizing the precise definition prevents the term from being substituted for a nearby but different idea. The alternatives instead point toward Prompt Comparison, Instruction Hierarchy, Neutral Question Design, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Ambiguous Instructions

See: Ambiguous Instructions

3. Which statement best explains Response Consistency in this chapter's research context?

  1. It refers to this idea: Wording that permits multiple reasonable interpretations because the requested action, scope, criteria, priority, or expected result is unclear.
  2. It refers to this idea: The degree to which repeated outputs follow the same role, criteria, format, and reasoning expectations under comparable inputs.
  3. It refers to this idea: Keeping an enacted persona’s language, priorities, knowledge, and decisions aligned with its profile throughout an interaction.
  4. It refers to this idea: Follow-up questions that seek greater detail, reasoning, evidence, or clarification about an earlier response.
Show Answer

The correct answer is B. The degree to which repeated outputs follow the same role, criteria, format, and reasoning expectations under comparable inputs. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Ambiguous Instructions, Character Maintenance, Probing Questions, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Response Consistency

See: Response Consistency

4. Which statement best explains Prompt Benchmark in this chapter's research context?

  1. It refers to this idea: Prompt, evidence, and review practices that lower the frequency of unsupported statements in AI outputs.
  2. It refers to this idea: A stable set of test cases and reference results used to compare prompt or model versions.
  3. It refers to this idea: Questions that permit respondents to answer in their own words rather than choose from fixed options.
  4. It refers to this idea: An instruction asking an agent to reconsider its reasoning, evidence, assumptions, or consistency before finalizing.
Show Answer

The correct answer is B. A stable set of test cases and reference results used to compare prompt or model versions. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Hallucination Reduction, Open-Ended Questions, Reflection Prompt, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Prompt Benchmark

See: Prompt Benchmark

5. Which statement best explains Prompt Comparison in this chapter's research context?

  1. It refers to this idea: A controlled test of two or more prompts on the same cases using the same evaluation criteria.
  2. It refers to this idea: Questions whose wording or assumptions encourage a particular answer and can distort research findings.
  3. It refers to this idea: Questions based on an earlier response that clarify meaning or explore a newly revealed issue.
  4. It refers to this idea: A documented input, context, expected behavior, and pass condition used to evaluate a prompt.
Show Answer

The correct answer is A. A controlled test of two or more prompts on the same cases using the same evaluation criteria. The option explains the concept's function, not merely a tool or output associated with it. The alternatives instead point toward Leading Questions, Follow-Up Questions, Prompt Test Case, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Prompt Comparison

See: Prompt Comparison

6. A marketing team encounters this situation: The team runs ten fixed cases after every revision and records pass or fail for each requirement. Which concept should guide its interpretation?

  1. Adversarial Questions
  2. Prompt Test Case
  3. Prompt Failure Mode
  4. Prompt Testing
Show Answer

The correct answer is D. Running defined cases against a prompt to find failures and measure whether revisions improve performance. The situation calls for this concept because its defining purpose matches the action or evidence described. The alternatives instead point toward Adversarial Questions, Prompt Test Case, Prompt Failure Mode, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Prompt Testing

See: Prompt Testing

7. A marketing team encounters this situation: After a missed citation, the team revises the evidence rule and reruns the failed case. Which concept should guide its interpretation?

  1. Synthesis Prompt
  2. Prompt Iteration
  3. Prompt Comparison
  4. Instruction Hierarchy
Show Answer

The correct answer is B. A cycle of revising a prompt, testing it, reviewing failures, and retaining changes supported by results. The situation calls for this concept because its defining purpose matches the action or evidence described. The alternatives instead point toward Synthesis Prompt, Prompt Comparison, Instruction Hierarchy, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Prompt Iteration

See: Prompt Iteration

8. A marketing team encounters this situation: One case supplies an unsupported guarantee and passes only if the model flags and quotes it. Which concept should guide its interpretation?

  1. Prompt Comparison
  2. Conflicting Instructions
  3. Character Maintenance
  4. Prompt Test Case
Show Answer

The correct answer is D. A documented input, context, expected behavior, and pass condition used to evaluate a prompt. The situation calls for this concept because its defining purpose matches the action or evidence described. The alternatives instead point toward Prompt Comparison, Conflicting Instructions, Character Maintenance, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Prompt Test Case

See: Prompt Test Case

9. Which analysis most accurately distinguishes Reflection Prompt from Prompt Failure Mode?

  1. Reflection Prompt and Prompt Failure Mode are interchangeable labels for exactly the same practice.
  2. Reflection Prompt concerns A recurring way a prompt produces an incorrect, inconsistent, unsafe, or unusable response; Prompt Failure Mode concerns An instruction asking an agent to reconsider its reasoning, evidence, assumptions, or consistency before finalizing.
  3. The distinction depends only on which software product the team selects.
  4. Reflection Prompt concerns An instruction asking an agent to reconsider its reasoning, evidence, assumptions, or consistency before finalizing; Prompt Failure Mode concerns A recurring way a prompt produces an incorrect, inconsistent, unsafe, or unusable response.
Show Answer

The correct answer is D. An instruction asking an agent to reconsider its reasoning, evidence, assumptions, or consistency before finalizing. The comparison preserves each concept's distinct purpose instead of reversing or collapsing the two meanings. The alternatives instead point toward Prompt Failure Mode, Response Consistency, Leading Questions, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Reflection Prompt

See: Reflection Prompt

10. Which analysis most accurately distinguishes Synthesis Prompt from Instruction Hierarchy?

  1. Synthesis Prompt and Instruction Hierarchy are interchangeable labels for exactly the same practice.
  2. Synthesis Prompt concerns The priority order used to resolve directions from system, developer, user, and embedded content sources; Instruction Hierarchy concerns An instruction asking an agent to combine multiple findings into a coherent account while preserving important differences.
  3. Synthesis Prompt concerns An instruction asking an agent to combine multiple findings into a coherent account while preserving important differences; Instruction Hierarchy concerns The priority order used to resolve directions from system, developer, user, and embedded content sources.
  4. The distinction depends only on which software product the team selects.
Show Answer

The correct answer is C. An instruction asking an agent to combine multiple findings into a coherent account while preserving important differences. The comparison preserves each concept's distinct purpose instead of reversing or collapsing the two meanings. The alternatives instead point toward Instruction Hierarchy, Neutral Question Design, Adversarial Questions, or detach the concept from the evidence and decision it is meant to support. Keeping those ideas distinct helps the team state its method, claim, and limits explicitly.

Concept Tested: Synthesis Prompt

See: Synthesis Prompt