Quiz: Scientific Literacy
Test your understanding of scientific reasoning, source evaluation, and statistical literacy with these review questions.
1. What is the difference between a scientific theory and a hypothesis?
- A hypothesis is always true while a theory is just a guess
- A theory is a well-supported explanation backed by extensive evidence while a hypothesis is a testable prediction
- A hypothesis applies to all situations while a theory applies only to specific cases
- A theory becomes a law once enough scientists agree with it
Show Answer
The correct answer is B. A hypothesis is a specific, testable prediction about what will happen under certain conditions. A theory is a broad, well-supported explanation of natural phenomena that has been confirmed through extensive evidence, repeated testing, and peer review. Theories do not become laws -- they are different types of scientific knowledge. The theory of evolution and germ theory of disease are examples of robust theories supported by overwhelming evidence.
Concept Tested: Theory
2. Why is peer review important for maintaining scientific credibility?
- It ensures that only the most popular research ideas get published
- Independent experts evaluate research methods, evidence, and conclusions before publication
- It guarantees that all published studies produce correct results
- It allows the public to vote on which scientific findings should be accepted
Show Answer
The correct answer is B. Peer review is the process by which independent experts in the same field critically evaluate a research paper's methods, data, analysis, and conclusions before it is published in a scientific journal. This process helps catch errors, identify weaknesses in experimental design, and ensure that claims are supported by evidence. While not perfect, peer review is the best quality control mechanism science has developed.
Concept Tested: Peer Review
3. Which logical fallacy involves presenting only two options when more alternatives exist?
- Cherry-picking data
- Appeal to nature
- False dichotomy
- Anecdotal evidence
Show Answer
The correct answer is C. A false dichotomy (also called false dilemma or either/or fallacy) presents a situation as having only two possible options when in reality there are more alternatives. In environmental debates, this might sound like "We either destroy the economy or destroy the environment" -- ignoring many approaches that address both concerns. Recognizing false dichotomies helps identify oversimplified arguments and explore nuanced solutions.
Concept Tested: False Dichotomy
4. What does it mean when scientists say "correlation does not equal causation"?
- Statistical correlations are always coincidental and never meaningful
- Two variables changing together does not prove that one causes the other
- Causation can only be proven through correlational studies
- Correlation is a stronger form of evidence than experimental testing
Show Answer
The correct answer is B. When two variables are correlated, they change together in a pattern -- but this does not prove that one causes the other. A third variable might cause both (confounding variable), the relationship might be coincidental, or the causal direction might be reversed. For example, ice cream sales and drowning rates both increase in summer, but ice cream does not cause drowning -- warm weather drives both. Establishing causation requires controlled experiments or very strong evidence ruling out alternatives.
Concept Tested: Correlation vs Causation
5. What is cherry-picking data and why is it problematic?
- Collecting data from the best possible study locations to ensure high-quality results
- Selecting only the data points that support a predetermined conclusion while ignoring contradictory evidence
- Using the most recent data instead of historical data in scientific analyses
- Organizing data from smallest to largest before performing statistical analysis
Show Answer
The correct answer is B. Cherry-picking involves selecting only the data points or studies that support a predetermined conclusion while ignoring evidence that contradicts it. For example, showing one unusually cold year to argue against climate change while ignoring the overall warming trend of decades of data. This is a common tactic in misleading environmental arguments. Honest science considers all available evidence, including data that challenges the researcher's hypothesis.
Concept Tested: Cherry-Picking Data
6. Why does sample size matter in scientific studies?
- Larger samples are always more expensive and therefore more prestigious
- Larger samples produce more reliable results with smaller margins of error
- Only studies with exactly 1,000 participants are considered scientifically valid
- Sample size determines whether a study can be published in a journal
Show Answer
The correct answer is B. Larger sample sizes generally produce more reliable and representative results because they better capture the true variability in a population. With a small sample, unusual values can skew results significantly. Larger samples also yield smaller margins of error and narrower confidence intervals, giving scientists greater confidence in their findings. When evaluating environmental claims, always check how many subjects or data points were included.
Concept Tested: Sample Size
7. What is the precautionary principle and how does it apply to environmental decisions?
- The idea that all new technologies should be banned until proven completely safe
- The principle that when an action threatens harm to the environment, precautionary measures should be taken even without full scientific certainty
- The requirement that scientists must achieve 100% consensus before any environmental regulation is enacted
- The guideline that environmental protection should only occur after economic costs are fully calculated
Show Answer
The correct answer is B. The precautionary principle states that when an action raises threats of harm to human health or the environment, precautionary measures should be taken even if some cause-and-effect relationships are not fully established scientifically. It shifts the burden of proof to those proposing potentially harmful activities. This principle is particularly relevant for issues like new chemical regulation, where waiting for complete certainty could allow irreversible damage.
Concept Tested: Precautionary Principle
8. How should you evaluate a potential conflict of interest in a scientific study?
- Any study with industry funding is automatically invalid and should be rejected
- Consider who funded the research and whether the funder has a financial stake in the outcome
- Only studies funded by government agencies are free from conflicts of interest
- Conflicts of interest only exist in medical research, not environmental science
Show Answer
The correct answer is B. When evaluating research, consider who funded the study and whether the funder could benefit from a particular outcome. A study on pesticide safety funded by a pesticide company deserves extra scrutiny, though it is not automatically invalid. Look for independent replication of results, examine whether funding is disclosed, and check whether findings align with the broader body of research. Conflicts of interest do not prove bias, but they warrant careful examination.
Concept Tested: Conflicts of Interest
9. What distinguishes scientific consensus from unanimous agreement?
- Scientific consensus requires 100% agreement among all scientists worldwide
- Scientific consensus means the overwhelming majority of experts agree based on the weight of evidence
- Scientific consensus is determined by a vote at annual scientific conferences
- Scientific consensus only applies to topics that have been studied for at least 100 years
Show Answer
The correct answer is B. Scientific consensus exists when the overwhelming majority of experts in a field agree on a conclusion based on the accumulated weight of evidence. It does not require unanimous agreement -- there are almost always some dissenters. For example, over 97% of climate scientists agree that human activities are causing climate change. One contrarian study does not overturn a consensus built on thousands of studies. Consensus can change when new evidence warrants it.
Concept Tested: Scientific Consensus
10. Why is anecdotal evidence insufficient for drawing scientific conclusions?
- Anecdotal evidence is always fabricated by the person telling the story
- Personal observations are subject to bias, small sample size, and lack of controlled conditions
- Anecdotal evidence can only be collected in laboratory settings
- Scientists are not allowed to consider anecdotal evidence under any circumstances
Show Answer
The correct answer is B. Anecdotal evidence consists of personal observations or individual stories that lack controlled conditions, systematic data collection, and adequate sample sizes. "My grandfather smoked until 95" does not disprove the link between smoking and cancer. Personal observations are subject to confirmation bias, memory distortion, and the inability to account for confounding variables. While anecdotes can generate hypotheses, they cannot substitute for systematic, controlled research.
Concept Tested: Anecdotal Evidence