Complete the 12 sentences below. Choose the best answer for each one. Some sentences have two correct answers. Choose both.
1Given the sampling frame, the observed effect ............... an artefact of selection rather than a genuine treatment impact.
Wrong!
"Might be" presents the artefact explanation as possible rather than certain.
2If the instrument is valid, the divergence ............... to measurement error alone.
Wrong!
"Cannot be attributed" rules out measurement error as the only explanation.
3The null finding ............... as evidence of absence, given the study's limited power.
Wrong!
"Should not be interpreted" warns against drawing too strong a conclusion from the null finding.
4On the basis of the archival record alone, we ............... whether the policy shift was intentional.
Wrong!
"Cannot determine" shows that the archival record alone is not enough to decide the question.
5The pattern is consistent with a threshold effect, though it ............... from unobserved heterogeneity.
Wrong!
"Could arise" keeps unobserved heterogeneity open as a possible alternative explanation.
6The unusually narrow confidence interval ............... a reporting error, so we rechecked the code.
Select 2 answers.
Wrong!
"Might indicate" and "may indicate" both express a possible sign rather than a certainty.
7Even under generous assumptions, the proposed mechanism ............... the magnitude of the observed change.
Wrong!
"Cannot explain" says the proposed mechanism is not able to account for the observed change.
8The authors' conclusion ............... premature, since the replication attempt is still underway.
Wrong!
"May be" cautiously suggests that the conclusion is possibly premature.
9The discrepancy ............... to differences in case definition, but the paper provides no coding appendix.
Wrong!
"May be due" gives a tentative explanation for the discrepancy.
10From these premises it ............... that the model is misspecified; at most, they show that it fits some subsamples poorly.
Wrong!
"Does not follow" denies that model misspecification is a necessary conclusion from the premises.
11The evidence is suggestive but ............... to warrant a causal claim in the abstract.
Wrong!
"Insufficient" means the evidence is not strong enough to support a causal claim.
12The convergence of independent datasets ............... that the effect is robust across contexts.
Select 2 answers.
Wrong!
"Suggests" and "indicates" present the conclusion cautiously, while avoiding an overstrong claim.
Exercise complete
0 out of 12
correct answers
Answers
- Given the sampling frame, the observed effect might be an artefact of selection rather than a genuine treatment impact.
- If the instrument is valid, the divergence cannot be attributed to measurement error alone.
- The null finding should not be interpreted as evidence of absence, given the study’s limited power.
- On the basis of the archival record alone, we cannot determine whether the policy shift was intentional.
- The pattern is consistent with a threshold effect, though it could arise from unobserved heterogeneity.
- The unusually narrow confidence interval might indicate / may indicate a reporting error, so we rechecked the code.
- Even under generous assumptions, the proposed mechanism cannot explain the magnitude of the observed change.
- The authors’ conclusion may be premature, since the replication attempt is still underway.
- The discrepancy may be due to differences in case definition, but the paper provides no coding appendix.
- From these premises it does not follow that the model is misspecified; at most, they show that it fits some subsamples poorly.
- The evidence is suggestive but insufficient to warrant a causal claim in the abstract.
- The convergence of independent datasets suggests / indicates that the effect is robust across contexts.