Dual Screening in Systematic Reviews
Why two reviewers screen independently, how to resolve conflicts, and when single screening is acceptable.
What Is Dual Screening?
Dual screening (or independent double screening) means two reviewers screen the same set of papers independently, without seeing each other's decisions. Their decisions are compared afterwards, and disagreements are resolved through discussion or a third reviewer.
Reviewer A
Screens all papers independently
Reviewer B
Screens all papers independently
Conflict Resolution
Disagreements are discussed or adjudicated
Why Is Dual Screening Important?
Reduces Error
A single reviewer may miss 5â10% of relevant papers due to fatigue, misunderstanding criteria, or subjective interpretation. A second reviewer catches these errors.
Minimizes Bias
Independent screening prevents one reviewer's biases (confirmation bias, familiarity bias) from dominating the selection process.
Required by Guidelines
Cochrane Handbook, JBI Manual, and most journals require or strongly recommend dual screening for systematic reviews.
Measurable Quality
Inter-rater reliability (Cohen's kappa) proves that your screening process was consistent and reproducible.
Measuring Agreement: Cohen's Kappa
Cohen's kappa (Îș) measures the level of agreement between two reviewers, adjusting for chance. Report this in your methodology section.
| Kappa (Îș) | Agreement Level | Interpretation |
|---|---|---|
| < 0.20 | Poor | Criteria need refinement â run another pilot |
| 0.21â0.40 | Fair | Some disagreement â discuss and clarify criteria |
| 0.41â0.60 | Moderate | Acceptable for most reviews |
| 0.61â0.80 | Substantial | Good agreement â proceed with confidence |
| 0.81â1.00 | Almost Perfect | Excellent â criteria are very clear |
When Is Single Screening Acceptable?
While dual screening is the gold standard, single screening may be acceptable in certain situations:
When speed is prioritized over exhaustive recall
When active learning provides a "second eye" with relevance rankings and AI recommendations
Continuous updates where dual screening of every new batch may be impractical
Dual Screening in Lumina
Lumina supports blinded dual screening out of the box. Two team members screen independently, and conflicts are flagged automatically for resolution.
- â Blinded mode â reviewers can't see each other's decisions
- â Automatic conflict detection
- â Built-in conflict resolution interface
- â AI still ranks papers for both reviewers