Dual Screening
What is dual screening?
Dual screening is the gold standard for systematic reviews. Two independent reviewers screen the same set of papers separately, then conflicts are resolved through discussion or a third reviewer.
How it works in Oryn
1. In the Criteria stage, enable Dual Screening mode
2. Two reviewers are assigned: Reviewer 1 and Reviewer 2
3. Each reviewer screens all papers independently (decisions are blinded from each other)
4. When both reviewers finish, Oryn automatically compares decisions
5. Agreements are finalized. Conflicts are flagged for resolution.
Conflict resolution
- See both reviewers' decisions side by side for each conflicting paper
- Read both reviewers' reasoning (if notes were added)
- Choose the final decision: Include, Exclude, or Maybe
- Optionally add a resolution note
Inter-rater reliability
Oryn calculates Cohen's kappa to measure agreement between reviewers:
| Kappa | Interpretation |
|---|---|
| 0.81-1.00 | Almost perfect agreement |
| 0.61-0.80 | Substantial agreement |
| 0.41-0.60 | Moderate agreement |
| Below 0.40 | Fair or poor agreement |
This metric is reported in your export and can be included in your methods section.
Tip
Dual screening is recommended for reviews intended for peer-reviewed publication. For rapid evidence assessments or scoping reviews, single-reviewer screening may be sufficient.