Theory 218/Peer review/Threshold lens
Decisions Need an Agreement Threshold
The claim
A decision is reliable only above a threshold in inter-reviewer agreement, below which the outcome is largely noise.
01Mechanism
The decision reflects the shared signal plus independent noise; the threshold marks where the signal dominates.
02Prediction
Decision reliability should track agreement.
03Refutation
Reliability tracking reviewer seniority would remove agreement.