Verbatim · Inter-coder reliability
Krippendorff's alpha (nominal)
Any number of coders, missing data permitted; the recommended general-purpose reliability index for content analysis. Bootstrap CI per Hayes & Krippendorff (2007).
alpha = 1 - Do/De, from the coincidence matrix on the nominal metric (delta_ck = 1 if c!=k)
- Measurement level
- nominal
- Coders
- Any number of coders; coverage may be unequal.
- Seminal reference
- Krippendorff (2004), Content Analysis 2nd ed., Ch.11; Krippendorff (2011/2007) Computing Krippendorff's Alpha-Reliability
Benchmark bands
Benchmarks are reporting guidance, not strict cut-offs — the engine presents them with their source.
| Agreement | Reading | Source |
|---|---|---|
| 0.80 – 1.0 | acceptable | Krippendorff (2004), p.241; Hayes & Krippendorff (2007) p.79 — rely on variables with alpha>=.80 |
| 0.67 – 0.80 | tentative | Krippendorff (2004), p.241 — draw tentative conclusions in the .667-.80 range |
| -1.0 – 0.67 | insufficient | Krippendorff (2004), p.241 |
Verbatim computes Krippendorff's alpha (nominal) with a deterministic, golden-verified math kernel — never a language model — with a bootstrap confidence interval and full provenance (coder + unit + kernel + fixture + run-id). The number is measured; the interpretation stays yours.
Measure this in the workshop →