Skip to main content

Table 3 Accuracy and inter-rater reliability

From: The design and implementation of an obstetric triage system for unscheduled pregnancy related attendances: a mixed methods evaluation

Measure

Percentage of agreement

ICC (95% CI)

Unweighted IRR (95% CI) c

Green

98.33%

a

0.94 (0.93–1.0)

Yellow

68.33%

0.50 (0.15–0.99)b

0.70 (0.67–0.85)

Orange

96.67%

a

0.83 (0.82–0.88)

Red

100%

a

0.97 (0.96–1.00)

Overall

90.83%

0.961 (0.91–0.99)

0.85 (.85–.89)

  1. aunable to compute ICC due to low variance – scores are to highly consistent
  2. bNumber should be interpreted with caution due to low variance and large CIs
  3. cLight Kappa statistic used to compute unweighted IRR
  4. dBootstrap – t utilised to adjust confidence intervals [1]