Skip to main content

Table 1 Impact of prevalence and bias on agreement (kappa) between administrative case definitions and medical records

From: Mental comorbidity and multiple sclerosis: validating administrative data to support population-based surveillance

Comorbidity Case definition Comparison to medical records Prevalence index Bias index Adjusted kappa
  No. years of data No. and type of claimsa Sens (95% CI) Spec (95% CI) Observed kappa (95% CI)    
Omnibus (Any Mental) 2 ≥ 1 H or ≥ 5 P OR (≥ 1 P AND ≥ 4 Rx) 63.5 (54.0, 72.2) 86.8 (82.1, 90.6) 0.51 (0.41, 0.60) 0.42 0.01 0.60
Any Mood or anxiety disorder 2 ≥ 1 H or ≥ 5 P OR (≥ 1 P AND ≥ 4 Rx) 62.8 (53.2, 71.7) 86.9 (82.2, 90.6) 0.50 (0.41, 0.60) 0.43 0.01 0.60
Depression 2 ≥ 1 H or ≥ 5 P OR (≥ 1 P AND ≥ 7 Rx) 62.2 (52.4, 71.2) 86.7 (82.2, 90.4) 0.49 (0.40, 0.59) 0.45 0 0.60
Bipolar disorder 5 ≥ 1 H or ≥ 3P OR (≥ 1 P AND ≥ 3 Rx) 75.0 (19.4, 99.4) 97.5 (95.5, 99.4) 0.30 (0.036, 0.57) 0.95 0.02 0.94
Anxiety 2 ≥ 1 H or ≥ 2 P OR (≥ 1 P AND ≥ 2 Rx) 42.3 (23.3, 63.1) 82.2 (78.0, 85.9) 0.23 (0.022, 0.23) 0.74 0.12 0.69
Schizophrenia 2 ≥ 1 H or ≥ 2 P 1.0 (15.8, 100) 0.99 (98.6, 100) 1.0 (0, 1.0) 0.99 0 1.0