Skip to main content

Table 1 Impact of prevalence and bias on agreement (kappa) between administrative case definitions and medical records

From: Mental comorbidity and multiple sclerosis: validating administrative data to support population-based surveillance

Comorbidity

Case definition

Comparison to medical records

Prevalence index

Bias index

Adjusted kappa

 

No. years of data

No. and type of claimsa

Sens (95% CI)

Spec (95% CI)

Observed kappa (95% CI)

   

Omnibus (Any Mental)

2

≥ 1 H or ≥ 5 P OR (≥ 1 P AND ≥ 4 Rx)

63.5 (54.0, 72.2)

86.8 (82.1, 90.6)

0.51 (0.41, 0.60)

0.42

0.01

0.60

Any Mood or anxiety disorder

2

≥ 1 H or ≥ 5 P OR (≥ 1 P AND ≥ 4 Rx)

62.8 (53.2, 71.7)

86.9 (82.2, 90.6)

0.50 (0.41, 0.60)

0.43

0.01

0.60

Depression

2

≥ 1 H or ≥ 5 P OR (≥ 1 P AND ≥ 7 Rx)

62.2 (52.4, 71.2)

86.7 (82.2, 90.4)

0.49 (0.40, 0.59)

0.45

0

0.60

Bipolar disorder

5

≥ 1 H or ≥ 3P OR (≥ 1 P AND ≥ 3 Rx)

75.0 (19.4, 99.4)

97.5 (95.5, 99.4)

0.30 (0.036, 0.57)

0.95

0.02

0.94

Anxiety

2

≥ 1 H or ≥ 2 P OR (≥ 1 P AND ≥ 2 Rx)

42.3 (23.3, 63.1)

82.2 (78.0, 85.9)

0.23 (0.022, 0.23)

0.74

0.12

0.69

Schizophrenia

2

≥ 1 H or ≥ 2 P

1.0 (15.8, 100)

0.99 (98.6, 100)

1.0 (0, 1.0)

0.99

0

1.0