Completeness and timeliness of reporting of meningococcal disease--Maine, 2001-2006.
Maine law requires that all health-care providers, laboratories, and health-care facilities report meningococcal disease (upon recognition or strong suspicion) immediately by telephone to MDHHS. Reports are assigned to epidemiologists for investigation. Reports meeting the Council of State and Territorial Epidemiologists (CSTE) and CDC case definition for meningococcal disease * are entered in the National Electronic Disease Surveillance System. ([dagger]) Beginning in 2006, the CSTE-CDC case definition was revised to include suspected cases of meningococcal disease; in previous years, the case definition only included categories for confirmed and probable cases.
MHDO maintains the state's hospital discharge dataset, which includes inpatient and outpatient visits for all nonfederal, acute-care hospitals in the state. International Classification of Diseases, 9th Revision (ICD-9) codes 036.0-036.9 (for meningococcal disease) were used to identify patients with meningococcal disease. The dataset did not contain patient names, so MHDO data were matched with MDHHS data for the period 2001-2006 using date of birth, admission date, and hospital. Persons who were in both datasets were considered to have verified cases of meningococcal disease. Hospital records were reviewed for patients who were in the MHDO dataset but who had not been reported to MDHHS.
The utility of various ICD-9 codes and clinical settings for identifying cases of meningococcal disease from the MHDO dataset was examined by calculating sensitivity and positive predictive value (PPV) (Table 1). The completeness of meningococcal disease reporting was estimated by the Sekar-Deming capture-recapture method (3) ([section]) (Table 2). The capture-recapture method provides an estimate of the actual total number of cases (reported or unreported) and the completeness of disease reporting using data from two independent surveillance systems (3). This technique requires being able to identify cases found in both surveillance systems, cases found only by the first surveillance system, and cases found only by the second surveillance system (3). Cases that could not have been reported to both MDHHS and MHDO were excluded from the capture-recapture analysis. These cases included out-of-state residents hospitalized in Maine who would not have been included in MDHHS records and Maine residents hospitalized out of state or at a Veterans Health Administration (VHA) facility in the state who would not have been included in the MHDO dataset. Timeliness of reporting was assessed by determining the difference in days between hospital admission and notification to MDHHS.
A total of 52 cases of meningococcal disease were reported to MDHHS during 2001-2006. These cases included two that occurred in Maine residents hospitalized out-of-state and one in a person hospitalized at a VHA facility in Maine. A total of 107 patients were identified in the MHDO dataset. A total of 42 patients were in both the MHDO and MDHHS datasets and were considered to have verified cases of meningococcal disease. Hospital records were reviewed for the 65 patients who were in the MHDO dataset but not in the MDHHS dataset. Nine (14%) of these patients were determined to have had meningococcal disease using the CSTE-CDC case definition; these included eight cases in out-of-state residents hospitalized in Maine. The remaining 56 patients in the MHDO dataset did not meet the CSTE-CDC case definition. Of these 56, 19 (34%) had meningeal signs but neither clinical purpura fulminans nor laboratory evidence of N. meningitides; 15 (27%) were coded incorrectly (e.g., with diagnoses other than meningococcal disease); 13 (23%) had noninvasive infections (e.g., a positive sputum culture for N. meningitides); and nine (16%) had medical records that were missing or incomplete.
In the analysis of the utility of various ICD-9 codes for identifying cases of meningococcal disease using MHDO data, sensitivity (92%) and PPV (53%) were highest when a combination of code 036.0 (meningococcal meningitis) or 036.2 (meningococcemia) was used (Table 1). Other ICD-9 codes for meningococcal disease (036.1 and 036.3-036.9) had poor sensitivity and PPV. Inpatient data were more sensitive and had higher PPV than outpatient data. The completeness of reporting for meningococcal disease to MDHHS was estimated at 97.6% (95% confidence interval = 95.9%-99.3%) (Table 2), based on MDHHS receiving reports on 49.0 of 50.2 total cases. Information was sufficient to assess timeliness of reporting for 43 (83%) of 52 cases reported to MDHHS. Reports were received in a median of 1 day (range: 0-11 days); 35% of cases were reported to MDHHS on the day of hospital admission, 56% were reported within 1 day, and 79% were reported within 2 days. No secondary cases of meningococcal disease among close contacts of patients with meningococcal disease were reported in Maine during the study period.
Editorial Note: Because of the severity of meningococcal disease symptoms, nearly all patients are treated in a hospital or emergency department setting. This results in a dataset (i.e., hospital discharge data) that can be compared with public health surveillance records to estimate the completeness of reporting to health departments using the capture-recapture technique (3). Most other nationally notifiable conditions either 1) do not result in routine hospitalization (e.g., salmonellosis) or 2) do not occur frequently enough at the state level (e.g., botulism) to allow use of the capture-recapture technique. Therefore, meningococcal disease provides an uncommon opportunity to assess completeness of reporting using hospital discharge data.
Six other studies using the capture-recapture technique to compare health department data with hospital discharge data have described the completeness of meningococcal disease reporting. The results have ranged from 64% to 95%, with a median value of 94% (4-9). The only published study from the United States was conducted in New York State in 1991 and reported 93% completeness (4). Completeness of reporting for meningococcal disease likely is considerably higher than for most other notifiable conditions because of the severity of the illness and the availability of a widely accepted public health intervention.
Although most cases of meningococcal disease were reported to MDHHS in a timely manner, 44% were reported more than 1 day after hospital admission. In the 1991 New York study, 34% of cases were reported more than 1 day after diagnosis (4). Timeliness of reporting is important for this disease because chemoprophylaxis of close contacts of an index patient is most effective when administered as soon as possible; ideally, chemoprophylaxis should be started within 24 hours after identification of the index case, but not later than 14 days after illness onset (1).
During the attempt to identify cases of meningococcal disease in the MHDO dataset, certain diagnostic codes (i.e., 036.1 and 036.3-036.9) and outpatient data had poor sensitivity and PPV. Because each potential case required medical record review for confirmation, considerable effort was required to identify a small number of actual cases. For example, of 38 reports of meningococcal disease among outpatients in the hospital discharge dataset, only two (5%) cases were verified after reviewing medical records.
The findings in this report are subject to at least two limitations. First, the two data systems used in this analysis might not have been completely independent because information from hospitals was included in both MHDO and MDHHS datasets. This type of dependence between data sources might result in an overestimate of the completeness of reporting (10). Second, some of the 19 patients in the MHDO dataset with meningeal signs, but neither clinical purpura fulminans nor laboratory evidence of N. meningitides, might have met the definition for a suspected case if such a category had existed before 2006. This might have affected the estimate for the completeness of reporting.
Passive disease surveillance efforts appear to have been adequate for achieving near complete reporting of meningococcal disease in Maine; however, timeliness of reporting was sometimes suboptimal. Evaluation of this surveillance system should be repeated periodically to determine whether completeness of reporting remains high and timeliness improves. Other attributes of surveillance systems (e.g., simplicity, representativeness, and acceptability) also should be assessed in future evaluations. In Maine, a delay of approximately 18 months after the end of a calendar year occurs before hospital discharge data for that year become available. This delay limits usage of the data for public health surveillance. When hospital discharge data become available on a real-time basis in Maine, MDHHS will need to determine how best to use this information, given the apparent limitations of ICD-9 codes in the MHDO dataset for identifying cases of meningococcal disease.
The findings in this report are based, in part, on contributions by E Bartlett, Houlton Regional Hospital; T Beaulier-Fuller, Aroostook Medical Center; C Bouley, Mercy Hospital; S Dirrigl, Southern Maine Medical Center; D Dunton, H Elliot, D Fenn, and D McKenney, Eastern Maine Medical Center; P Hadley, Franklin Memorial Hospital; E King, Maine General Hospital; B MacPike, Maine Coast Memorial Hospital; D Peabody, St. Joseph Healthcare; C Reeder, York Hospital; P Rybak, Mercy Hospital; D Skalina, Central Maine Medical Center; D Theriault, St. Mary's Hospital; B Wagner, Maine Medical Center; S Whiting, Reddington-Fairview Hospital; P Carson, D Guppy, L LaRochelle, L Parker, and A Robbins, Maine Dept of Health and Human Svcs; and D Baughman and A Cohn, Div of Bacterial Diseases, National Center for Immunization and Respiratory Diseases, CDC.
(1.) CDC. Prevention and control of meningococcal disease: recommendations of the Advisory Committee on Immunization Practices (ACIP). MMWR 2005;54(No. RR-7).
(2.) CDC. Summary of notifiable diseases, United States, 2007. MMWR 2007;56(53) (in press).
(3.) Sekar CC, Deming WE. On a method of estimating birth and death rates and extent of registration. J Amer Stat Assoc 1949;44:101-15.
(4.) Ackman DM, Birkhead G, Flynn M. Assessment of surveillance for meningococcal disease in New York State, 1991. Am J Epidemiol 1996;144:78-82.
(5.) Rivest P, Sagot B, Bedard L. Evaluation of the completeness of reporting of invasive meningococcal disease. Can J Public Health 1999;90:250-2.
(6.) Robinson P. Meningococcal disease and the law: does non-notification really happen? Commun Dis Intell 1999;23:97-101.
(7.) Breen E, Ghebrehewet S, Regan M, Thomson AP. How complete and accurate is meningococcal disease notification? Commun Dis Public Health 2004;7:334-8.
(8.) de Greeff SC, Spanjaard L, Dankert J, Hoebe CJ, Nagelkerke N, de Melker HE. Underreporting of meningococcal disease incidence in the Netherlands: results from a capture-recapture analysis based on three registration sources with correction for false positive diagnoses. Eur J Epidemiol 2006;21:315-21.
(9.) Berghold C, Berghold A, Fulop G, Heuberger S, Strauss R, Zenz W. Invasive meningococcal disease in Austria 2002: assessment of completeness of notification by comparison of two independent data sources. Wien Klin Wochenschr 2006;118:31-5.
(10.) Brenner H. Use and limitations of the capture-recapture method in disease monitoring with two dependent sources. Epidemiology 1995;6:42-8.
Reported by: V Rea, MPH, Maine Dept of Health and Human Svcs and Univ of Southern Maine. A Pelletier, MD, Coordinating Office for Terrorism Preparedness and Emergency Response, CDC.
* Case definition available at http://www.cdc.gov/ncphi/disss/nndss/casedef/ case_definitions.htm.
([dagger]) Additional information available at http://www.cdc.gov/nedss.
([section]) Completeness of reporting was calculated as R / N, and the 95% confidence interval was calculated as R / N [+ or -] 1.96 Var [(N).sup.1/2] where Var (N) = (R x S x [N.sub.1] x [N.sub.2]) / [C.sup.3]. R = number of cases identified in MDHHS dataset, N = estimated total number of cases of meningococcal disease in Maine during 2001-2006 calculated as C + [N.sub.1] + [N.sub.2] + X where X = ([N.sub.1] x [N.sub.2]) / C, S = number of cases identified in MHDO dataset, N1 = number of cases identified only in MDHHS dataset, [N.sub.2] = number of cases identified only in MHDO data, and C = number of cases identified in both MDHHS and MHDO datasets.
TABLE 1. Sensitivity and positive predictive value of hospital discharge data to identify meningococcal disease, by diagnostic code and clinical setting--Maine, 2001-2006 Cases * Noncases ICD-9 ([paragraph]) code 036.0 (meningococcal meningitis) 19 31 036.2 (meningococcemia) 28 11 036.0 or 036.2 47 42 036.1 or 036.3-036.9 4 14 Clinical setting Inpatient 49 20 Outpatient 2 36 Total 51 56 Positive Sensitivity predictive value (%) ([dagger]) (%) ([section]) ICD-9 ([paragraph]) code 036.0 (meningococcal meningitis) 37 38 036.2 (meningococcemia) 55 72 036.0 or 036.2 92 53 036.1 or 036.3-036.9 8 22 Clinical setting Inpatient 96 71 Outpatient 4 5 Total 100 48 * Meeting the Council of State and Territorial Epidemiologists and CDC case definition for meningococcal disease, available at http://www.cdc.gov/ncphi/disss/nndss/casedef/case_definitions.htm. Cases included persons with meningococcal disease in both Maine Health Data Organization (MHDO) and Maine Department of Health and Human Services datasets (n = 42) and those reported only to MHDO (n = 9). Eight persons who were reported only to MHDO were out-of-state residents hospitalized in Maine. ([dagger]) Calculated as follows: [(cases) / 51] x 100%. ([section]) Calculated as follows: [(cases) / (cases + noncases)] x 100%. ([paragraph]) International Classification of Diseases, 9th Revision. TABLE 2. Estimated completeness * of reporting for meningococcal disease--Maine, 2001-2006 Maine Department of Health and Human Services (MDHHS) Cases ([dagger]) Cases not reported reported All cases Cases (C) ([N.sub.2)] (S) ([section]) 42 1 43 Maine Health reported Data Organization Cases not ([N.sub.1]) (X) MHDO) reported 7 0.2# 7.2# ([paragraph]) All cases (R) (N) 49 1.2# 50.2# ** * Calculated by using the Sekar-Deming capture-recapture method (3). Calculated estimates are in italics. Completeness of reporting was calculated as R / N, and the 95% confidence interval was calculated as R / N [+ or -] 1.96 Var [(N).sup.1/2] where Var (N) = (R x S x [N.sub.1] x [N.sub.2]) / [C.sup.3]. R = number of cases identified in MDHHS dataset, N = estimated total number of cases of meningococcal disease in Maine during 2001-2006, S = number of cases identified in MHDO dataset, [N.sub.1] = number of cases identified only in MDHHS dataset, [N.sub.2] = number of cases identified only in MHDO dataset, and C = number of cases identified in both MDHHS and MHDO datasets. ([dagger]) Meeting the Council of State and Territorial Epidemiologists and CDC case definition for meningococcal disease, available at http://www.cdc.gov/ncphi/disss/nndss/ casedef/case_definitions.htm. Cases excluded were those in Maine residents hospitalized out of state (n = 2) and in patients hospitalized at Veterans Health Administration facilities in Maine (n = 1). ([section]) Meeting the Council of State and Territorial Epidemiologists and CDC case definition for meningococcal disease. Cases excluded were in out-of-state residents who were hospitalized in Maine (n = 8). ([paragraph]) Estimated number of cases not reported to either MDHHS or MHDO. Calculated as follows: X = ([N.sub.1] x [N.sub.2]) / C. ** Estimated number if all cases were reported. Calculated as follows: N = C + [N.sub.1] + [N.sub.2] + X. Note: Calculated estimates are in italics indicated with #.
|Printer friendly Cite/link Email Feedback|
|Author:||Rea, V.; Pelletier, A.|
|Publication:||Morbidity and Mortality Weekly Report|
|Date:||Feb 27, 2009|
|Previous Article:||Arthritis as a potential barrier to physical activity among adults with heart disease--United States, 2005 and 2007.|
|Next Article:||Table I. Provisional cases of infrequently reported notifiable diseases (<1,000 cases reported during the preceding year)--United States, week ending...|