Health benefits, risks, and cost-effectiveness of influenza vaccination of children.

We estimated cost-effectiveness of annually vaccinating children not at high risk with inactivated influenza vaccine (IIV) to range from US $12,000 per quality-adjusted life year (QALY) saved for children ages 6-23 months to $119,000 per QALY saved for children ages 12-17 years. For children at high risk (preexisting medical conditions) ages 6-35 months, vaccination with IIV was cost saving. For children at high risk ages 3-17 years, vaccination cost $1,000-$10,000 per QALY. Among children not at high risk ages 5-17 years, live, attenuated influenza vaccine had a similar cost-effectiveness as IIV. Risk status was more important than age in determining the economic effects of annual vaccination, and vaccination was less cost-effective as the child's age increased. Thus, routine vaccination of all children is likely less cost-effective than vaccination of all children ages 6-23 months plus all other children at high risk.

**********

The risks of influenza, both annual epidemic and pandemic, have caused national policymakers to ask whether routine influenza vaccination should be expanded to healthy children and adults of all ages. During the 2003-04 influenza season, reports of >150 influenza-associated deaths among children and unprecedented demand for influenza vaccine highlighted the need to reevaluate the nation's influenza vaccination policies regarding children (1-3). The Advisory Committee on Immunization Practices (ACIP) and the American Academy of Pediatrics Red Book Committee have recommended that all children 6-23 months of age and their household contacts should receive annual influenza vaccination, and this policy has been widely adopted (4,5). In February 2006, the ACIP recommended expanding routine influenza vaccination to children 24-59 months old (L. Picketing, pers. comm.). However, a vote to recommend routine influenza vaccination for all children and adults failed. ACIP members requested more information on the projected health benefits, cost-effectiveness, and logistical issues regarding expanding influenza recommendations to other age groups.

Should influenza vaccine be routinely used in older children without high-risk conditions? This question is especially relevant, given the introduction of live, attenuated (intranasal) influenza vaccine (LAIV) for healthy persons ages 5-49 years, which has a higher list price than the inactivated (injected) vaccine but is also potentially more effective (6,7). Previous studies have examined the cost-effectiveness of influenza vaccination in various age groups (8-10). However, these studies may have been overly optimistic regarding vaccination because they assumed high influenza attack rates, low estimates for vaccination costs, or both, thereby limiting their use in policy decisions. Further, no studies have been published that compare the cost-effectiveness of live attenuated influenza vaccines with that of inactivated influenza vaccines.

Our objective in this study was to evaluate the cost-effectiveness of routine annual influenza vaccination, comparing live attenuated with inactivated vaccines, for children in varying age and risk groups from 6 months to 17 years. This is the first study to include measures of health preferences that allow results to be calculated in quality-adjusted life years (QALYs).

Methods

Using standard software (TreeAge Pro 2004 Software, release 6, Treeage Software, Williamstown, MA, USA), we created a mathematical model (decision tree) to estimate the effect of influenza vaccination on outcomes and costs among children. The decision tree evaluated 3 options: 1) no vaccination; 2) inactivated influenza vaccine (IIV); and 3) live, attenuated influenza vaccine (LAIV). It estimated costs and outcomes for influenza-related illness for children stratified into 10 subgroups by age (6-23 months, 2 years [24-35 months], 3-4 years, 5-11 years, 12-17 years) and risk status (high risk or not at high risk). Children were defined as being at high risk for influenza-related complications due to preexisting medical conditions (4). Since most costs and consequences related to influenza occur during a single influenza season, the time horizon of the decision tree was 1 year. Costs and effects of long-term outcomes (death, long-term sequelae of influenza-related hospitalization or vaccine adverse events), however, were also included in the model. A simplified schematic of the decision tree is shown in Figure 1. Input parameters for probabilities, costs, and outcomes were described by using probability distributions (Tables 1-3).

[FIGURE 1 OMITTED]

Natural History of Influenza

Influenza-related outcomes included in the decision tree were episodes of influenza illness (medically attended or not), otitis media, mild pneumonia (and other complications treated on an outpatient basis), hospitalizations (with and without long term sequelae), and deaths. Event rates, by age and risk group, were derived from the published literature and were supplemented by expert opinion where data were limited or unavailable (Table 1) (11-15) (see Online Appendix for full list of references; available from http://www.cdc.gov/ncidod/eid/vol12no10/05-1015. htm).

Vaccine Effectiveness

Inactivated vaccine was considered for all 10 subgroups, and LAIV was considered only for children not at high risk. Children 6 months to 4 years were included as a theoretical intended population for LAIV, although LAIV is currently licensed in the United States only for children 5-17 years. The most likely estimate for vaccine effectiveness against symptomatic influenza illness was lower for IIV (0.690) than the most likely estimate for LAIV (0.838) (Table 1) (16,17).

Vaccination-related Adverse Events

Adverse events attributable to influenza vaccination included in the decision tree were medically-attended episodes of injection site reactions, systemic reactions (defined as fever within 2-7 days of vaccination), anaphylaxis, and Guillain-Barre syndrome (Table 1). Probabilities of medically-attended vaccine adverse events were highest for the youngest age group and declined as age increased.

Costs

Costs included direct medical costs (physician visits, over-the-counter remedies, prescription drugs, diagnostic tests, and hospitalizations) and opportunity costs (parent time costs) for physician visits (Table 2). All costs were adjusted to 2003 dollars by using the medical cost component of the Consumer Price Index (available from http://data.bls.cgi-bin/surveymost?cu). Costs of physician visits for influenza illness, influenza-related hospitalizations, and vaccination-related adverse events were calculated by using a large database that reported payments for health insurance companies in the mid-Atlantic states of the United States (The Medstat Group, Ann Arbor, MI, USA). Vaccination costs included vaccine dose costs, administration costs, medical attention for vaccine adverse events, and, if an additional visit was required, parent time costs (18,19).

It is recommended that first-time recipients aged 6 months through 8 years receive 2 doses of influenza vaccine (4). Some children will also require additional office visits to be vaccinated with either 1 or 2 doses. The mean number of additional office visits needed to deliver the recommended number of doses ranged from 1.07 for children ages 6-23 months to 0.75 for children ages 5-17 years (Table 2) (20).

Health Outcomes

The model projected 4 different outcomes that were averted through vaccination: influenza episodes, hospitalizations, deaths, and QALYs. The QALY is a measure of net health effects that takes into account the health benefits of averted influenza cases as well as the health costs of vaccination-related adverse events. We obtained QALY valuations for each health event in the model from 2 studies (Table 3) (21,22). In these studies, adult respondents were asked for the amount of time that they were willing to give up from the end of their life to prevent a specific temporary health state in a hypothetical child. We explicitly asked respondents to include a parent's reduction in quality of life associated with a child's illness and any time lost from work to care for a sick child in the time-tradeoff valuation; therefore, time-tradeoff amounts could exceed the length of the event. QALYs lost due to severely disabling long-term sequelae after influenza hospitalization, such as acute necrotizing encephalopathy with irreversible neurologic damage, were also included (23,24). An influenza-related death was assumed to result in the loss of 1 QALY for each year of life lost.

Analysis Plan

The primary outcome measure was the incremental cost-effectiveness ratio in dollars per QALY. Secondary measures included costs and events averted per 1,000 vaccinated children, dollars per influenza-related event avoided, dollars per hospitalization avoided, and dollars per death averted. One-way sensitivity analyses were conducted on all variables, in which the impact on the average $/QALY saved was examined by altering each variable within the range of given values (Table 1). Two-way sensitivity analyses were conducted on variables for which the results were most sensitive in 1-way sensitivity analysis. A scenario analysis examined the effect of excluding parent time costs. Another scenario analysis evaluated the effect of using an alternative calculation for quality adjustments, which used the duration of the health state in the child as the denominator instead of respondent's life expectancy. To evaluate the effects of parameter uncertainty, a probabilistic sensitivity analysis was conducted. For the probabilistic sensitivity analysis, each variable was assigned a distribution of possible values, assuming [beta] distributions for probabilities and quality adjustments and log-normal distributions for costs (a technical appendix listing details of all distributions is available online at http://www. cdc.gov/ncidod/eid/vol12no 10/05-1015.htm). For each run in the probabilistic sensitivity analysis, the model randomly picked a different value for each variable from its associated distribution. The model was run 10,000 times for each age-risk and vaccine combination separately. Cost-effectiveness acceptability curves show the cumulative probabilities of the cost-effectiveness ratio, from $0 to $250,000/QALY, due to vaccinating children against influenza (i.e., the curves display the probability of the cost-effectiveness being less than or equal to a given $/QALY amount), by using the results from the Monte Carlo analysis.

Results

Health Benefits, Risks, and Costs

Influenza vaccination with IIV was projected to be cost saving for children ages 6-35 months at high risk and to require a net investment for all other age and risk groups. The projected benefits of vaccination decreased as age increased (Table 4). For example, routine influenza vaccination with IIV of children 6-23 months old not at high risk was projected to avert 108 influenza events per 1,000, while vaccination of 5- to 11-year-old children was projected to averted 55 influenza events per 1,000. Among the 5- to 11-year-olds not at high risk, the projected number of influenza-related hospitalizations and deaths averted by influenza vaccination with IIV was only one tenth the number averted among 6- to 23-month-old children not at high risk. For children not at high-risk age >5 years, the number of projected influenza events averted was similar for LAIV and IIV.

QALYs and Cost-Effectiveness

All vaccination strategies had net positive QALYs gained, which indicated that the health benefits of vaccination outweighed the risks (Table 4). For children not at-high risk, the QALYs gained by IIV use were highest for 6- to 23-month-olds at 3.0 QALYs gained per 1,000 children vaccinated, compared with 2.4 per 1,000 children vaccinated for 2-year-olds and 1.7 per 1,000 children vaccinated for 3- to 4-year-olds. For children at high risk, the QALYs gained by IIV use ranged from 1.3 to 7.2 per 1,000 children vaccinated, depending on age group. For children 5-17 years old not at high risk, LAIV use would result in slightly higher QALYs gained because of the vaccine's higher effectiveness at 0.5 to 3.7 per 1,000 children vaccinated.

IIV use was cost saving among children at high risk ages 6 months to 2 years (Table 5). For children <5 years not at high risk as well as children at high risk in all age groups, IIV use had mean cost-effectiveness ratios of <$30,000 per QALY saved. Cost-effectiveness ratios based on dollars per influenza episode averted yielded patterns similar to the ratios of dollars per QALY saved, ranging from cost savings for children at high risk ages <2 years to $1,070 per influenza case averted for healthy 12- to 17-year-olds (Table 5).

Using base-case vaccine purchase prices for LAIV and IIV (Table 2), LAIV for children ages 5-17 years not at high risk had higher mean net costs and yielded greater mean health benefits than IIV. The cost-effectiveness ratios for LAIV were $72,000 per QALY gained for 5- to 11-year-olds and $109,000 per QALY gained for 12- to 17-year-olds (Table 5).

Sensitivity Analyses

Probabilistic sensitivity analysis provided confidence intervals for projected costs and events averted and quasi-confidence intervals for cost-effectiveness ratios. By using base case assumptions, results for LAIV are slightly more favorable than IIV (compared to no vaccination), and vaccination with LAIV is the preferred strategy. However, probabilistic sensitivity analysis indicated projected results were similar for IIV and LAIV.

Cost-effectiveness acceptability curves generated through probabilistic sensitivity analysis are very similar for IIV and LAIV (Figures 2A and 2C). The probability that the cost-effectiveness of IIV would be [less than or equal to] $30,000/QALY ranged from 51% to 89% for all children ages 6-23 months and 2 years (Figure 2). For children of any age not at high risk, the probability that IIV would be cost saving was [less than or equal to] 10% (Figure 2A). For children aged [greater than or equal to] 5 years not at high risk, the probability that the cost-effectiveness of LAIV, compared with no vaccination, would be [less than or equal to] $30,000 per QALY gained was 5%-13% (Figure 2C).

[FIGURE 2 OMITTED]

In 1-way sensitivity analyses, cost-effectiveness ratios were most sensitive to changes in influenza illness attack rate, hospitalization rates, total vaccination costs, and vaccine effectiveness (Figure 3). Cost-effectiveness ratios varied notably with total costs of vaccination for IIV. For example, if total costs of vaccination were doubled for children ages 6-23 months who were not at high risk, cost-effectiveness ratios increased (worsened) by a factor of 3. We included costs for parent time associated with taking a child to the physician's office to receive influenza vaccination, which accounted for 41%-66% of total vaccination costs (Table 1). Excluding these time costs resulted in cost-effectiveness ratios approximately half of those reported in Table 5 and Figure 2. Using an alternative calculation for quality adjustments resulted in higher estimates of the projected number of QALYs gained through vaccination. For example, projected gains in QALYs for children not at high risk were 12%-37% higher than in the base case.

[FIGURE 3 OMITTED]

Two-way sensitivity analysis on influenza illness rate and vaccine effectiveness (IIV) resulted in changes in the cost-effectiveness ratio from a decrease in 11% for a season with a high influenza illness rate (35%) and high vaccine effectiveness (IIV) to an increase of more than a factor of 30 for seasons with a low influenza illness rate and low vaccine effectiveness (IIV). Combining a high influenza illness rate (35%) with low vaccine effectiveness (IIV) resulted in cost-effectiveness ratio [approximately equal to] 3 times base case results ($43,000/QALY) for children not at high risk ages 6-23 months. Two-way sensitivity analyses on influenza illness rate and total vaccination costs (IIV) had similar results, ranging from a decrease in 6% in the cost-effectiveness ratio to an increase 25 times as high as the base case for seasons with low influenza illness rate and high vaccination costs (IIV). Two-way sensitivity analyses for vaccination costs and effectiveness yielded a 20% lower cost-effectiveness ratio for low costs and high effectiveness of vaccination (IIV) to 7 times the base case for high costs and low vaccine effectiveness (IIV).

Discussion

Major Findings

We found that influenza vaccination of children, both those at high risk and those not at high risk, in all age groups would have health benefits that outweigh vaccine adverse events as measured by QALYs for both IIV and LAIV. For children not at high risk ages 6 months-4 years, we estimated that influenza vaccination with IIV would cost [less than or equal to] $25,000 per QALY saved. In comparison, other routinely-used preventive interventions, such as pneumococcal conjugate vaccination, cost an average of $7,000/QALY for children <2 years (22,25); driver-side air bags cost $30,000/QALY (26), and costs of other vaccinations range from cost-savings to $150,000/QALY (27-30).

Live, attenuated influenza vaccine is currently approved for children [greater than or equal to] 5 years of age who are not at high risk, but not for children <5 years or for children at high risk. At a price per dose <$20, its cost-effectiveness ratios are similar to those for IIV. This analysis likely presents a relatively conservative estimate of the potential benefits of LAIV, because we did not include its potentially greater effectiveness against antigenically drifted strains or likely higher effectiveness with 1 dose of vaccine in previously unvaccinated children <9 years (4,6).

The sensitivity of the results to the influenza illness attack rate (which varies from season to season and from community to community) and to vaccine effectiveness indicates that the cost-effectiveness of influenza vaccination can vary considerably from year to year. In seasons with a low influenza attack rate, the cost-effectiveness of vaccination with IIV would be dramatically higher than in the base case (Figure 3). The 2-way sensitivity analyses demonstrate even less favorable cost-effectiveness for a scenario that assumes a low influenza illness rate and low level of vaccine effectiveness. In addition, the sensitivity of these results to the total costs of vaccination highlights the potential for delivering vaccinations in settings that have lower costs and reduce the time required for vaccination.

Comparisons with Previous Studies

Our study contributes valuable new information because it incorporates survey-based health state preferences for influenza-related illness and vaccine adverse events. These preferences, which are expressed as QALYs saved, are important for 2 reasons. First, we were able to evaluate the net health benefits of vaccination by subtracting the QALYs lost due to vaccine adverse events from the QALYs gained due to averted influenza cases. The results suggest that vaccination of all children is desirable from a health standpoint. Second, the outcome measure of dollars per QALY saved allows policymakers to compare the cost-effectiveness of influenza vaccination of children with other potential investments in preventive health services.

Authors of other economic analyses of influenza vaccination in children concluded that vaccination was more cost-effective than we found in our study (8,9,31). However, in these studies, the authors either did not separate children at high risk from those not at risk (31) or did not allow for sufficient variability in key variables (8,9). These studies assumed substantially higher influenza attack rates (8,9), higher levels of vaccine effectiveness (8,9), and lower total costs of vaccination (8-10), all of which would favor vaccination. However, we believe that it is more accurate to include variation in both incidence of influenza-related clinical illnesses and rates of influenza-related health outcomes. Neither our study nor the previous studies included potential benefits of herd immunity.

In a recent study that used cost-benefit analysis to evaluate the economics of influenza vaccination in children, Meltzer et al. arrived at conclusions similar to this analysis for many of the age/risk groups under consideration (32). Meltzer et al. found that annual vaccination of children not at high risk was unlikely to be cost-saving and that annual vaccination of children 6-23 months at high risk was likely to generate cost savings. For older children at high risk, they estimated median cost savings, but this analysis projects net costs of influenza vaccination for similar-age risk groups.

Limitations

Some studies that used mathematical models have suggested substantial community herd immunity effects from vaccinating school-aged children (33). Although one study demonstrated herd immunity with vaccination rates of >80% among school-aged children during the 1968 pandemic (34), a recent study by Pisu et al. (35) reported that vaccinating 20%-25% of children <5 years of age in a Texan community did not generate any measurable herd immunity in persons <35 years. Additionally, no field studies have assessed the impact of pediatric vaccination on hospitalization and deaths in adults. Thus, we made the conservative decision to not include herd immunity effects in our analysis. If herd immunity effects had been included in our analysis, the findings would likely have been more favorable for vaccination. Future analyses should evaluate the cost-effectiveness of expanding routine influenza immunization under different assumptions for vaccine coverage rates and the costs of achieving these rates.

A recent randomized trial suggests that influenza vaccination has little, if any, effect on otitis media in children (36), while previous trials have found that influenza vaccination reduces otitis media (6,37). Our model assumes that only a small proportion of otitis media is preventable by influenza vaccination, and our findings are consistent with estimates of otitis media reduction from influenza vaccination reported in all of these studies. Our model is conservative in that it only includes the effect of reduced incidence of otitis media (or other complications) due to reduced incidence of influenza illness and does not consider any other benefits of vaccination, such as whether vaccinated patients with influenza illness may have a lower probability of experiencing otitis media (or other complications).

The time-tradeoff questions we used to elicit preferences for health states differ from that commonly used for adult illnesses because the loss of quality of life for both parent and child are explicitly included. In addition, parents were asked to include the value of productivity losses to paid or unpaid work for caring for a child with influenza in the time-tradeoff amount; therefore, productivity losses were included in the health state quality adjustments, whereas parent time costs for vaccination were included as dollar costs. As a result, the time-tradeoff amounts presented here are not directly comparable to utility values from generic utility instruments for measuring reductions in quality-of-life for chronic health states, such as the Health Utilities Index (38) or the EQ-5D (39). The sample sizes for the time-tradeoff studies were small.

Recent data show that some influenza-related deaths in children may occur outside the medical setting (2). Only deaths that occurred after an influenza-related hospitalization have been included in this analysis. However, even a 10-fold increase in influenza-related deaths did not appreciably change the cost-effectiveness results since the total number of deaths remains small.

Few data are available to guide assumptions on what proportion of children who experience mild systemic symptoms after vaccination, such as fever or respiratory symptoms, will see a physician. In the absence of reliable data, we selected an assumption that would be more likely to bias against vaccination rather than for and assumed it would be the same as the proportion of children who would visit a physician due to influenza illness. If the number of medically attended, vaccination-related adverse events were lower, the cost-effectiveness ratios would also be slightly lower, but cost-effectiveness results are not very sensitive to this parameter. We did not include any quality adjustment for vaccination itself aside from negative effects of vaccination-related adverse events. If vaccination itself were associated with a decrease in quality of life, cost-effectiveness ratios would be less favorable than in the current analysis. Previous analyses of other vaccinations, which included a quality adjustment for fever and fussiness following vaccination, were not sensitive to this parameter (22,40).

Conclusions

Routine annual influenza vaccination using IIV for children age [greater than or equal to] 2 years not at high risk is likely to result in net health benefits, but cost-effectiveness ratios are likely to be less favorable than for children ages 6-23 months and children of any age with a high-risk condition. Cost-effectiveness among children decreases with increasing age, although risk status is more important than age in determining the economic impact of annual influenza vaccination. Further work is needed to assess the potential impact of herd immunity on the cost-effectiveness of expanding influenza vaccine recommendations.

Acknowledgments

We thank the external members of our expert panel (Kathryn Edwards, Arnold Monto, and Marie Griffin) for assisting in the development of input assumptions for the model; Kakoli Roy, Peter Szilagyi, James Singleton, and Jonathan Finkelstein for providing important data for this study; and Andra Barnette for outstanding administrative assistance.

This research was supported by the Vaccine Safety Datalink Project and the Joint Initiative for Vaccine Economics of the National Immunization Program, Centers for Disease Control and Prevention. Dr. Lieu's effort was supported in part by a Mid-Career Investigator Award in Patient-Oriented Research from the National Institute of Child Health and Human Development (K24 HD047667).

Technical Appendix is available at http://www. cdc.gov/ ncidod/eid/vol12no10/05-1015.htm

References

(1.) McKay B. Health officials say flu shots should go to most vulnerable. Wall Street Journal. 2003 Dec 8;A8.

(2.) Centers for Disease Control and Prevention. MMWR update: influenza-associated deaths reported among children aged <18 years--United States, 2003-4 influenza season. MMWR Morb Mortal Wkly Rep. 2004;52:1286-8.

(3.) Auge L. 3 more Colo. kids die from flu: cases already surpass total for all of last year. Denver Post Medical Writer 2003;A-01.

(4.) Centers for Disease Control and Prevention. Prevention and control of influenza: recommendations of the Advisory Committee on Immunization Practices. MMWR Morb Mortal Wkly Rep. 2004;53:1-40.

(5.) Committee on Infectious Diseases. Recommendations for influenza immunization of children. Pediatrics. 2004;113:1441-7.

(6.) Belshe RB, Mendelman PM, Treanor J, King J, Gruber WC, Piedra PA, et al. The efficacy of live attenuated, cold-adapted, trivalent, intranasal influenzavirus vaccine in children. N Engl J Med. 1998;338:1405-12.

(7.) Drug Topics Red Book. Montvale (NJ): American Academy of Pediatrics; 2000.

(8.) Cohen GM, Nettleman MD. Economic impact of influenza vaccination in preschool children. Pediatrics. 2000;106:973-6.

(9.) White T, Lavoie S, Nettleman MD. Potential cost savings attributable to influenza vaccination of school-aged children. Pediatrics. 1999;103:e73.

(10.) Luce BR, Zangwill KM, Palmer CS, Mendelman PM, Yan L, Wolff MC, et al. Cost-effectiveness analysis of an intranasal influenza vaccine for the prevention of influenza in healthy children. Pediatrics. 2001;108:e24.

(11.) Fox JP, Hall CE, Cooney MK, Foy HM. Influenza virus infections in Seattle families, 1975-1979: II. Pattern of infection in invaded households and relation of age and prior antibody to occurrence of infection and related illness. Am J Epidemiol. 1982;116:228-42.

(12.) Hall CE, Cooney MK, Fox JP. The Seattle virus watch: IV. Comparative epidemiologic observations of infections with influenza A and B viruses, 1965-1969, in families with young children. Am J Epidemiol. 1973;98:365-80.

(13.) Monto AS, Sullivan KM. Acute respiratory illness in the community: frequency of illness and the agents involved. Epidemiol Infect. 1993;110:145-60.

(14.) Monto AS, Koolman JS, Longini Jr IJ. Tecumseh study of illness: XIII. Influenza infection and disease, 1976-1981. Am J Epidemiol. 1985;121:811-22.

(15.) Neuzil KM, Zhu Y, Griffin MR, Edwards KM, Thompson JM, Tollefson SJ, et al. Burden of interpandemic influenza in children younger than 5 years: a 25-year prospective study. J Infect Dis. 2002;185:147-52.

(16.) Belshe RB, Gruber WC, Mendelman PM, Cho I, Reisinger K, Block SL, et al. Efficacy of vaccination with live attenuated, cold-adapted, trivalent, intranasal influenza virus vaccine against a variant (A/Sydney) not contained in the vaccine. J Pediatr. 2000;136:168-75.

(17.) Nichol KL. The efficacy, effectiveness and cost-effectiveness of inactivated influenza virus vaccines. Vaccine. 2003;21:1769-75.

(18.) American Academy of Pediatrics. Pediatric service utilization, fees and managed care arrangements: 2001 report based on 1999 data. Elk Grove Village (IL): The Academy; 2001. p. 1-11.

(19.) Bureau of Labor Statistics. National Compensation Survey. US Department of Labor, 2004 Feb 5. Available from http://www. bls.gov/ncs/home.htm

(20.) Szilagyi PG, Iwane MK, Schaffer S, Humiston SG, Barth R, McInerny T, et al. Potential burden of universal influenza vaccination of young children on visits to primary care practices. Pediatrics. 2003;112:821-8.

(21.) Prosser LA, Bridges CB, Uyeki TM, Rego VH, Ray GT, Meltzer MI, et al. Values for preventing influenza-related morbidity and vaccine adverse events in children. Health Qual Life Outcomes. 2005;3:1-18.

(22.) Prosser LA, Ray GT, O'Brien M, Kleinman K, Santoli J, Lieu TA. Preferences and willingness to pay for health states prevented by pneumococcal conjugate vaccine. Pediatrics. 2004;113:283-90.

(23.) Huang SM, Chen CC, Chiu PC, Cheng MF, Lai PH, Hsieh KS. Acute necrotizing encephalopathy of childhood associated with influenza type B virus infection in a 3-year-old girl. J Child Neurol. 2004;19:64-7.

(24.) Morishima T, Togashi T, Yokata S, Okuno Y, Miyazaki C, Tashir M, et al. Encephalitis and encephalopathy associated with an influenza epidemic in Japan. Clin Infect Dis. 2002;35:512-7.

(25.) Lieu TA, McGuire TG, Hinman AR. Overcoming economic barriers to the optimal use of vaccines. Health Aft (Millwood). 2005;24: 666-79.

(26.) Graham JD, Thompson KM, Goldie SJ, Segui-Gomez M, Weinstein MC. The cost-effectiveness of air bags by seating position. JAMA. 1997;278:1418-25.

(27.) Stone PW, Teutsch S, Chapman RH, Bell C, Goldie SJ, Neumann PJ. Cost-utility analyses of clinical preventive services: Published ratios, 1976-1997. Am J Prev Med. 2000;19:15-23.

(28.) Ekwueme DU, Strebel PM, Hadler SC, Meltzer MI, Allen JW, Livengood JR. Economic evaluation of use of diphtheria, tetanus, and acellular pertussis vaccine or diphtheria, tetanus, and whole-cell pertussis vaccine in the United States, 1997. Arch Pediatr Adolesc Med. 2000;154:797-803.

(29.) Margolis HS, Coleman PJ, Brown RE, Mast EE, Sheingold SH, Arevalo JA. Prevention of hepatitis B virus transmission by immunization: an economic analysis of current recommendations. JAMA. 1995;274:1201-8.

(30.) White CC, Koplan JP, Orenstein WA. Benefits, risks and costs of immunization for measles, mumps and rubella. Am J Public Health. 1985;75:739-44.

(31.) Office of Technology Assessment. Data and methods used in OTA's cost-effectiveness analysis of strategies for newborn screening. Healthy children: investing in the future. Washington: The Office; 1987. p. 236-41.

(32.) Meltzer MI, Neuzil KM, Griffin MR, Fukuda K. An economic analysis of annual influenza vaccination of children. Vaccine. 2005;23:1004-14.

(33.) Halloran ME, Longini IM, Cowart DM, Zinam A. Community interventions and the epidemic prevention potential. Vaccine. 2002;20:3254-62.

(34.) Monto AS. Davenport FM, Napier JA, Francis T. Modification of an outbreak of influenza in Tecumseh, Michigan by vaccination of schoolchildren. J Infect Dis. 1970;122:16-25.

(35.) Pisu M, Meltzcr JI, Hurwitz ES, Haber M. Household-based costs and benefits of vaccinating healthy children in day care against influenza virus: results from a pilot study. Pharmacoeconomics. 2005;23:55-67.

(36.) Hoberman A, Greenberg DR Paradise JL, Rockette HE, Lave JR, Kearney DH, et al. Effectiveness of inactivated influenza vaccine in preventing acute otitis media in young children: a randomized controlled trial. JAMA. 2003;290:1608-16.

(37.) Heikkinen L Ruuskanen O, Waris M, Ziegler T, Arola M, Halonen P. Influenza vaccination in the prevention of acute otitis media in children. Am J Dis Child. 1991;145:445-8.

(38.) Feeny D, Furlong W. Boyle M. Torrance GW. Multi-attribute health status classification systems. Health Utilities Index. Pharmacoeconomics. 1995;7:490-502.

(39.) Dolan P, Gudex C, Kind P, Williams A. The time trade-off method. results from a general population study. Health Econ. 1996:5:141-54.

(40.) Lee GM, Lebaron C, Murphy TV, Lett S, Schauer S, Lieu TA. Pertussis in adolescents and adults: should we vaccinate? Pediatrics. 2005;115:1675-84.

Address for correspondence: Lisa A. Prosser. Department of Ambulatory Care and Prevention, Harvard Medical School and Harvard Pilgrim Health Care, 133 Brookline Ave, 6th Floor, Boston, MA 02215, USA: email: [e-mail]

Lisa A. Prosser, * ([dagger]) Carolyn Buxton Bridges, ([double dagger]) Timothy M. Uyeki, ([double dagger]) Virginia L. Hinrichsen, * ([dagger]) Martin I. Meltzer, ([double dagger]) Noelle-Angelique M. Molinari, ([double dagger]) Benjamin Schwartz, ([double dagger]) William W. Thompson, ([double dagger]) Keiji Fukuda, ([double dagger]) and Tracy A. Lieu * ([dagger]) ([section])

* Harvard Medical School, Boston, Massachusetts, USA; ([dagger]) Harvard Pilgrim Health Care, Boston, Massachusetts, USA; ([double dagger]) Centers for Disease Control and Prevention, Atlanta, Georgia, USA; and ([section]) Children's Hospital, Boston, Massachusetts, USA

Dr Prosser is an assistant professor in the Department of Ambulatory Care and Prevention at Harvard Medical School and Harvard Pilgrim Health Care. Her research interests include conducting economic evaluations of health interventions and improving methods for valuing children's health benefits for cost-effectiveness analysis. Her current research focuses on the cost-effectiveness of childhood interventions, including newborn screening for metabolic disorders, influenza vaccination, and child maltreatment.

Table 1. Model inputs and assumptions for children areas 6 months to 17
years * ([dagger])

                                                            Range for
                                             Most likely   sensitivity
Variable                                      estimate       analysis

Influenza illness attack rate (annual)
  6-23 mo                                       0.157       0.02-0.35
  2 y                                           0.155       0.02-0.35
  3-4 y                                         0.155       0.01-0.35
  5-11 y                                        0.08        0.01-0.18
  12-17 y                                       0.06        0.01-0.14
Probability of outpatient visit for child
with influenza illness ([double dagger])
  6-23 mo                                        0.5        0.17-0.83
  2 y                                           0.47        0.15-0.81
  3-4 y                                         0.43        0.12-0.78
  5-11 y                                        0.28         0.11-0.5
  12-17 y                                       0.24         0.06-0.5
Probability of otitis media for child with
medically attended influenza illness
  6-23 months                                   0.63         0.33-0.8
  2 y                                           0.58         0.27-0.8
  3-4 y                                         0.39         0.17-0.6
  5-11 y                                        0.23         0.05-0.5
  12-17 y                                       0.15         0.01-0.4
Probability of nonhospitalized pneumonia
or other outpatient complication for child
with medically attended influenza illness
([section])
  6-23 mo                                        0.2         0.04-0.5
  2 y                                           0.15         0.02-0.4
  3-4 y                                         0.15         0.02-0.4
  5-11 y                                        0.11         0.02-0.3
  12-17 y                                       0.08         0.01-0.2
Hospitalizations for pneumonia or other
respiratory conditions due to influenza/
10,000 children not at high risk
([paragraph])
  6-23 mo                                       28.3         1.9-80.0
  2 y                                           17.1          0-56.8
  3-4 y                                          8.0          0-35.4
  5-11 y                                         3.1          0-16.0
  12-17 y                                        3.1          0-14.9
Probability of long-term sequelae
  following influenza-related
  hospitalization ([double dagger])             0.01        0.001-0.03
Probability of death during influenza-
  related hospitalization                      0.0009        0-0.002
Vaccine effectiveness in preventing
  influenza illness#
  IIV                                           0.69         0.4-0.9
  LAIV                                          0.838        0.6-0.96
Probability of medically attended
  vaccination-related adverse events
  Injection site reaction
    6-23 mo                                     0.008      0.002-0.017
    2 y                                         0.003      0.001-0.006
    3-4 y                                       0.002      0.0004-0.003
    5-11 y                                      0.001      0.0002-0.002
    12-17 y                                    0.0003      0.0001-0.001
  Systemic reaction (fever) **
    6-23 mo                                     0.013      0.001-0.025
    2 y                                         0.011      0.0008-0.020
    3-4 y                                       0.009      0.0007-0.016
    5-11 y                                      0.004      0.0003-0.008
    12-17 y                                     0.003      0.0002-0.005
  Anaphylaxis                                0.00000025     0-0.000001
  Guillain-Barre syndrome                     0.000001      0-0.00001

* IIV, inactivated influenza vaccine; LAIV, live, attenuated influenza
vaccine.

([dagger]) Refer to online appendix (available at
http://www.cdc.gov/ncidod/EID/vol12no10/05-1015.htm) for list of
references used to derive model inputs.

([double dagger]) Estimates for children not at high risk are shown.
Probabilities are estimated to be twice as high for children at high
risk for influenza-related complications.

([section]) Estimates for healthy children shown. Probabilities are
estimated to be [less than or equal to] 5 times as high for children at
high risk for influenza-related complications. Most likely estimates
for children at high risk are 1.6 times as high as for healthy
children.

([paragraph]) Children at high-risk are estimated to be hospitalized at
3-6 times the rate of children not at high risk.

(#) Assumes vaccine is poorly matched with circulating virus 1 in 10
years (i.e., vaccine effectiveness is assumed to be 0 years with a poor
match).

** Definitions and follow-up for incidence of fever following
vaccination vary by study. Rates are 2x higher for children at high
risk.

Table 2. US $ cost inputs for children ages 6 months to 17 years *

Cost input                                      Most likely estimate

Influenza-related costs
  OTC medications ([dagger])                             $3
  Physician visit, uncomplicated influenza
    ([double dagger])                                    $27

  Physician visit, otitis media ([section])              $78
  Physician visit, non-hospitalized
    pneumonia ([section])                               $179
  Hospitalization ([paragraph])                        $4,300
  Long-term sequelae following influenza-
    related hospitalization (#)                       $625,000
Vaccination costs
  Per dose, IIV ** (children <3 y)            $9.56 ([dagger][dagger])
  Per dose, IIV ** (children
    [greater than or equal to] 3 y)           $6.86 ([dagger][dagger])
  Per dose, LAIV **                           $12.89 ([dagger][dagger])
  Administration costs (0-2 visits)
    ([double dagger][double dagger])                     $25
  Parent time costs, per visit
    ([subsection])                                       $32
  Total vaccination costs
    ([paragraph][paragraph])
    6-23 mo                                              $79
    2 y                                                  $66
    3-4 y                                                $59
    5-11 y                                               $49
    12-17 y                                              $49
Vaccination-related adverse events
  Physician visit for injection site
    reaction (##)                                        $61
  Anaphylaxis ***                                      $2,700
  Guillain-Barr6 syndrome
    ([dagger][dagger][dagger])                         $23,360

                                                        Range
Cost input                                    for sensitivity analysis

Influenza-related costs
  OTC medications ([dagger])
  Physician visit, uncomplicated influenza
    ([double dagger])                                  $10-$78

  Physician visit, otitis media ([section])           $23-$197
  Physician visit, non-hospitalized
    pneumonia ([section])                             $62-$715
  Hospitalization ([paragraph])                    $1,300-$34,500
  Long-term sequelae following influenza-
    related hospitalization (#)                     $0-$1,000,000
Vaccination costs
  Per dose, IIV ** (children <3 y)                1 x-4x base case
  Per dose, IIV ** (children
    [greater than or equal to] 3 y)
  Per dose, LAIV **                                    $10-$25
  Administration costs (0-2 visits)
    ([double dagger][double dagger])                   $10-$40
  Parent time costs, per visit
    ([subsection])                                     $0-$64
  Total vaccination costs
    ([paragraph][paragraph])                          $30-$110
    6-23 mo
    2 y
    3-4 y
    5-11 y
    12-17 y
Vaccination-related adverse events
  Physician visit for injection site
    reaction (##)                                     $30-$683
  Anaphylaxis ***                                    $52-$13,754
  Guillain-Barr6 syndrome
    ([dagger][dagger][dagger])                     $6,700-$78,900

* OTC, over the counter; IIV, inactivated influenza vaccine, LAIV,
live, attenuated influenza vaccine.

([dagger]) Vary by age, calculated by costing out recommended dose of
acetaminophen for average weight in each age group.

([double dagger]) Only a proportion of children with influenza illness
are assumed to make a physician visit. ICD-9 codes: 487 and 487.0.

([section]) Costs of physician visits for otitis media and
nonhospitalized pneumonia vary by age group and include prescription
medications and laboratory tests. Costs shown are for children 6-23 mo.
See online appendix (available from
http://www.cdc.gov/ncidod/EID/vol12no10/05-1015-app.htm) for full list
of costs by age.

([paragraph]) ICD-9 codes: 460-466, 471-474, 477, 478, 480-483,
490-496, 506-508, 510, 511, 514, 518, 519.

(#) Includes costs of lifetime care and special education.

** 2 doses assumed for children <5 y receiving their first influenza
vaccination.

([dagger][dagger]) Vaccine dose costs are based on 2004 CDC-negotiated
prices. Cost for children <3 y assumes thimerosal-free vaccine is used.

([double dagger][double dagger]) Current Procedural Terminology (CPT)
codes: 99211 for an additional visit ($19.95) and 90471 for a
vaccination at an existing visit ($10.37).

([subsection]) Each physician visit is assumed to take 2 hours of
parent time valued at an average hourly wage rate of $15.54.

([paragraph][paragraph]) Proportion of children requiring 2 doses is 1
for 6-23 mo, 0.5 for 2 y, and 0.33 for 3-4 y. No. of additional visits
needed to administer recommended number of vaccine doses is 1.07 for
6-23 mo, 0.91 for 2 y, and 0.84 for 3-4 y, and 0.75 for 5-17 y. See
online appendix for more details. Total vaccination costs in Table 1
exclude average costs for vaccination-related adverse events of
$0.18-$2.05 per child, depending on age and risk status.

(##) 5-minute visit, CPT code 99211.

*** ICD-9 codes: 999.4, 995.0, 995.6x.

([dagger][dagger][dagger]) ICD-9 code: 357.0.

Table 3. Quality adjustments for influenza-related illness and
vaccination-related adverse events (decrease in utility) * ([dagger])

                                                             Range for
                                             Most likely    sensitivity
Event                                         estimate       analysis

Episode of influenza                            0.005       0.002-0.009
Otitis media                                    0.042       0.023-0.065
Nonhospitalized complications (pneumonia)       0.046       0.027-0.071
Hospitalization, pneumonia                      0.076       0.054-0.100
Anaphylaxis                                     0.020       0.006-0.041
Guillain-Barre syndrome                         0.141       0.092-0.199

* Quality adjustments are included in modelas a one-time decrement in
utility for each temporary health slale. For example, an episode of
influenza results in a 1-time Ioss of 0.005 quality-adjusted life years
(QALYs). Utility losses were calculated by dividing discounted
time-traded off by respondent's discounted life expeclancy. See online
appendix for references.

([dagger]) Average life span used to calculate total QALYs lost due to
lifelong sequelae and death was 77.9-78.2 years, depending on child's
current age.

Table 4. Health benefits, risks, and costs of influenza vaccination of
varying age and risk groups per 1,000 children vaccinated, means *
(95% Cl ([dagger]))

                            Net costs, $ ([double    Influenza events
                                  dagger])            averted (all)

Using inactivated influenza vaccine
  Non-high risk
    6-23 mo                  37,000 (-119,000 to       108 (16-276)
                                   98,000
    2 y                      43,000 (-40,000 to        107 (15-276)
                                   83,000
    3-4 y                      47,000 (2,000-          107 (15-276)
                                   78,000
    5-11 y                     44,000 (21,000-          55 (8-142)
                                   68,000
    12-17 y                    44,000 (22,000-          41 (6-104)
                                   68,000
  High risk
    6-23 mo                   -74,000 (-552,000        108 (16-276)
                                 to 83,000)
    2 y                       -22,000 (-292,000        107 (15-276)
                                 to 72,000)
    3-4 y                    2,000 (-212,000 to        107 (15-276)
                                   70,000
    5-11 y                   12,000 (-125,000 to        55 (8-142)
                                   59,000
    12-17 y                  13,000 (-120,000 to        41 (6-104)
                                   59,000
Using LAIV ([paragraph])
  Non-high risk
    6-23 mo                  32,000 (-155,000 to      132 (20-319)#
                                  99,000)#
    2 y                      42,000 (-59,000 to       130 (20-322)#
                                  85,000)#
    3-4 y                     50,000 (-3,000 to        130(20-322)#
                                  83,000)#
    5-11 y                     48,000 (22,000-         67(10-166)#
                                  73,000)#
    12-17 y                    49,000 (23,000-          50(8-120)#
                                  73,000)#

                               Influenza
                            hospitalizations
                                averted          Deaths averted

Using inactivated influenza vaccine
  Non-high risk
    6-23 mo                    2 (0.2-6)        0.002 (0-0.007)
    2 y                      1.2 (0.1-4.2)      0.001 (0-0.005)
    3-4 y                     0.6 (0-2.3)          0.0005(0-
                                                     0.0025
    5-11 y                    0.2 (0-0.7)          0.0002(0-
                                                     0.0008
    12-17 y                   0.2 (0-0.6)          0.0002(0-
                                                     0.0008
  High risk
    6-23 mo                  5.5 (0.5-6.5)      0.005 (0-0.020)
    2 y                      3.5 (0.2-11.4)     0.003 (0-0.013)
    3-4 y                    2.2 (0.1-9.1)      0.002 (0-0.010)
    5-11 y                   1.3 (0.1-3.9)      0.001 (0-0.005)
    12-17 y                  1.3 (0.1-3.9)      0.001 (0-0.005)
Using LAIV ([paragraph])
  Non-high risk
    6-23 mo                  2.4 (0.3-7.2)#     0.002 (0-0.009)#
    2 y                      1.4 (0.1-4.9)#     0,001 (0-0.005)#
    3-4 y                     0.7 (0-2.7)#           0.0006
    5-11 y                    0.3 (0-0.8)#           0.0002
    12-17 y                   0.3 (0-0.7)#           0.0002
                                                  (0-0.0010)#

                            Vaccine adverse
                            events incurred
                            ([section])          QALYs gained

Using inactivated influenza vaccine
  Non-high risk
    6-23 mo                    21 (8-47)         3.0 (0.4-9.0)
    2 y                         14(5-30)         2.4 (0.3-7.3)
    3-4 y                       10(3-24)         1.7 (0.2-5.2)
    5-11 y                      5(2-11)          0.6 (0.1-1.7)
    12-17 y                      3(1-8)           0.4(0-1.1)
  High risk
    6-23 mo                    32(11-56)        7.2 (0.8-23.2)
    2 y                         25(7-44)        5.4 (0.6-17.2)
    3-4 y                       19(5-37)        4.0 (0.4-13.1)
    5-11 y                      9(3-24)          1.6 (0.2-5.6)
    12-17 y                     6(1-15)          1.3 (0.1-4.5)
Using LAIV ([paragraph])
  Non-high risk
    6-23 mo                    13 (3-32)#       3.7 (0.5-10.5)#
    2 y                        11 (2-26)#       2.9 (0.4-8.5)#
    3-4 y                      9 (2-23)#        2.1 (0.3-6.1)#
    5-11 y                     4 (1-10)#        0.7 (0.1-1.9)#
    12-17 y                     3 (0-7)#        0.5 (0.1-1.3)#

Note: # indicate that LAIV is not licensed for children <5 y.

* CI, confidence interval; QALYs, quality-adjusted life years, LAIV,
live, attenuated influenza vaccine.

([dagger]) Bootstrapped.

([dounle dagger]) Net costs = costs of vaccination minus savings from
disease averted.

([section]) Includes medically attended injection site reactions,
systemic reactions, anaphylaxis, and Guillain-Barre syndrome.

([paragraph]) Italics indicate that LAIV is not licensed for children
<5 y.

Table 5. Incremental cost-effectiveness ratios for use of inactivated
and live attenuated influenza vaccination in varying age and risk
groups compared to no vaccination, mean (2.5% and 97.5% bootstrapped
percentiles) *

                     Using inactivated influenza vaccine

              Children not at high risk     Children at high risk

$ per influenza episode averted ([double dagger])
  6-23 mo          340 (CS-4,690)               CS (CS-4,090)
  2 y              400 (CS-3,990)               CS (CS-3,620)
  3-4 y            440 (10-3,590)               20 (CS-3,410)
  5-11 y           800 (180-5,850)             210 (CS-5,560)
  12-17 y         1,070 (250-7,780)            310 (CS-7,360)

$ per hospitalization averted ([double dagger])
  6-23 mo        19,000 (CS-350,000)           CS (CS-132,000)
  2 y            37,000 (CS-633,000)           CS (CS-232,000)
  3-4 y       84,000 (1,000-2,587,000)       1,000 (CS-750,000)
  5-11 y     202,000 (38,000-1,929,000)      9,000 (CS-310,000)
  12-17 y    206,000 (43,000-1,768,000)      10,000 (CS-304,000)

$ per death averted ([double dagger])
  6-23 mo         22 m (CS-1,109 m)             CS (CS-342 m)
  2 y             42 m (CS-1,762 m)             CS (CS-591 m)
  3-4 y          98 m (1 m-6,840 m)           1 m (CS-1,873 m)
  5-11 y        234 m (32 m-5,993 m)           10 m (CS-876 m)
  12-17 y       238 m (37 m-5,607 m)           12 m (CS-892 m)

$ per quality-adjusted life-year saved
  6-23 mo        12,000 (CS-208,000)           CS (CS-85,000)
  2 y            18,000 (CS-217,000)           CS (CS-100,000)
  3-4 y        28,000 (1,000-290,000)        1,000 (CS-130,000)
  5-11 y       79,000 (15,000-682,000)       7,000 (CS-260,000)
  12-17 y    119,000 (24,000-1,040, 000)     10,000 (CS-367,000)

             Using live, attenuated influenza vaccine ([dagger])

                          Children not at high risk

$ per influenza episode averted ([double dagger])
  6-23 mo                      240 (CS-3,890)#
  2 y                          330 (CS-3,340)#
  3-4 y                        440 (CS-3,170)#
  5-11 y                      720 (170-5,290)#
  12-17 y                     980 (240-7,070)#

$ per hospitalization averted ([double dagger])
  6-23 mo                   14,000 (CS-287,000)#
  2 y                       30,000 (CS-522,000)#
  3-4 y                    74,000 (CS-2,227,000)#
  5-11 y                 184,000 (35,000-1,629,000)#
  12-17 y                188,000 (40,000-1,575,000)#

$ per death averted ([double dagger])
  6-23 mo                     16 m (CS-880 m)#
  2 y                        34 m (CS-1,435 m)#
  3-4 y                      86 m (CS-5,991 m)#
  5-11 y                   212 m (32 m, 5,331 m)#
  12-17 y                  217 m (34 m; 5,007 m)#

$ per quality-adjusted life-year saved
  6-23 mo                    9,000 (CS-167,000)#
  2 y                       15,000 (CS-180,000)#
  3-4 y                     25,000 (CS-236,000)#
  5-11 y                  72,000 (14,000; 592,000)#
  12-17 y                109,000 (22,000; 888,000)#

Note: # indicate that live, attenuated influenza vaccine is not
licensed for children <5 y.

* CS, cost savings, m, million.

([daggrer]) Numerator does not include productivity losses.

([double dagger]) Italics indicate that live, attenuated influenza
vaccine is not licensed for children <5 y.