Rotenone, paraquat, and Parkinson's disease.
OBJECTIVES: Our goal was to determine whether pesticides that cause mitochondrial dysfunction or oxidative stress are associated with PD or clinical features of parkinsonism in humans.
METHODS: We assessed lifetime use of pesticides selected by mechanism in a case-control study nested in the Agricultural Health Study (AHS). PD was diagnosed by movement disorders specialists. Controls were a stratified random sample of all AHS participants frequency-matched to cases by age, sex, and state at approximately three controls:one case.
RESULTS: In 110 PD cases and 358 controls, PD was associated with use of a group of pesticides that inhibit mitochondrial complex I [odds ratio (OR) = 1.7; 95% confidence interval (CI), 1.0-2.8] including rotenone (OR = 2.5; 95% CI, 1.3-4.7) and with use of a group of pesticides that cause oxidative stress (OR = 2.0; 95% CI, 1.2-3.6), including paraquat (OR = 2.5; 95% CI, 1.4-4.7).
CONCLUSIONS: PD was positively associated with two groups of pesticides defined by mechanisms implicated experimentally--those that impair mitochondrial function and those that increase oxidative stress--supporting a role for these mechanisms in PD pathophysiology.
KEY WORDS: aging, agricultural epidemiology, environmental epidemiology, epidemiology, fungicides, herbicides, insecticides, persistent organic pollutants, pesticides. Environ Health Perspect 119:866-872(2011). doi:10.1289/ehp.1002839 [Online 26 January 2011]
Mitochondrial dysfunction and oxidative stress have long been implicated as pathophysiologic mechanisms underlying Parkinson's disease (PD) (Betarbet et al. 2000; Di Monte et al. 2002). Genetic forms of PD associated with mutations in the alpha-synuclein, PARKIN, PINK1, or DJ-1 genes may involve these mechanisms (Henchcliffe and Beal 2008). In experimental models, the pesticides paraquat, which causes oxidative stress, and rotenone, which inhibits mitochondrial complex I, both induce loss of nigral dopaminergic neurons and behavioral changes associated with human PD (Henchcliffe and Beal 2008). Yet despite decades of laboratory study, neither pesticide has been definitively associated with PD in humans. Previous studies have reported associations with paraquat, but results are inconsistent and, in general, studies included few exposed cases; evidence concerning rotenone is sparse (Table 1). To assess the relevance of experimental results to human PD, we investigated the association of PD with use of pesticides linked to complex I inhibition or oxidative stress in a population with well-characterized pesticide exposure.
Table 1. Relationship of PD to paraquat or rotenone exposure in human populations. Study Design Method of No. enrolled assessing (cases, pesticide use controls) Paraquat Sanchez-Ramos et al. Case report Medical history 1 case 1987 Hertzman et al. Case-control Specific question 57 cases 1990 re: paraquat use 122 controls Semchuk et al. 1992 Case-control General questions 130 cases re: pesticide 260 cases use Hertzman et al. Case-control Specific question 127 cases 1994 re: paraquat use 245 controls Liou et al. 1997 Case-control Open-ended 120 cases question re: 240 controls pesticide use Firestone et al. Case-control Checklist (b) 250 cases 2005 388 controls Kamel et al. 2007 Case-control Specific question 83 prevalent re: paraquat use cases 79,557 controls 78 incident cases 55,931 controls Tanner et al. 2009 Case-control Specific question 519 cases re: occupational 511 controls paraquat use Firestone et al. Case-control Checklist (c) 404 incident 2010 cases 526 controls Rotenone Kamel et al. 2007 Case-control Specific question 83 prevalent re: rotenone use cases in a 79,557 controls supplementary 78 incident questionnaire cases 55,931 controls Tanner et al. 2009 Case-control Specific question 519 cases re: occupational 511 controls rotenone use Dhillon et al. 2008 Case-control General question 100 cases re: "organic 84 controls pesticides" Study Finding OR (95% CI) or Exposed n p-value Paraquat Sanchez-Ramos et Symptoms NA 1 case al. 1987 "comparable to PD" in a 32-year-old farmer after 15 years of paraquat use Hertzman et al. Association p = 0.0 * (a) 4 cases 1990 with PD 0 controls Semchuk et al. One case with NA 1 case 1992 early-onset PD (< age 40 years) reported using paraquat (ages 26-31 years) Hertzman et al. 1.11 (0.32-3.87) 6 cases 1994 No association 1.25 (0.34-4.63) 5 controls with PD 6 cases 4 controls Liou et al. 1997 No association 3.22 (2.41-4.31) 31 cases with PD 22 controls Firestone et al. Association 1.67 (0.22-12.76) 2 cases 2005 with PD 2 controls Kamel et al. 2007 Association 1.8 (1.0-3.4) 14 prevalent with PD in 11,266 prevalent controls cases No association 1.0 (0.5-1.9) 11 incident with PD in 7,382 controls incident cases Tanner et al. 2009 Association 2.80 (0.81-9.72) 9 cases with PD 4 controls Firestone et al. Added subjects 0.9 (0.14-5.43) 2 cases 2010 to 2005 interim population No association 3 controls with PD in reanalysis Rotenone Kamel et al. 2007 Association of 1.7 (0.6-4.7) 4 prevalent PD with ever 671 controls use Could not 1 incident determine 565 controls Tanner et al. 2009 No association 0.82 (0.05-13.34) 1 case with PD 1 control Dhillon et al. Greater use of 10.0 (2.9-34.3) 27 cases 2008 "organic 3 controls pesticides such as rotenone" in PD patients NA, not analyzed. (a) Four PD patients and no controls reported paraquat contact; OR could not be calculated; (b) Occupational pesticide exposures were identified from a checklist of common chemical agents and home-based pesticide exposures from a checklist of commercial brand name products. (c) Subjects reported exposures to various industrial toxicants identified from a checklist.
The Farming and Movement Evaluation study (FAME) is a case--control study nested in the Agricultural Health Study (AHS), a prospective study including 84,740 private pesticide applicators (mostly farmers), recruited in 1993-1997 in Iowa and North Carolina, and their spouses (Alavanja et al. 1996). Pesticide use is reported reliably by these applicators (Blair et al. 2002; Hoppin et al. 2002). We previously reported that self-reported PD was associated with increasing lifetime days of. use of any pesticide, but no specific pesticide could be definitely implicated (Kamel et al. 2007). In this study, we assessed lifelong use of pesticides with toxicant mechanisms relevant to PD. Because 15-25% of self-reported PD diagnoses in community populations may be incorrect (Tolosa et al. 2006), we based diagnoses on in-person examination and consensus of two experts, minimizing diagnostic misclassification and enabling analyses of clinical features. We report here results from our investigation of pesticides previously associated with mitochondrial complex I inhibition (termed "complex I inhibitors") or oxidative stress (termed "oxidative stressors").
Case and control identification. From among AHS cohort members who were private pesticide applicators (mostly farmers) and their spouses, we identified persons suspected to have PD based on diagnoses from self-reports or state mortality files. We selected potential controls by stratified random sampling of all AHS participants. Cohort members who were ultimately diagnosed with PD or parkinsonism, dead, cognitively impaired, or seriously ill were not eligible to be controls. Controls were frequency-matched to cases by age (< 40, 40-49, 50-59, 60-64, 65-69, [greater than or equal to] 70 years), sex, and state (Iowa or North Carolina) at a ratio of approximately three controls per case.
Living suspect cases and all potential controls were assessed during home visits. Movement disorder specialist neurologists (subsequently called "neurologists") assessed all cases and 5% of controls. Neurologist-trained technicians assessed the remaining controls. The in-person assessment included factors used to diagnose PD and to distinguish PD from other disorders, including a standardized medical and neurological history, the Cognitive Abilities Screening Instrument (Teng et al. 1994), a scripted, standardized videotaped assessment of parkinsonism, a handwriting sample, medications, and the University of Pennsylvania brief smell identification test (Sensonics, Inc., Haddon Heights, NJ, USA) (Doty et al. 1996). Assessments by neurologists also included a standardized neurological examination, orthostatic hypotension assessment, the Unified Parkinson's Disease Rating Scale (Fahn et al. 1987), and the Tremor Rating Scale (Fahn et al. 1993). Technician-assessed controls with signs suggesting parkinsonism were subsequently assessed by a neurologist.
Diagnosis was determined by agreement of two neurologists (C.M.T. and either G.W.R., C.M., A.C., or M.K.) after independent review of all available diagnostic information (medical records, in-person examination records, and videotaped examination) for all suspect cases and when PD was suspected in a control. Established criteria for PD and related disorders were used (Bain et al. 2000; Elble 2000; Gelb et al. 1999; Gilman et al. 1999; Hughes et al. 1992; Langston et al. 1992; Litvan et al. 1996; McKeith et al. 1996).
FAME was approved by institutional review boards for the Parkinson's Institute, National Institutes of Health, Social and Scientific Systems, Inc. (Durham, NC, USA), the University of Iowa (Iowa field station), and Battelle, Inc. (North Carolina field station). All participants provided written informed consent.
Exposure assessment. We used computer-assisted telephone interviews to obtain detailed information on pesticide use from 14 years of age onward for 31 selected pesticides [Supplemental Material, Table 1 (doi:10.1289/ehp. 1002839)] as well as covariate information including lifelong smoking and family history of PD. For subjects who were unable to complete interviews, we used proxy informants. Although all controls were living and competent when enrolled, some later became unable to participate and a proxy informant was used. We considered only pesticide use occurring before a reference date (cases: age at PD diagnosis; controls: median age of PD diagnosis for cases within the corresponding age-, sex-, and state-specific stratum). For each pesticide, we determined ever use (used one or more times) and lifetime days of use (determined for each farm job by multiplying years of use by average days of use per year, and then summing across jobs). Self-reported pesticide use falling outside U.S. Environmental Protection Agency (EPA) approval dates was not included. For cigarette smoking, we classified individuals who smoked > 100 cigarettes before their reference date as exposed (Grant et al. 2004). Family history of PD was positive if the subject reported PD in any first-degree relative. We dichotomized educational level as [less than or equal to] 12 years and > 12 years.
Statistical analyses. We compared participant characteristics using Fisher's exact test or Pearson's chi-square statistic for categorical data and the Wilcoxon rank-sum test for continuous data. For pesticides reported by [greater than or equal to] 10 subjects, we evaluated associations between pesticide use and PD using unconditional logistic regression to derive odds ratios (ORs) and 95% confidence intervals (CIs) [Supplemental Material, Table 2 (doi:10.1289/ehp.1002839)]. To control potential confounding, we included reference age (tertiles 40-57, 58-65, 66-87 years), sex, state, and cigarette smoking (ever/never) in all models. We also examined whether adjusting for overall pesticide use or educational level changed point estimates ([+ or -] 15%) for individual pesticides. To adjust lor overall pesticide use, we categorized individuals who used pesticides on < 25 lifetime days as unexposed and others as exposed, using data reported at enrollment in the AHS (data from AHS data release version P1REL0506 and AHSREL0612; unpublished data).
Table 2. Characteristics of subjects. Characteristic Cases Controls n 110 358 Age at FAME enrollment [years 70 [+ or -] 8 69 [+ or -] 8 (mean [+ or -] SD)] Men [n (%)] 80 (73) 265 (74) Residence in Iowa (vs. North 79 (72) 262 (73) Carolina) [n (%)] Non-Hispanic white (vs. 107 (97) 350 (98) other) [n (%)] Pesticide applicator (vs. 80 (73) 267 (75) spouse) [n(%)] Education > high school [n 49 (45) 178 (50) (%)] PD in first-degree relative 18 (16) 22 (6) * [n (%)] Smoked at least 100 31 (28) 141 (39) ** cigarettes [n (%)] BSIT (mean score [+ or -] 5.5 [+ or -] 2.8 8.8 [+ or -] 2.3 # SD) CASI (mean score [+ or -] 89.2 [+ or -] 8.5 93.1 [+ or -] 5.0 # SD) Clinical features among cases (a) Age at PD diagnosis [years 61 [+ or -] 9 -- (mean [+ or -] SD)] PD duration at FAME 7 [+ or -] 6 -- enrollment [years (median [+ or -] SD)] Resting tremor [n affected/n 100/108 (93) -- with data (%)] Bradykinesia [n affected/n 105/110 (95) -- with data (%)] Rigidity [naffected/n with 106/107 (99) -- data (%)] Postural reflex impairment 61/92 (66) -- [n affected/n with data (%)] Asymmetric onset [n 102/104 (98) -- affected/n with data (%)] Response to dopaminergic 95/98 (97) -- therapy (if prescribed) [n affected/n with data (%)] Abbreviations: BSIT, Brief Smell Identification Test; CASI, Cognitive Abilities Screening Instrument. (a) Percentages for clinical features are based on numbers of cases with features divided by the total number of cases with available data; cases with missing data for a feature are excluded. * p < 0.005 (Fisher's exact test). ** p < 0.05 (Fisher's exact test). # p < 0.001 (Wilcoxon rank-sum test).
We performed analyses for pesticide exposure groups classified by mechanism as complex I inhibitors or oxidative stressors, based on literature review (Degli Esposti 1998; Krieger 2001; Uversky et al. 2001) and information in public databases [Agency for Toxic Substances and Disease Registry (ATSDR) 2002; Extension Toxicology Network (EXTOXNET) 2002; National Center for Biotechnology Information 2002]. Because men were the primary users of pesticides, we repeated analyses of ever use and duration of use restricted to men. For each pesticide reported by > 30 men [Supplemental Material, Table 3 (doi:10.1289/ehp.1002839)], we assessed the effect of exposure duration by separately comparing less use (at or below the median number of cumulative days of use) or more use (use above the median) with never use of that pesticide.
Table 3. Association of PD with ever use of pesticides before diagnosis or reference date by mechanism. Pesticide Cases (n = 110) Controls (n = 358) [n (%)] [n (%)] Oxidative stressors Paraquat 23 (24) 49 (14) Permethrin 16 (16) 41 (12) Carbon disulfide 2 (2) 3 (1) Chloranil 1 (1) 3 (1) Cyhalothrin 1 (1) 1 (0) Dichlone 3 (3) 8 (2) Mercury compounds 2 (2) 5 (1) Pybuthrin 0 (0) 6 (2) Any oxidative stressor 35 (40) 93 (28) Mitochondrial complex I inhibitors Benomyl 7 (7) 15 (4) Carbendazim 1 (1) 2 (1) Cyhalothrin 1 (1) 1 (0) Permethrin 16 (16) 41 (12) Pyridaben 0 (0) 1 (0) Rotenone 19 (19) 32 (9) Thiabendazole 3 (3) 12 (3) Any complex I inhibitor 36 (38) 92 (27) Pesticide OR (95% CI) p-Value Oxidative stressors Paraquat 2.5 (1.4-4.7) 0.004 Permethrin 1.5 (0.77-2.9) 0.244 Carbon disulfide 2.6 (0.41-16) 0.313 Chloranil 1.6 (0.16-16) 0.706 Cyhalothrin 3.8 (0.22-64) 0.359 Dichlone 1.6 (0.40-6.2) 0.517 Mercury compounds 1.4 (0.26-7.5) 0.692 Pybuthrin NA Any oxidative stressor 2.0 (1.2-3.6) 0.012 Mitochondrial complex I inhibitors Benomyl 1.9 (0.70-5.0) 0.207 Carbendazim 2.2 (0.19-25) 0.529 Cyhalothrin 3.8 (0.22-64) 0.359 Permethrin 1.5 (0.77-2.9) 0.244 Pyridaben NA Rotenone 2.5 (1.3-4.7) 0.005 Thiabendazole 0.8 (0.23-3.1) 0.778 Any complex I inhibitor 1.7 (1.0-2.8) 0.041 NA, not available. Analyses used logistic regression adjusted for reference age tertile, sex, state, and cigarette smoking.
We repeated primary analyses in subgroups defined by race/ethnicity (non-Hispanic whites, others), state, family history of PD, cigarette use, and respondent status (self-reported vs. proxy-reported pesticide data) and, in cases, PD duration. We performed analyses for rotenone and paraquat use truncated 5, 10, and 15 years before the index date to evaluate whether the association of PD with pesticide use was influenced by behavioral changes caused by undiagnosed disease. We also assessed the combination of paraquat plus any dithiocarbamate (ferbam, mancozeb, maneb, metam sodium, vegedex, zineb, ziram), because previous studies reported an association of PD with the combination of paraquat and the dithiocarbamate maneb (Costello et al. 2009; Thiruchelvam et al. 2000). We also repeated the primary analysis after including cases of atypical parkinsonism in our case group. For cases, we compared clinical features in persons who did or did not use paraquat or oxidative stressors as a group, or rotenone or complex I inhibitors as a group.
We used SAS version 9.1.3 (SAS Institute Inc., Cary, NC, USA) and SPSS version 12.0 (SPSS Inc., Chicago, IL, USA) for statistical analyses. We used [alpha] [less than or equal to] 0.05 as a criterion for statistical significance.
We identified 170 suspect cases and 644 potential controls and screened 156 (92%) and 542 (84%) of these, respectively (Figure 1). We conducted study evaluations in 137 (88%) of eligible suspect cases (including 4 initially indentified as potential controls who self-reported PD at screening) and 383 (71%) of eligible potential controls. Final diagnoses in suspect cases were PD (115), essential tremor/ other tremor disorder (12), no neurologic diagnosis (5), dystonia (2), multiple system atrophy (2), and atypical parkinsonism not fulfilling any diagnostic criterion (1), the latter three cases subsequently termed "atypical parkinsonism."
The analyses reported here include 110 PD cases and 358 controls who provided complete information on pesticide use and application practices. Cases and controls were similar for most characteristics assessed (Table 2), although cases were more likely to have impaired smell recognition or to have a family history of PD, and were less likely to smoke.
To validate our approach to pesticide exposure assessment, we compared information on use of four pesticides collected at enrollment in the AHS with information collected for FAME. Despite an average lapse of 9 years, agreement was good [DDT (dichlo-rodiphenyltrichloroethane) 79%, 2,4-D (2,4-dichlorophenoxyacetic acid) 84%, paraquat 85%, rotenone 93%].
Ninety-eight percent of men and 44% of women had ever used pesticides. Information on 18 pesticides used by > 10 subjects is presented in Supplemental Material, Table 2 (doi: 10.1289/ehp.1002839). Results from analyses in men were similar to those in men and women combined (Supplemental Material, Table 2). Information on pesticides linked to complex I inhibition or oxidative stress, regardless of the number of users, is presented in Table 3. Most of the pesticides in the oxidative stressor and mitochondrial inhibitor groups were used infrequently, limiting individual analyses; but in general, use of these chemicals was more common in cases. Use of paraquat (OR = 2.5; 95% CI, 1.4-4.7) or any of the group of oxidative stressors (OR = 2.0; 95% CI, 1.2-3.6) was associated with PD (Table 3). Similarly, use of rotenone (OR = 2.5; 95% CI, 1.3-4.7) or any of the group of complex I inhibitors (OR = 1.7; 95% CI, 1.0-2.8) was associated with PD (Table 3).
Associations between ever use of paraquat or rotenone and PD were similar when exposures were truncated at 5, 10, or 15 years before the diagnosis or reference date [paraquat: 5 years prior OR = 2.7 (95% CI, 1.4-4.9), 10 years OR = 2.9 (95% CI, 1.6-5.5), 15 years OR = 3.1 (95% CI, 1.6-5.8); rotenone: 5 years prior OR = 2.3 (95% CI, 1.2-4.4), 10 years OR = 2.4 (95% CI, 1.3-4.6), 15 years OR = 2.4 (95% CI, 1.3-4.6]. Exposures to rotenone and paraquat were not correlated (r = 0.004), and ORs from a model that included both pesticides (paraquat OR = 2.6; 95% CI, 1.4-4.9; rotenone OR = 2.9; 95% CI, 1.5-5.5) were comparable with those from models without mutual adjustment (Table 3). For men who used paraquat plus any dithiocarbamate (7 cases, 16 controls), the OR compared with use of neither was 2.2 (95% CI, 0.79-5.9). Compared with never users, associations with PD were generally stronger among those who had used pesticides for more than the median number of lifetime days than among those who had used pesticides for fewer than the median number of days [Supplemental Material, Table 3 (doi: 10.1289/ehp.1002839)].
Results from analyses stratified by race/ethnicity, cigarette use, state, or duration of disease (in cases) were not appreciably different between subgroups (data not shown). In an analysis restricted to 18 cases and 22 controls (28 men and 12 women) with a first-degree relative with PD, PD was not associated with ever exposure to rotenone (OR = 0.98) or paraquat (OR = 1.1). Adjustment for education or overall pesticide use did not appreciably alter effect estimates, nor did exclusion of 28 cases and 6 controls with proxy interviews or inclusion of 3 atypical parkinsonism cases.
We compared clinical features of cases who did or did not use paraquat or any oxidative stressor, or rotenone or any complex I inhibitor (Table 4). PD was diagnosed at a younger age among those who used oxidative stressors (mean age = 59 vs. 64 years, p = 0.02). Although postural reflex impairment appeared to be less frequent in those using either paraquat or rotenone, these differences were not statistically significant. Clinical features did not otherwise differ between groups. We were unable to determine whether exposure to both paraquat and rotenone was associated with unique clinical features because only five cases reported use of both pesricides (data not shown).
Table 4. Clinical features of PD cases by use of paraquat or rotenone or mechanistic group. Paraquat Characteristic Exposed Not exposed (n = 23) (n = 74) Age at PD diagnosis [years (mean 59 [+ or -] 8 62 [+ or -] 9 [+ or -] SD)] PD duration [years (mean [+ or -] 8.6 [+ or -] 6 8.4 [+ or -] 6 SD)] Clinical features [n with feature/n with data available (%)] Resting tremor 21/22 (95) 66/73 (90) Bradykinesia 22/23 (96) 70/74 (95) Rigidity 23/23 (100) 72/73 (99) Postural reflex impairment 10/21 (48) 43/62 (69) Asymmetric onset 23/23 (100) 69/71 (97) Response to dopaminergic therapy (if 21/21 (100) 63/65 (97) prescribed) Any oxidative stressor Characteristic Exposed Not exposed (n = 35) (n = 53) Age at PD diagnosis [years (mean 59 [+ or -] 8 64 [+ or -] 9 * [+ or -] SD)] PD duration [years (mean [+ or -] 8.2 [+ or -] 6 7.6 [+ or -] 5 SD)] Clinical features [n with feature/n with data available (%)] Resting tremor 31/34 (91) 49/53 (92) Bradykinesia 33/35 (94) 50/53 (94) Rigidity 33/34 (97) 50/53 (94) Postural reflex impairment 18/31 (58) 29/43 (67) Asymmetric onset 35/35 (100) 49/51 (96) Response to dopaminergic therapy (if 30/30 (100) 46/48 (96) prescribed) Rotenone Characteristic Exposed Not exposed (n = 19) (n = 82) Age at PD diagnosis [years (mean 65 [+ or -] 11 61 [+ or -] 8 [+ or -] SD)] PD duration [years (mean [+ or -] 7.7 [+ or -] 7 8.7 [+ or -] 5 SD)] Clinical features [n with feature/n with data available (%)] Resting tremor 17/18 (94) 75/81 (93) Bradykinesia 17/19 (89) 79/82 (96) Rigidity 18/19 (95) 80/80 (100) Postural reflex impairment 7/15 (47) 48/69 (70) Asymmetric onset 18/18 (100) 77/79 (97) Response to dopaminergic therapy (if 14/15 (93) 73/74 (99) prescribed) Any complex I inhibitor Characteristic Exposed Not exposed (n = 36) (n = 59) Age at PD diagnosis [years 61 [+ or -] 11 62 [+ or -] 8 (mean [+ or -] SD)] PD duration [years (mean [+ or -] SD)] 8.2 [+ or -] 6 8.5 [+ or -] 5 Clinical features [n with feature/n with data available (%)] Resting tremor 32/35 (91) 54/58 (93) Bradykinesia 34/36 (94) 56/59 (95) Rigidity 34/35 (97) 58/58 (100) Postural reflex impairment 16/28 (57) 37/52 (71) Asymmetric onset 35/35 (100) 54/56 (96) Response to dopaminergic therapy 30/31 (97) 53/54 (98) (if prescribed) * Difference between exposed versus not exposed p = 0.02.
The pathogenesis of PD is thought to involve several critical abnormalities, each of which can be the result of genetic or environmental factors. Chief among these abnormalities are dysfunction of the mitochondrial respiratory chain, particularly complex I, and the production of reactive oxygen species (Henchcliffe and Beal 2008). To our knowledge, we have performed the first analysis of pesticides classified by presumed mechanism, rather than by functional categories (e.g., herbicides) or chemical class (e.g., organochlo-rines). We found significant associations of PD with use of groups of pesticides classified as complex I inhibitors or as oxidative stressors, providing support in humans for findings from decades of experimental work. In particular, PD was strongly associated with rotenone and paraquat, two individual pesticides used extensively to model PD in the laboratory.
This study provides strong evidence of an association between rotenone use and PD in humans. PD developed 2.5 times as often in those who reported use of rotenone compared with nonusers, and an association of similar magnitude was observed even when exposure was truncated up to 15 years before PD diagnosis. In our prior analysis of self-reported PD in the AHS, information on rotenone was available for a small subgroup, and nonsignificant association with PD (OR = 1.7; 95% CI, 0.6-4.7) was observed (Kamel et al. 2007), whereas in a multicenter, clinic-based case-control study distinct from the AHS, only two individuals were exposed and no association was observed (Tanner et al. 2009). In the only other report of rotenone-like compounds and PD, use of organic pesticides such as rotenone in the previous year was determined for PD clinic attendees, who reported current use more often than did cases with other neurologic diseases (Dhillon et al. 2008). This information cannot be used to assess etiology, because the study evaluated associations with rotenone use that occurred after PD had been diagnosed. In contrast, in the present population-based study, we evaluated rotenone use before PD diagnosis in cases and during a comparable time period in neurologically healthy controls.
Rotenone is a plausible cause of PD because of its mechanism of action. Like 1 -methyl-4-phenyl-1,2,3,6-tetrahydropyri-dine (MPTP), a toxicant known to cause parkinsonism in humans, rotenone directly inhibits mitochondrial complex I (Langston et al. 1983; Sherer et al. 2007). In experimental models, both MPTP and rotenone cause selective injury of dopaminergic neurons in the substantia nigra, a key pathological feature of PD (Greenamyre et al. 1999; Langston et al. 1984). Because rotenone is believed to have a relatively short environmental half-life and limited bioavailability, a relationship to human disease has been questioned (Hatcher et al. 2008; Li et al. 2005). However, recent work in rodent models indicated that a temporally limited exposure to rotenone later caused progressive functional and pathologic changes in the enteric nervous system of rodents, mimicking changes found in human PD; as in PD, these enteric nervous system changes preceded central nervous system pathology (Abbott et al. 2001; Braak et al. 2006; Drolet et al. 2009; Greene et al. 2009; Pan-Montojo et al. 2010). Chronic rotenone exposure in the laboratory has been reported to have additional effects associated with PD pathogenesis, including ones similar to changes observed in monogenic forms of PD (Henchcliffe and Beal 2008). Rotenone toxicity, therefore, provides a conceptual bridge, suggesting shared mechanisms for both sporadic and inherited forms of PD.
Although we report here findings for agricultural use of rotenone, the ubiquitous use of rotenone in both work and home settings that occurred until recently suggests that many people may have been exposed. Humans have used rotenone-containing plants as pesticides for centuries (Cabras et al. 2002). Because rotenone is plant derived, it has been considered an organic pesticide and was commonly used as a household insecticide in home gardening and agriculture, and to kill fish. For example, the California Department of Pesticide Regulation (2007) reported that almost 15,000 pounds of rotenone were used in 2007, not including home use. Rotenone was withdrawn from use in the European Union in 2007 (Schapira 2010), after which time most uses were voluntarily cancelled in the United States (U.S. EPA 2007). Other agents associated with mitochondrial complex I inhibition remain in common use. For example, permethrin is used in nonagricultural settings as an insect repellant, including use of permethrin-impregnated fabric for military uniforms and recreational clothing (Armed Forces Pest Management Board 2010).
Our study also extends prior research on paraquat. Experimentally, paraquat produces subcellular changes associated with PD, including increased production of reactive oxygen species, alpha-synuclein aggregation, and selective nigral injury (Dinis-Oliveira et al. 2006; Kuter et al. 2010; McCormack et al. 2002). Previously, we found an association between paraquat use and PD in prevalent but not incident self-reported cases in the AHS (Kamel et al. 2007) and a nonsignificant association between PD and occupational paraquat use in a multicenter case-control study (Tanner et al. 2009). Cumulative use was not assessed in either study. Only a few other studies have assessed associations between PD and paraquat use (Table 1). A study of 120 cases and 240 controls conducted in Taiwan (Liou et al. 1997) reported an OR of 3.22 (95% CI, 2.41-4.31) for PD in paraquat users compared with nonusers. Cumulative exposure was associated with greater risk, but paraquat use in the Taiwanese study was highly correlated with use of other herbicides. Although the inconsistency of findings in human populations has been used as a basis for suggesting that paraquat is not associated with PD (Li et al. 2005; Miller 2007), an alternative explanation is that few studies have had adequate size and sufficiently detailed exposure information to allow the association to be observed. Our findings, considered together with earlier results, suggest that paraquat use plays a role in human PD. Because paraquat remains one of the most widely used herbicides worldwide (Frabotta 2009), this finding potentially has great public health significance.
Parkinsonism in humans due to high-dose exposure to toxicants such as carbon monoxide or manganese has characteristic clinical features including less prominent tremor, more prominent postural instability, symmetric distribution of signs, and poor response to dopaminergic therapy (Tanner 1992). We did not observe such features in our cases. Cases who did or did not use rotenone, paraquat, or groups of pesticides with similar mechanisms were generally similar, suggesting that PD associated with these agents is clinically typical and indirectly supporting a role for pesticide exposure in the etiology of typical PD. We did note an earlier age at diagnosis in users of oxidative stressors and a suggestion of this in paraquat users specifically. Early age at onset is also a characteristic of genetic parldnsonism in which oxidative stress is a presumed pathophysiologic mechanism (alpha-synuclein, PINK-1, DJ-1, and PARKIN mutations) (Henchcliffe and Beal 2008; Klein et al. 2009).
In FAME, pesticide exposure was not associated with PD in individuals with a family history, although numbers were small. Interestingly, Hancock et al. (2008) similarly found pesticide exposure to be associated with PD risk only in those without an affected first-degree relative.
Our study has some limitations. First, because most participants were exposed to many pesticides, we cannot confidently exclude effects of agents other than those studied or rule out the possibility that our results are attributable to combined exposures. However, the associations that we observed remained after adjustment for overall pesticide use, and estimated effects of rotenone and paraquat were comparable after mutual adjustment. Future investigations of combinations of pesticides and of other mechanistic groups will be important. Second, we could not use laboratory measures of pesticides or their metabolites to estimate exposure. Such measures are not available for many of the pesticides we studied, and when available, they are poor predictors of past or long-term use. Thus, although we recognize that retrospective exposure assessment has limitations, it is often the best approach for studying lifelong exposure in an adult population in connection with a rare disease. Third, we included prevalent cases already diagnosed but still living at enrollment in the AHS; therefore, survivor bias is possible. However, our results were similar when only those with shorter disease duration were analyzed. Additionally, we were able to investigate only persons willing to participate. Thus, PD cases or controls in this study may not have been fully representative of the entire population. However, participation was good, partially allaying this concern. Finally, we selected pesticides presumed to act through specific toxic mechanisms, but for most pesticides there is very little information regarding toxic effects in humans, as most studies are directed toward effects on plant or animal pests. It is likely that we have misclassified some pesticides with regard to mechanism. However, the likely effect of any misclassification would be to attenuate an association with pesticides grouped according to a common mechanism.
Strengths include the size of the study; the focus on an agricultural cohort with many exposed individuals and wide variability in exposure; the quality of diagnosis, which was based on in-person assessment and agreement of movement disorders experts; and the completeness and reliability of the pesticide exposure information. An additional strength is the nested case-control design with an internal control group who had similar exposure opportunities as the cases and similar demographic and lifestyle characteristics, reducing the likelihood of bias or confounding. Use of pesticides in general was ubiquitous, of course, in applicators and relatively common among their spouses, and all participants may have had additional passive pesticide exposure. However, these features would all be likely to lower the chance of identifying any effect.
Our study helps connect the dots between basic research and human populations. Rotenone and paraquat have been linked experimentally to pathophysiological mechanisms implicated in human PD. Groups of pesticides linked to the mechanisms of mitochondrial dysfunction or oxidative stress were also associated with PD in our study, thus extending experimental work to provide strong evidence that these mechanisms play a role in PD in humans. Importantly, the potential for exposure to many of these pesticides, including rotenone and paraquat, extends well beyond the occupational setting. Many persons with nonoccupational pesticide exposures may be unaware of the presence of pesticides in their environments (Centers for Disease Control and Prevention 2009). The potential for exposure to other toxicants with similar mechanisms is even greater. To continue the interplay between human and experimental studies, future mechanistic studies of these pesticides should model exposure conditions similar to those occurring in humans, including chronic low-dose exposure, exposure to multiple agents, and assessment of gene-exposure interactions. Such work could provide new insights into the pathogenesis and ultimately the prevention of PD.
Abbott RD, Petrovitch H, White LR, Masaki KH, Tanner CM, Curb JD, et al. 2001. Frequency of bowel movements and the future risk of Parkinson's disease. Neurology 57(3):456-462.
Alavanja MC, Sandler DP, McMaster SB, Zahm SH, McDonnell CJ, Lynch CF, et al. 1996. The Agricultural Health Study. Environ Health Perspect 104:362-369.
Armed Forces Pest Management Board. 2010. Permethrin - Impregnated Clothing. Available: http://fhpr.osd.mil/factsheetDetail.jsp?fact=27 [accessed 4 November 2010].
ATSDR (Agency for Toxic Substances and Disease Registry). 2002. Home page. Available: http://www.atsdr.cdc.gov/ [accessed 15 January 20021.
Bain P, Brin M, Deuschl G, Elble R, Jankovic J, Findley L, et al. 2000. Criteria for the diagnosis of essential tremor. Neurology 54(11 suppl 4):S7.
Betarbet R, Sherer TB, MacKenzie G, Garcia-Osuna M, Panov AV, Greenamyre JT. 2000. Chronic systemic pesticide exposure reproduces features of Parkinson's disease. Nat Neurosci 3(12):1301-1306.
Blair A, Tarone R, Sandler D, Lynch CF, Rowland A, Wintersteen W, et al. 2002. Reliability of reporting on lifestyle and agricultural factors by a sample of participants in the Agricultural Health Study from Iowa. Epidemiology 13(1):94-99.
Braak H, de Vos RA, Bohl J, Del Tredici K. 2006. Gastric alpha-synuclein immunoreactive inclusions in Meissner's and Auerbach's plexuses in cases staged for Parkinson's disease-related brain pathology. Neurosci Lett 396(1):67-72.
Cabras P, Caboni P, Cabras M, Angioni A, Russo M. 2002. Rotenone residues on olives and in olive oil. J Agric Food Chem 50(9):2576-2580.
California Department of Pesticide Regulation. 2007. Pesticide Use Reporting (PUR). Available: http://www.cdpr.ca.gov/docs/pur/purmain.htm <http://www.cdpr.ca.gov/docs/pur/purmain.htm> [accessed 12 September 2009].
Centers for Disease Control and Prevention. 2009. Fourth National Report on Human Exposure to Environmental Chemicals. Available: http://www.cdc.gov/ExposureReport/index.html [accessed 17 December 2009].
Costello S, Cockburn M, Bronstein J, Zhang X, Ritz B. 2009. Parkinson's disease and residential exposure to maneb and paraquat from agricultural applications in the central valley of California. Am J Epidemiol 169(8):919-926.
Degli Esposti M. 1998. Inhibitors of NADH-ubiquinone reductase: an overview. Biochim Biophys Acta 1364(2):222-235.
Dhillon AS, Tarbutton GL, Levin JL, Plotkin GM, Lowry LK, Nalbone JT, et al. 2008. Pesticide/environmental exposures and Parkinson's disease in East Texas. J Agromedicine 13(1):37-48.
Di Monte DA, Lavasani M, Manning-Bog AB. 2002. Environmental factors in Parkinson's disease. Neurotoxicology 23(4-5):487-502.
Dinis-Oliveira RJ, Remiao F, Carmo H, Duarte JA, Navarro AS, Bastos ML, et al. 2006. Paraquat exposure as an etiological factor of Parkinson's disease. Neurotoxicology 27(6):1110-1122.
Doty RL, Marcus A, Lee WW. 1996. Development of the 12-item Cross-Cultural Smell Identification Test (CC-SIT). Laryngoscope 106(3 pt 1):353-356.
Drolet RE, Cannon JR, Montero L, Greenamyre JT. 2009. Chronic rotenone exposure reproduces Parkinson's disease gastrointestinal neuropathology. Neurobiol Dis 36(1):96-102.
Elble RJ. 2000. Diagnostic criteria for essential tremor and differential diagnosis. Neurology 54(11 suppl 4):S2-S6.
EXTOXNET (Extension Toxicology Network). 2002. Home page. Available: http://pmep.cce.cornell.edu/profiles/extoxnet/ [accessed 3 February 20021.
Fahn S, Elton RL, Members of the UPDRS Development Committee. 1987. Unified Parkinson's disease rating scale. In: Recent Developments in Parkinson's Disease, Vol II (Fahn S, Marsden CD, Calne DB, Goldstein M, eds). Florham Park, NJ:Macmillan Healthcare Information, 153-163.
Fahn S, Tolosa E, Marin C. 1993. Clinical rating scale for tremor. In: Parkinson's Disease and Movement Disorders (Jankovic J, Tolosa E, eds). Baltimore:Williams & Wilkins, 225-234.
Firestone JA, Lundin Jl, Powers KM, Smith-Weller T, Franklin GM, Swanson PD, et al. 2010. Occupational factors and risk of Parkinson's disease: a population-based case-control study. Am J Ind Med 53(3):217-223.
Firestone JA, Smith-Weller T, Franklin G, Swanson P, Longstreth WT Jr., Checkoway H. 2005. Pesticides and risk of Parkinson disease: a population-based case-control study. Arch Neurol 62(1):91-95.
Frabotta D. 2009. Paraquat: Herbicide Helps No-till Operations. Available: http://www.farmchemicalsinternational.com/magazine/?storyid=413 [accessed 17 December 2009].
Gelb DJ, Oliver E, Gilman S. 1999. Diagnostic criteria for Parkinson disease. Arch Neurol 56(1):33-39.
Gilman S, Low PA, Quinn N, Albanese A, Ben-Shlomo Y, Fowler CJ, et al. 1999. Consensus statement on the diagnosis of multiple system atrophy. J Neurol Sci 163(1):94-98.
Grant BF, Hasin DS, Chou SP, Stinson FS, Dawson DA. 2004. Nicotine dependence and psychiatric disorders in the United States: results from the national epidemiologic survey on alcohol and related conditions. Arch Gen Psychiatry 61(11):1107-1115.
Greenamyre JT, MacKenzie G, Peng Tl, Stephans SE. 1999, Mitochondrial dysfunction in Parkinson's disease. Biochem Soc Symp 66:85-97.
Greene JG, Noorian AR, Srinivasan S. 2009. Delayed gastric emptying and enteric nervous system dysfunction in the rotenone model of Parkinson's disease. Exp Neurol 218(1):154-161.
Hancock DB, Martin ER, Mayhew GM, Stajich JM, Jewett R, Stacy MA, et al. 2008. Pesticide exposure and risk of Parkinson's disease: a family-based case-control study. BMC Neurol 8:6; doi.10.1186/1471-2377-8-6 [Online 28 March 2008].
Hatcher JM, Pennell KD, Miller GW. 2008. Parkinson's disease and pesticides: a toxicological perspective. Trends Pharmacol Sci 29(6):322-329.
Hertzman C, Wiens M, Bowering D, Snow B, Calne D. 1990. Parkinson's disease: a case-control study of occupational and environmental risk factors. Am J Ind Med 17(3):349-355.
Hertzman C, Wiens M, Snow B, Kelly S, Calne D. 1994. A case-control study of Parkinson's disease in a horticultural region of British Columbia. Mov Disord 9(1):69-75.
Henchcliffe C, Beal MF. 2008. Mitochondrial biology and oxidative stress in Parkinson disease pathogenesis. Nat Clin Pract Neurol 4(11):600-609.
Hoppin JA, Yucel F, Dosemeci M, Sandler DP. 2002. Accuracy of self-reported pesticide use duration information from licensed pesticide applicators in the Agricultural Health Study. J Expo Anal Environ Epidemiol 12(5):313-318.
Hughes AJ, Daniel SE, Kilford L, Lees AJ. 1992. Accuracy of clinical diagnosis of idiopathic Parkinson's disease: a clinico-pathological study of 100 cases. J Neurol Neurosurg Psychiatry 55(3):181-184.
Kamel F, Tanner C, Umbach D, Hoppin J, Alavanja M, Blair A, et al. 2007. Pesticide exposure and self-reported Parkinson's disease in the agricultural health study. Am J Epidemiol 165(4):364-374.
Klein C, Schneider SA, Lang AE. 2009. Hereditary parkinsonism: Parkinson disease look-alikes--an algorithm for clinicians to "PARK" genes and beyond. Mov Disord 24(14):2042-2058.
Krieger R. 2001. Handbook of Pesticide Toxicology. 2nd ed. San Diego, CA:Academic Press.
Kuter K, Nowak P, Golembiowska K, Ossowska K. 2010. Increased reactive oxygen species production in the brain after repeated low-dose pesticide paraquat exposure in rats. A comparison with peripheral tissues. Neurochem Res 35(8):1121-1130.
Langston JW, Ballard P, Tetrud JW, Irwin I. 1983. Chronic Parkinsonism in humans due to a product of meperidine-analog synthesis. Science 219(4587):979-980.
Langston JW, Forno LS, Rebert CS, Irwin I. 1984. Selective nigral toxicity after systemic administration of 1-methyl-4-phenyl-1,2,5,6-tetrahydropyrine (MPTP) in the squirrel monkey. Brain Res 292(2):390-394.
Langston JW, Widner H, Goetz CG, Brooks DJ, Fahn S, Freeman TB, et al. 1992. Core assessment program for intracerebral transplantations (CAPIT). Mov Disord 7(1):2-13.
Li AA, Mink PJ, Mcintosh LJ, Teta MJ, Finley B. 2005. Evaluation of epidemiologic and animal data associating pesticides with Parkinson's disease. J Occup Environ Med 47(10):1059-1087.
Liou HH, Tsai MC, Chen CJ, Jeng JS, Chang YC, Chen SY, et al. 1997. Environmental risk factors and Parkinson's disease: a case-control study in Taiwan. Neurology 48(6):1583-1588.
Litvan I, Agid Y, Calne D, Campbell G, Dubois B, Duvoisin RC, et al. 1996. Clinical research criteria for the diagnosis of progressive supranuclear palsy (Steele-Richardson-Olszewski syndrome): report of the NINDS-SPSP international workshop. Neurology 47(1):1-9.
McCormack AL, Thiruchelvam M, Manning-Bog AB, Thiffault C, Langston JW, Cory-Slechta DA, et al. 2002. Environmental risk factors and Parkinson's disease: selective degeneration of nigral dopaminergic neurons caused by the herbicide paraquat. Neurobiol Dis 10(2):119-127.
McKeith IG, Galasko D, Kosaka K, Perry EK, Dickson DW, Hansen LA, et al. 1996. Consensus guidelines for the clinical and pathologic diagnosis of dementia with Lewy bodies (DLB): report of the consortium on DLB international workshop. Neurology 47(5):1113-1124.
Miller GW. 2007. Paraquat: the red herring of Parkinson's disease research. Toxicol Sci 100(1):1-2.
National Center for Biotechnology Information. 2002. PubChem. Available: http://pubchem.ncbi.nlm.nih.gov/ [accessed 23 January 2002].
Pan-Montojo F, Anichtchik O, Dening Y, Knels L, Pursche S, Jung R, et al. 2010. Progression of Parkinson's disease pathology is reproduced by intragastric administration of rotenone in mice. PLoS One 5(1):e8762; doi:10.1371/journal. pone.0008762 (Online 19 January 2010].
Sanchez-Ramos JR, Hefti F, Weiner WJ. 1987. Paraquat and Parkinson's disease. Neurology 37(4):728.
Schapira AH. 2010. Complex I: inhibitors, inhibition and neuro-degeneration. Exp Neurol 224:331-335.
Semchuk KM, Love EJ, Lee RG. 1992. Parkinson's disease and exposure to agricultural work and pesticide chemicals. Neurology 42(7):1328-1335.
Sherer TB, Richardson JR, Testa CM, Seo BB, Panov AV, Yagi T, et al. 2007. Mechanism of toxicity of pesticides acting at complex I: relevance to environmental etiologies of Parkinson's disease. J Neurochem 100(6):1469-1479.
Tanner CM. 1992. Occupational and environmental causes of parkinsonism. Occup Med 7(3):503-513.
Tanner CM, Ross GW, Jewell SA, Hauser RA, Jankovic J, Factor SA, et al. 2009. Occupation and risk of parkinsonism: a mul-ticenter case-control study. Arch Neurol 66(9):1106-1113.
Teng EL, Hasegawa K, Homma A, Imai Y, Larson E, Graves A, et al. 1994. The Cognitive Abilities Screening Instrument (CASH: a practical test for cross-cultural epidemiological studies of dementia. Int Psychogeriatr 6(1):45-58; discussion 62.
Thiruchelvam M, Brockel BJ, Richfield EK, Baggs RB, Cory-Slechta DA. 2000. Potentiated and preferential effects of combined paraquat and maneb on nigrostriatal dopamine systems: environmental risk factors for Parkinson's disease? Brain Res 873(2):225-234.
Tolosa E, Wenning G, Poewe W. 2006. The diagnosis of Parkinson's disease. Lancet Neurol 5(1):75-86.
U.S. EPA (U.S. Environmental Protection Agency). 2007. Reregistration Eligibility Decision for Rotenone. March 2007 EPA 738-R-07-005. Available: http://www.epa.gov/pesticides/reregistration/REDs/rotenone_red.pdf [accessed 17 November 2009].
Uversky VN, Li J, Fink AL. 2001. Pesticides directly accelerate the rate of alpha-synuclein fibril formation: a possible factor in Parkinson's disease. FEBS Lett 500(3):105-108.
Address correspondence to C. Tanner, Parkinson's Institute, 675 Almanor Ave., Sunnyvale, CA 94085 USA. Telephone: (408) 734-2800. Fax: (408) 734-8455- E-mail: email@example.com
Supplemental Material is available online (doi:10.1289/ehp.l002839 via http://dx.doi.org/).
The authors thank the participants, the research team, T. Grcenamyre for manuscript review, and J. Wright for editorial assistance.
This study was supported in part by the Intramural Research Program of the National Institutes of Health [National Institute of Environmental Health Sciences (NJEHS) grants Z01-ES044007 and Z01-ES049030, National Cancer Institute grant Z01-CP010119], NIEHS grant R01-ES10803, and James and Sharron Clark.
C.T., W.L., C.M., H.F., W.R., and S.G., in addition to their listed affiliations, serve on advisory boards for various foundations and serve as consultants and receive financial support from many sources, including former and current welding products manufacturers and pharmaceutical companies who manufacture or do research on medications for Parkinson's disease. The Parkinson's Institute treats patients with PD. Westat is an employee-owned company. The other authors declare they have no actual or potential competing financial interests.
Received 8 August 2010; accepted 26 January 2011.
Caroline M. Tanner, (1) Freya Kamel, (2) G. Webster Ross, (3) Jane A. Hoppin, (2) Samuel M. Goldman, (1) Monica Korell, (1) Connie Marras, (4) Grace S. Bhudhikanok (1) Meike Kasten, (5) Anabel R. Chade, (6) Kathleen Comyns, (1) Marie Barber Richards, (2), (7) Cheryl Meng, (1) Benjamin Priestley, (1) Hubert H. Fernandez, (8) Franca Cambi, (9) David M. Umbach, (10) Aaron Blair, (11) Dale P. Sandler, (2) and J. William Langston (1)
(1) The Parkinson's Institute, Sunnyvale, California, USA; (2) Epidemiology Branch, National Institute of Environmental Health Sciences, National Institutes of Health, Department of Health and Human Services, Research Triangle Park, North Carolina, USA; (3) Veterans Affairs Pacific Islands Health Care System, Honolulu, Hawaii, USA; (4) Toronto Western Hospital, University of Toronto, Toronto, Ontario, Canada; (5) Departments of Neurology and Clinical and Molecular Neurogenetics, University of Lubeck, Lubeck, Germany; (6) Institute of Cognitive Neurology, Institute of Neuroscience, Favaloro University, Buenos Aires, Argentina; (7) Westat Inc., Durham, North Carolina, USA; (8) Center for Neurological Restoration, Cleveland Clinic, Cleveland, Ohio, USA; (9) Department of Neurology, University of Kentucky, Lexington, Kentucky, USA; (10) Biostatistics Branch, National Institute of Environmental Health Sciences, National Institutes of Health, Department of Health and Human Services, Research Triangle Park, North Carolina, USA; (11) Occupational and Environmental Epidemiology Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Department of Health and Human Services, Bethesda, Maryland, USA
|Printer friendly Cite/link Email Feedback|
|Author:||Tanner, Caroline M.; Kamel, Freya; Ross, G. Webster; Hoppin, Jane A.; Goldman, Samuel M.; Korell, Mo|
|Publication:||Environmental Health Perspectives|
|Date:||Jun 1, 2011|
|Previous Article:||Lung cancer incidence and long-term exposure to air pollution from traffic.|
|Next Article:||Residential proximity to freeways and autism in the CHARGE study.|