Demographic analysis: an update of randomized controlled studies in prostatic oncology.
Randomized controlled trials (RCTs) are considered among the most reliable for evaluating scientific evidence and are most effective in removing bias and confounding factors that regularly compromise the validity of medical and scientific research. Other types of studies are of benefit, such as feasibility studies or those that assess inherently subjective parameters, such as patient perceptions. In any case, the need for properly constructed randomized trials to evaluate the effectiveness of a wide range of medical or surgical therapies cannot be overstated.
There is a vast amount of work that goes into a properly designed RCT, which most often consists of a sufficiently large sample size and rigorous study design. Oftentimes, blinding is not possible or is unethical, such as in studies with surgical arms; often, sufficient sample sizes are difficult to attain. Generally, to validate and implement innovative treatment regimens, at least one properly constructed RCT needs to be conducted.
We exam the urologic oncology literature through numerous MEDLINE searches to ascertain the number articles published that used data from prospective, phase II/III RCTs. These may also be follow-up studies to the original conducted trials. We then undertake a demographic analysis of RCT articles in prostate cancer for 5 major categories from 1997 to March 21, 2006. These are modality of intervention, cohort size, area of expertise of principle author, country of origin and journal type in which the article was published.
A MEDLINE search was performed using the OVID MEDLINE database from "1966 to March Week 3 2006" with the exploded medical subject heading for "prostatic neoplasms." The results of the search was then limited to publications in English and was stratified on a yearly basis from 1997 to March 21, 2006. Each of the 10 search strings corresponding to each year for a given category was then combined with the search string with the MeSH "Clinical trial.mp. OR clinical trial.pt. OR random:.mp. OR tu.xs." This search string has been shown to be an optimal search strategy with great sensitivity, as high as 99.8%, for detecting RCTs in the MEDLINE database (Appendix 1).[sup.10]
Publications were then manually appraised for inclusion as RCTs by examining the abstract and article itself. Demographic data were then extracted from each article and tabulated.
For this study, only RCTs that use primary data were included in this study. Meta-analyses and review articles were excluded. We included follow-up publications to ongoing trials. This would lead to greater than one article being tabulated for a given trial, usually incorporated with RCT articles in a subsequent year.
The modalities of intervention covered the main areas of focus for trials in urologic oncology (Table 2, Table 3). These included trials that had only medical, surgical or radiotherapeutic treatment arms versus controls. Combinations of the above were also considered and included. Studies that focused on primarily screening interventions and measurements of quality of life parameters were also included.
Screening studies were included as long as they were found to be randomized trials that allocated participants to intervention arms appropriately. An example of this is a trial that studied prostate specific antigen or prostate biopsies in men randomly allocated to screening versus no intervention.
Trials that focused on quality of life factors were also included if the intervention the trials addressed had participants randomized to treatment and control groups appropriately. For example, a trial that measured quality of life parameters in patients randomized to surgery or watchful waiting would have been included.
It should be noted when allocating articles to the category for journal type, articles that were found in journals with a focus on a primarily surgical field were sited as such. For example, if an article was found in Urology or European Urology, the journal was categorized as being primarily a surgical one.
In the above-listed database, there were 28 465 publications for the exploded MeSH term "prostatic neoplasms." The search term "Clinical trial.mp. OR clinical trial.pt. OR random:.mp. OR tu.xs." yielded 1 110 837 results. Searches were combined in MEDLINE to yield all the English publications on a yearly bases with the above two MeSHs. The total number of articles for all years yielded from the search was 7831. These were then individually sifted, and only 517 (6.6%) articles were found to be RCTs.
We illustrate the selection process for RCTs for prostatic neoplasms in 1997 (Fig. 1). A similar process was carried out for subsequent years.
For the 7831 articles obtained from our MEDLINE searches, we broke the data by year and this demonstrated a steady increase in the number of RCT publications since 1997 (Table 1), although only a small percentage of articles indexed as RCTs in prostatic oncology are actually RCTs per given year (5.4%-8.6%).
We also looked at cumulative parameters over the 10-year period (Table 2). Modalities within these parameters varied. However, most trials over this period commonly examined medical therapies (42.7%) to treat prostatic neoplasms. This was followed by diagnostic studies (13.2%). Cohort sizes were generally greater than 100 (63.1%). Urologists were often the lead investigators of the trials (48.2%). Trials were generally based in European cities, followed by the United States with 43.1% and 38.3%, respectively. Articles were usually published in surgical journals (48.4%) followed by medical journals (36.9%).
We tallied the demographic data from the remaining 517 articles (Table 3). These are shown for each year and provide a detailed analysis of the distribution of RCTs found using our search criteria over the past 10 years.
We present, through a series of MEDLINE searches, demographic data from 517 retrieved articles in prostatic oncology. Several search systems, such as EMBASE, MEDLINE, CINAHL, are valuable tools to help health care and non-health care professionals across a wide range of specialties retrieve RCTs. Although these databases allow researchers to acquire and sift through large amounts of published articles rather expediently, they are not all-comprehensive and in some studies, database-based searches identified only 46% to 51% of RCTs.[sup.2,3] Often, references are also listed as RCTs when they do not qualify as such. Carr and Klotz showed that this rate may be as high as 78%.[sup.4] Given such rates, it would not be surprising to discover that a large number of articles were not identified by our searches over such an extended study period of 10 years. In this respect, our MeSHs may have also limited our retrieval numbers.
In other searches we conducted (data not shown), RCTs have been indexed with MeSHs "Controlled Clinical Trials," "Clinical Trials," "Random Allocation" (to name a few). These were not included as part of our search terms as we primarily wanted to look at RCTs. Since a vast quantity of non-random trials would have been retrieved with multiple MeSHs as well, we chose to include only articles that had the MeSH "Clinical trial.mp. OR clinical trial.pt. OR random:.mp. OR tu.xs." As discussed earlier, this has been shown to have high sensitivity for retrieving high-powered clinical trials through MEDLINE.
Of the 23 905 articles indexed with MeSH "prostatic neoplasms" retrieved over our 10-year time interval, only 517 (2.2%) were RCTs. This is consistent with findings by Carr and Klotz.[sup.4] It is worth noting that most excluded publications were review articles, meta-analyses, commentaries and proposals.
Although this paper does not directly compare the number of RCTs with other medical or surgical fields, for example RCTs in leukemia literature, others have shown that the number of published RCTs across many fields is also quite dismal when compared to other study designs with less internal validity. In one study, Sauerland and colleagues demonstrated that the proportion of RCTs published in many surgical and medical journals representing a wide range of surgical and medical specialties was quite low, 2.5% and 3.6%, respectively.[sup.5] From the paucity of RCT publications, it is not unreasonable to infer that an equally low number of such trials are being conducted.
Despite the sparse number of RCTs conducted each year in prostatic oncology, there is some evidence to suggest that a more rigorous approach to study design and investigation is taking place. Al-Futaisi and colleagues compared the number of clinical trials and evaluated the quality of research in pediatric urology in 1990 and 2000.[sup.6] They showed that although a similar number of clinical trials were being conducted in the 2 years, there was a statistically significant increase in analytic design (21.8% vs. 39.5%, p = 0.01) and an increase in case control studies (11.3% vs. 22.9%, p = 0.02) from 1990 to 2000, respectively.[sup.6] This occurrence was also noted by Mylonas who also found that clinical research in neurosurgery in 1990 used studies with significantly stronger research designs than in 1975.[sup.7]
It has been shown in this work and several other quoted references that the number of RCT studies published each year are meagre. The question remains: what are the obstacles to RCTs being performed in urologic oncology and other surgical and medical specialties?
Firstly, one of the major difficulties in conducting RCTs in surgery are issues of ethical principles that arise regarding randomization. It is unimaginable, in light of current surgical practices, to enter a control group a radical prostatectomy, for example. Concordantly, many patients have a difficult time accepting the concept of randomization in surgical clinical trials. O'Reilly and colleagues write: "Men with a life expectancy of 10 to 25 years who develop prostate cancer will not allow themselves to be randomized to a "watchful waiting group."[sup.8]
One should also comment on the innate differences in surgical practice between and within institutions and surgical centres everywhere and the intrinsic variability in surgical treatment due to human error. Kranenbarg and Van de Velde wrote that: "Randomization of patients to evaluate surgical procedures involves problems in addition to those associated with medical experimentation. Surgery, unlike a pill, is not a standardized, reproducible entity, but rather a unique product whose details are defined by variables which include, for example, the skill of the surgeon. The skill level will not only vary among surgeons, but will increase for the same surgeon as he gains experience."[sup.9]
The very essence of RCTs is to provide a high degree of intrinsic validity so that unique parameters can be evaluated with few confounding errors. Introducing human experience to such a degree, as inherent in surgery, has profound effects on outcomes or procedures and patient decision-making.
Secondly, the cost of definitive, large cohort size RCTs is a major cause for their scarceness. Weinberger and colleagues discuss the obstacles, both scientific and operational issues, involved in properly designed RCT; they also examine the innate enormous financial burden of conducting large unisite or multisite RCTs.[sup.10]
Thirdly, RCTs especially in surgical fields have greater challenges than those in other medical fields; this is especially true in Canadian centres where there are limits on operating room hours and the resulting competition between surgical specialties for this limited time puts a cap on the amount of procedures that can be completed. For example, it is much more efficient for physicians to administer and investigate the effects of an oral therapy given in pill form to individuals inflicted with an ailment than it is for surgeons to carry out the same number of procedures. Obviously fewer time and resources are needed to administer a pill than to perform surgery.
Other obstacles to RCT realization specific for surgery include poor outcome and complications to surgery (for example, when a patient expires as a result of postoperative infection and not necessarily as a consequence of the offending tumour). Also dropout rates and loss to follow-up can have significant effects on results, as would occur in other RCTs.[sup.11]
There are many barriers which prevent extremely well-designed RCTs from being universally generalizable.
Our study examines the number of RCTs retrieved from numerous MEDLINE searches in prostatic oncology from 1997 to March 2006 inclusive and supports previous studies that show a relatively low number of RCTs being conducted in prostatic oncology.
Significant efforts are needed to overcome the numerous hurdles so that the body of evidence supporting therapeutic interventions may be increased.
This paper has been peer-reviewed.
Competing interests: None declared.
1.. Haynes BR, McKibbon AK, Wilczynski NL, et al. Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survery. BMJ 2005;330:1179.
2.. Poynard T, Conn HO. The retrieval of randomized clinical trials in liver disease from the medical literature. A comparison of MEDLARS and manual methods. Control Clin Trials 1985;6:271-9.
3.. Solomon MJ, Laxamana A, Devore L, et al. Randomized controlled trials in surgery. Surgery 1994;115:707-12.
4.. Carr LK, Klotz LH. Randomized controlled trials in urologic oncology: a demographic analysis. Can J Urol 1994;1:83-6.
5.. Sauerland S, Bouillon B, Neugebauer E. The practice of evidence-based medicine in surgery--evidence and experience. Z Arztl Fortbild Qualitatssich 2003;97:271-5.
6.. Al-Futaisi A, Shevell M. Comparative audit of clinical research in pediatric neurology. J Child Neurol 2004;19:882-6.
7.. Mylonas C. Research in neurosurgical journals. Br J Neurosurg 1992;6:41-6.
8.. O'Reilly P, Martin L, Collins G. Few patients with prostate cancer are willing to be randomised to treatment. BMJ 1999;318:1556.
9.. Kranenbarg EK, van de Velde CJ. Importance of organizing surgical trials in oncology. Jpn J Clin Oncol 1999;29:185-6.
10.. Weinberger M, Oddone EZ, Henderson WG, et al. Multisite randomized controlled trials in health services research: scientific challenges and operational issues. Med Care 2001;39:627YoungJMSolomonMJImproving the evidence-base in surgery: evaluating surgical effectivenessANZ J Surg200373:507-10.
11.. Solomon MJ, Pager CK, Young JM, et al. Patient entry into randomized controlled trials of colorectal cancer treatment: Factors influencing participation. Surgery 2003;133:608-13.
Medline search strategy
0 Database: Ovid MEDLINE(R) <1996 to March Week 3 2006> Search Strategy: 1 Clinical trial.mp. or clinical trial.pt. or random:.mp. or tu.xs. (1110837) 2 exp Prostatic Neoplasms/ (28465) 3 limit 2 to (english language and yr="2006") (237) 4 exp Prostatic Neoplasms/ (28465) 5 limit 4 to (english language and yr="2005") (3324) 6 exp Prostatic Neoplasms/ (28465) 7 limit 6 to (english language and yr="2004") (3462) 8 exp Prostatic Neoplasms/ (28465) 9 limit 8 to (english language and yr="2003") (3265) 10 exp Prostatic Neoplasms/ (28465) 11 limit 10 to (english language and yr="2002") (2748) 12 exp Prostatic Neoplasms/ (28465) 13 limit 12 to (english language and yr="2001") (2545) 14 exp Prostatic Neoplasms/ (28465) 15 limit 14 to (english language and yr="2000") (2381) 16 exp Prostatic Neoplasms/ (28465) 17 limit 16 to (english language and yr="1999") (2068) 18 exp Prostatic Neoplasms/ (28465) 19 limit 18 to (english language and yr="1998") (1946) 20 exp Prostatic Neoplasms/ (28465) 21 limit 20 to (english language and yr="1997") (1929) 22 1 and 3 (70) 23 1 and 5 (1112) 24 1 and 7 (1124) 25 1 and 9 (1146) 26 1 and 11 (903) 27 1 and 13 (817) 28 1 and 15 (800) 29 1 and 17 (688) 30 1 and 19 (577) 31 1 and 21 (594)
Figure and Tables
Fig. 1.: Process used to identify randomized controlled trials for prostatic neoplasms in 1997 using MEDLINE and manual exclusion. ≠Exact MeSH terms are: "Clinical trial.mp. or clinical trial.pt. or random:.mp. or tu.xs." [Figure omitted]
Table 1.: Number of articles before and after manual appraisal of MEDLINE searches [Table omitted]
Table 2.: Cumulative data for all 517 articles over 10-year period [Table omitted]
Table 3.: Randomized controlled trials in urologic oncology from 1997 to March 2006 [Table omitted]
 Division of Urology, Department of Surgery, University of Toronto, Toronto, ON
Correspondence: Dr. Elias Wehbi, Division of Urology, Department of Surgery, University of Toronto, Toronto, ON; email@example.com
|Printer friendly Cite/link Email Feedback|
|Title Annotation:||Original Research|
|Author:||Wehbi, Elias; Hersey, Karen; Finelli, Tony; Fleshner, Neil E.|
|Publication:||Canadian Urological Association Journal (CUAJ)|
|Date:||Aug 1, 2011|
|Previous Article:||Guidelines for the management of the incidentally discovered adrenal mass.|
|Next Article:||Identification of lymphatic pathway involved in the spreading of prostate cancer by fluorescence navigation approach with intraoperatively injected...|