Trends in pancreatic pathology practice before and after implementation of endoscopic ultrasound-guided fine-needle aspiration: an example of disruptive innovation effect?
[FIGURE 1 OMITTED]
MATERIALS AND METHODS
The study included all consecutive patients who underwent cytologic or histologic evaluation for pancreatic lesions at the University of Alabama at Birmingham Medical Center, Birmingham, Alabama, in the period from January 1990 to December 2010. Endoscopic ultrasound-guided fine-needle aspiration was introduced in our institution in July 2000. This medical center is the largest reference center for pancreatic cancer in the state and has an active National Institute of Health Pancreatic Specialized Program of Research Excellence grant. Included in the study were all patients with suspicious pancreatic lesions. Transplant and trauma cases were excluded. The most severe diagnosis was considered when there were duplicate specimens from the same lesion. Gastroenterology, surgery, or radiology units ordered the majority of cytology specimens, whereas surgery or radiology units ordered the majority of histology specimens.
Non-endoscopic ultrasound-guided fine-needle aspiration pancreatic samples included fluids, brushes, and smears. Fluids were obtained through endoscopic retrograde cholangiopan-creatography or cholangiography and sent to the laboratory fresh, then concentrated and prepared as smears, cytospins, thin layer, and/or cell block. A combination of Diff-Quik and Papanicolaou stain was performed on these preparations. Endoscopic ultrasound-guided fine-needle aspiration smears were air dried before staining with Diff-Quik stains. In some cases, smears were fixed in 95% ethanol for Papanicolaou staining in the laboratory. Cell block preparations were attempted in each case. Flow cytometry and culture for microorganisms were occasionally ordered as ancillary tests. Rapid on-site interpretation was performed in each case of EUS-FNA. A final diagnosis was delivered after thorough microscopic review of all material. Percutaneous fine-needle aspiration was handled much the same as EUS-FNA, absent the ultrasound guidance and rapid interpretation. Needle biopsy, laparoscopic biopsy, and resection specimens were processed for routine gross and microscopic examination using hematoxylin-eosin. Eight cytopathologists before implementation and 5 cytopathologists after implementation reviewed and signed cytologic cases (4 overlapping both periods). On the other hand, 19 surgical pathologists reviewed and signed cases before implementation and 28 surgical pathologists after implementation of EUS-FNA; 80% of cases were signed by 8 surgical pathologists in each period, with 6 of these overlapping both periods.
To frame the impact of EUS-FNA on pathology practice, the physicians were considered as customers to the pathology practice with their respective departments and units as market segments. Because EUS-FNA is an improvement in cytologist techniques, we considered it a sustaining innovation to cytology, making cytology a disruptive innovation relative to histologic methods. (3,7) Ten years before and 10 years after implementation of EUS-FNA, the following utilization parameters were collected and compared: the number of ordering physicians (customers) and their representative units (internal market segment), total and annual average of all and each type of pancreatic specimen, diagnostic categories, and accuracy of cytologic diagnoses, using histology as the gold standard. As appropriate, [chi square] test or Student t test was used for comparison and statistical significance was considered at P < .05. Disruptiveness of cytology relative to biopsy was assessed by comparing the utilization trends and the accuracy of diagnosis over time. A substitution curve for cytology test orders relative to histology test orders was constructed as suggested by Christensen. (5)
During 20 years, a total of 2781 (242 before and 2539 after implementation) cytologic and 2338 (729 before and 1609 after implementation) histologic specimens were submitted for analysis. Fourteen physicians ordered the majority (80%) of cytologic tests before implementation of EUS-FNA, compared with 2 physicians ordering the same fraction after implementation (Pareto chart, Figure 1, A). On the other hand, 20 physicians ordered the majority (80%) of histologic tests, compared with 4 physicians ordering the same percentage after implementation (Figure 1, B). Virtually all the specimens came from 5 service units: gastroenterology, surgery, oncology, radiology, and internal medicine departments. After implementation, 92% of cytologic specimens came from gastroenterology compared with 59% before implementation (P < .001). After implementation, 94% of histologic specimens were submitted from surgery compared with 77% before implementation (P < .001). The fraction of all specimens submitted from gastroenterology increased from 16% before implementation (Figure 2, A) to 60% after implementation (Figure 2, B) (P < .001), whereas that submitted from surgery decreased from 64% before implementation (Figure 2, A), to 37% after implementation (Figure 2, B) (P < .001).
Viewed as annual trends, the total number of pancreatic specimens submitted to our laboratory increased gradually from merely 40 specimens in 1990 to 563 in 2010, with a dramatic increase after introduction of the EUS-FNA service (Figure 3). The mean annual volume (standard deviation) of cytologic specimens was 24 (12) before versus 231 (97) after implementation, 9 (6) non-EUS-FNA, 222 (102) EUS-FNA (P < .05), and that of histologic specimens was 73 (31) before versus 146 (59) after implementation (P < .05).
[FIGURE 3 OMITTED]
Unlike before implementation, more cytologic than histologic specimens were submitted after implementation of EUS-FNA (Figure 3). Gradually cytology replaced histology for the diagnosis and management decisions of pancreatic disease. Specifically, the average annual percentage (SD) of cases managed following cytology alone was 18% (10%) before versus 51% (8%) after implementation (P < .05) (Figure 4). In contrast, the percentage managed after histology alone was 56% (25%) before versus 23% (5%) after implementation (P < .05) (Figure 4). The substitution of cytology for histology was best illustrated in the Christensen substitution curve (Figure 5), which showed the log ratio of cytology percentage to histology percentage over time. Although the fitted line was not straight as suggested by Christensen, there was a trend upward, indicating continuous replacement of cytology for histology.
[FIGURE 4 OMITTED]
[FIGURE 5 OMITTED]
EUS-FNA replaced smears, brushings, and percutaneous FNAs, as well as tissue biopsy. Non-EUS FNA decreased from 36% to 1% of total cytologic pancreatic specimens (P < .05). Out of all pancreatic surgical pathology specimens, the total number of needle biopsies decreased from 7% to 1% (P < .05) and other biopsy types decreased from 29% to 9% (P < .05). Whipple procedures increased from 19% to 49% (P < .05), whereas partial resections remained essentially unchanged, 44% versus 41%.
As an example of improvement of accuracy, we assessed EUS-FNA diagnostic performance for ductal carcinoma of the pancreas using histology as a gold standard. After implementation, the unsatisfactory and indeterminate diagnoses decreased significantly: 7% before versus 1% after implementation (P < .05) for unsatisfactory, 16% before versus 4% after (P < .05) for atypical, and 16% before versus 3% after (P < .05) for suspicious diagnoses (Table 1). Additionally, more definitive cytologic diagnoses such as categorization of neoplastic and cystic diseases were observed after implementation (Table 1). The accuracy of cytologic diagnosis improved significantly; for ductal carcinoma, for example, the sensitivity (confidence interval) and specificity (confidence interval) were 54% (37%-70%) and 77% (58%-89%) before versus 88% (83%-91%) and 96% (93%-98%) after, respectively (Table 2). The diagnostic odds ratio (confidence interval) for a cytology positive for neoplasm before and after was 4.0 (1-13) and 200 (94-422) respectively (Table 2).
In this study, we demonstrate the impact of EUS-FNA on the practice of pancreatic pathology. The data presented here confirm the widely held view that EUS-FNA has practically replaced tissue biopsy and non-EUS-FNA cytology for the diagnosis of pancreatic lesions. Because EUS-FNA brought about a much-needed improvement (a sustaining innovation) in accuracy of cytologic diagnosis, it resulted in the displacement of histologic diagnosis in management of some pancreatic lesions. This process of displacement shows the characteristic 5 features of disruptive innovation as described by Christensen in his various writings (3-7) (Figure 6). (1) At onset, a disruptive innovation underperforms regarding the main performance measure. As we have seen in this study, the sensitivity and specificity of cytologic diagnosis before EUS-FNA were very low compared with those of histology (the mainstream product). (2) It introduces secondary features that are attractive to some customers. Because of convenience, simplicity, cost, and prevention of unnecessary surgeries (secondary measure of performance), cytologic diagnosis in general will always be potentially disruptive to histologic diagnosis regardless of organ site. In addition, EUS-FNA fits Christensen's description of a disruptive technology: "technically straightforward, consisting of off-the-shelf components put together in a way that was often more simple than prior approaches." (3) Endoscopic ultrasound-guided fine-needle aspiration consists of 3 technologies, each of which is disruptive in its own way: fiber-optic endoscopy was disruptive to rigid endoscopy, ultrasound to x-ray, and cytology to histology. It appeals to (3), a fringe market, but not to (4), the main users. In this study, cytology was ordered more by endoscopists than by other physicians because of convenience (while performing already planned procedures), simplicity, cost, and speed, particularly in patients who were not candidates for surgery. However, as seen in this study, the clinical decision would be compromised by the low accuracy when the specimens are smears, brushes, or aspirates, which were plagued by sampling issues and frequent lack of definitive diagnoses. Non-EUS-FNA preparations had very low sensitivity and specificity (Table 2). For these reasons, until recently the role of cytologic diagnosis in pancreatic cancer has been questioned, particularly among surgeons, listing causes such as poor performance, misinterpretation, management delay, complications, and dissemination of the disease. (12) Finally, (5), over time, disruptive technology improves on the main performance measure to become attractive to the main users and displaces the mainstream product. In this study, we showed the remarkable improvement of sensitivity and specificity of cytologic diagnosis after the introduction of EUS-FNA. This is accompanied by an increase in utilization of cytology and obviates the need for tissue biopsy in a certain set of patients, thus making EUS-FNA/cytodiagnosis a disruptive innovation (Figure 6).
[FIGURE 6 OMITTED]
To our knowledge, this is the first example of an ex post (after the fact) prediction of disruptive innovation at work in anatomic pathology. Using empirical data, Christensen showed that disruptive innovation was behind the success of new and demise of incumbent products in hundreds of examples, including patient care and the steel, computer hardware, and service industries. (3,7) Two examples he frequently cited as relevant to health care were the balloon angioplasty disrupting bypass surgery and the miniature glucose meter disrupting glucose assay in the clinical laboratory. (5) One can think of a handful of other products in pathology practice that may be good examples of such disruptive technology.
In spite of its appeal, there are many critiques, shortcomings, and challenges facing this theory. (9-11) Although Christensen has vigorously responded to this point and has published a book on "seeing what is next," (4,13) still some academics, with strong arguments, doubt the ability of the theory to produce ex ante predictions. (10) Proponents of the theory see in it a new way of strategic thinking especially useful in industries where technologic improvement is offered in excess of the consumer demand or need, such as in health care, aviation, and higher education. Detractors, on the other hand, question the generalizability of the theory, the inconsistency of the terms used, sampling methods, and the degree of disruption to firms or products in the market. Its inability to ex ante predict which products will become a "disruptive innovation in particular standouts." (9,10) A product's and the market's features may help in identifying the potentiality, but not the inevitability, of disruption. To this end, Christensen continuously asks readers to differentiate between disruptive and sustaining (radical or incremental) innovations that mean to improve products in the main dimension of performance to serve the same customers in the same market. Framed as such, a technology that automates biomarker assessment in tissue is not a disruptive innovation; neither is an imaging technology that helps cytotechnologists perform slide reading more efficiently. However, a low-cost human papilloma virus test is a disruptive innovation. To help better predict disruption, Christensen used the substitution curve in many disruptive products, such as disk drives, sportswear, and online education. (6) In this study, the EUS-FNA substitution for biopsy curve showed some trends, but it did not strictly follow a straight line as suggested by Christensen. It would be interesting to see whether many of the suggested disruptive technologies discussed in the College of American Pathologists Futurescape Forum, such as imaging, telepathology, genome-wide sequencing, and informatics, would follow the features and model suggested above.
Several limitations exist within this study. First, pathology practice was treated as a market with internal customers who could be segmented into different groups depending on the unit of service from which the specimen is ordered. Although the patients are the final customers of pathologists, it has been acceptable to treat physicians as immediate customers. To this end, the internal market in the hospital that describes how different departments and internal customers carry transactions may not follow the dynamics, preference, and constraints of a general market. Second, we treated non-EUS-FNA cytology and EUS-FNA as the same product, with the latter adding value (sustaining improvement) to the former. Additionally, we did not inquire about the indications for EUS-FNA and or tissue biopsy in detail, nor did we stratify our patients into those who had resectable versus unresectable lesions. Because the trends were tracked during a 20-year period, other factors may explain the observed trends, including changes in guidelines, pathology or clinical staff, or referral base to our medical center. Finally, the preference of EUS-FNA over biopsy may change in the future, as has happened to breast FNA, which was replaced by biopsy because of the need for tissue adequate for biomarkers and receptor assessments.
In conclusion, EUS-FNA has quantitatively and qualitatively changed the scope of pancreatic pathology practice in such a way that EUS-FNA may be considered an example of a disruptive innovation. This adds to the already known impact of EUS-FNA or EUS alone on clinical decisions and outcomes of pancreatic disease. (14,15) There is a need for more understanding of the mechanisms and processes through which new technologies, disruptive or sustaining, impact pathology practice.
(1.) College of American Pathologists. Transforming pathology: information as a disruptive technology. Futurescape of Pathology Series III; Jun 12-14, 2009; Rosemont, IL. http://www.cap.org/apps/docs/futurescape/ast_conferences.html.
(2.) Hwang J. Keynote address--the innovator's prescription: an examination of the future of health care through the lenses of disruptive innovation. Arch Pathol Lab Med. 2009; 133(4):513-520.
(3.) Christensen CM. The Innovator's Dilemma: When New Technologies Cause Great Firms to Fail. Boston, MA: Harvard Business School Press; 1997.
(4.) Christensen CM. The ongoing process of building a theory of disruption. J Prod Innov Manag. 2006; 23(1):39-55.
(5.) Christensen CM, Bohmer R, Kenagy J. Will disruptive innovations cure health care? Harv Bus Rev. 2000; 78(5):102-112, 199.
(6.) Christensen CM, Horn MB, Caldra L, Soares L. Disrupting college: how disruptive innovation can deliver quality and affordability to postsecondary education. Center for American Progress Web site. http://www.americanprogress. org/issues/2011/02/disrupting_college.html. Published February 8, 2011. Accessed July 14, 2011.
(7.) Christensen CM, Raynor ME. The Innovator's Solution: Creating and Sustaining Successful Growth. Boston, MA: Harvard Business School Press; 2003.
(8.) Yu D, Hang C-C. A reflective review of disruptive innovation theory. Int J Manag Rev. 2010; 12:435-452.
(9.) Danneels E. Disruptive technology reconsidered: a critique and research agenda. J Prod Innov Manag. 2004; 21(4):246-258.
(10.) Danneels E. From the guest editor: dialogue on the effects of disruptive technology on firms and industries. J Prod Innov Manag. 2006; 23(1):2-4.
(11.) Sood A, Tellis GJ. Demystifying disruption: a new model for understanding and predicting disruptive technologies. Mark Sci. 2011; 30(2):339-354.
(12.) Goldin SB, Bradner MW, Zervos EE, Rosemurgy AS 2nd. Assessment of pancreatic neoplasms: review of biopsy techniques. J Gastrointest Surg. 2007; 11(6):783-790.
(13.) Christensen CM, Scott A, Roth E. Seeing What Is Next. Boston, MA: Harvard Business School Press; 2004.
(14.) Queneau PE, Sauve G, Koch S, et al. The impact on clinical practice of endoscopic ultrasonography used for the diagnosis and staging of pancreatic adenocarcinoma. JOP. 2001; 2(3):98-104.
(15.) Ngamruengphong S, Li F, Zhou Y, Chak A, Cooper GS, Das A. EUS and survival in patients with pancreatic cancer: a population-based study. Gastro intest Endosc. 2010; 72(1):78-83, 83.e1-2.
Isam A. Eltoum, MD, MBA; Evans A. Alston, MD; Janie Roberson, CT(ASCP)
Accepted for publication July 15, 2011.
From the Department of Pathology, Division of Anatomic Pathology (Dr Eltoum) and the Department of Pathology (Dr Alston and Ms Roberson), University of Alabama at Birmingham.
The authors have no relevant financial interest in the products or companies described in this article.
Presented in part at the 59th Annual Scientific Meeting of the American Society of Cytopathology; November 4-8, 2011; Baltimore, Maryland.
Reprints: Isam A. Eltoum, MD, MBA, Department of Pathology, Division of Anatomic Pathology, University of Alabama at Birmingham, 1802 Sixth Ave S, Birmingham, AL 35249 (e-mail: firstname.lastname@example.org).
Table 1. Cytologic Diagnostic Category Before and After Implementation of Endoscopic Ultrasound-Guided Fine-Needle Aspiration Before (%) After (%) Unsatisfactory 15 (6.7) 16 (0.6) Benign 71 (31.9) 504 (20.8) Atypical 36 (16.2) 91 (3.7) Suspicious for carcinoma 36 (16.2) 72 (2.9) Positive for neoplasm (a) 64 (28.8) 1730 (71.6) Ductal carcinoma 64 (28.8) 1336 (77.2) Endocrine neoplasm NA 117 (6.7) Metastatic malignancy NA 53 (3) Cystic lesions NA 193 (11.1) lymphoma NA 9 (0.52) Spindle cell lesions NA 13 (0.75) SPN NA 9 (0.52) Total 222 (100) 2413 (100) Abbreviations: NA, notavailable: SPN, solid cystic pseudopapillary neoplasm. Number and percent (%) for each neoplasm listed below. Table 2. Diagnostic Performance of Cytology Before and After Implementation of Endoscopic Ultrasound-Guided Fine-Needle Aspiration Before After Sensitivity 54% (37-70%) 88% (83-91%) Specificity 77% (58-89%) 96% (93-98%) Positive likelihood ratio 2.4 (1.0-5.1) 24 (13.0-46.9) Negative likelihood ratio 0.59 (0.38-0.91) 0.12 (0.09-0.17) Diagnostic odds ratio 4.0 (1.3-12.8) 199.5 (94.1-422.7) Figure 2. Pie chart showing the frequency of ordered pancreatic (cytology and histology) tests, stratified by departments (market segment), before (A) and after (B) implementation of endoscopic ultrasound-guided fine-needle aspiration. Abbreviations: Rad, radiology; Surg, surgery; GI, gastroenterology; Onc, oncology; Med, medicine other than GI. A Surg, 64.4% GI, 16.2% Rad, 10.5% Med, 1.8% Others, 3.6% Onc, 3.6% B Surg, 37.2% GI, 60.0% Rad, 0.6% Med, 1.7% Others, 0.3% Onc, 0.2% Note: Table made from pie chart.
|Printer friendly Cite/link Email Feedback|
|Title Annotation:||Original Article|
|Author:||Eltoum, Isam A.; Alston, Evans A.; Roberson, Janie|
|Publication:||Archives of Pathology & Laboratory Medicine|
|Date:||Apr 1, 2012|
|Previous Article:||Selected common diagnostic problems in urologic pathology: perspectives from a large consult service in genitourinary pathology.|
|Next Article:||Butterfly needles reduce the incidence of nerve injury during phlebotomy.|