Printer Friendly


Byline: Eisha Mansoor, Nagin Anjum, Tahir Mahmood Butt and Mansoor Tariq


Objective: To assess effect of "specialty oriented HMS software" on "quality of EMRs".

Study Design: Comparative interventional study.

Place and Duration of Study: Obstetrics Out Patient Department (OPD) of Pak Emirates Military Hospital (PEMH) Rawalpindi and Combined Military Hospital (CMH) Lahore, from Apr 2015 to Mar 2018.

Material and Methods: The study began in 2015 with a baseline survey of quality of EMRs produced by generic HMS software in vogue. We used an observational checklist derived from hospital SOPs including 12 mandatory EMR fields. We then collaborated with IT experts to develop and implement a specialty oriented test-HMS in obstetrics OPD, PEMH. After 6 months, quality of EMRs generated by test-HMS was assessed using same method. We cross tabulated the quality of pre and post intervention EMRs. EMR quality among individual EMR fields was also compared for each software. In 2018, we assessed quality of EMRs at tertiary care hospital, a year after the official launch of customized new-HMS software in the hospital.

Results: Both the test-HMS and new-HMS had a statistically significant effect in improving quality of EMRs. A statistically significant variation was also observed among EMR quality of individual fields irrespective of the software being used.

Conclusion: Customization of HMS improves the quality of EMRs but there may be other factors effecting EMR quality besides customization of HMS. We need to Identify and address those factors to attain true benefits of HMS.

Keywords: Customization, Data quality, Electronic medical records, HMS.


Every clinical specialty has a unique work environment with peculiar functional needs. Therefore, creating a "one size fits all" Hospital Management System (HMS) fulfilling the needs of all specialties is difficult1. Non-customized soft wares are often associated with missed patient records which adversely affect the quality of EMRs limiting their use for directing clinical, research and policy decisions2,3. Software's adoption in primary care settings was satisfactory but in specialist OPDs, most of the patient records continued to be made on paper; Some part of which was later entered into HMS. Overall the degree of HMS adoption corresponded to stage "1 of 7' of the Health Information Management Systems Society (HIMSS) EMR adoption model4. During in-house discussions on HMS, doctors using generic HMS attributed the suboptimal adoption of HMS largely to lack of customization in the software.

Hence, in 2014, HMS cell at medical directorate, General Headquarters Rawalpindi decided to replace the generic software by a specialized one, better suited to the needs of the user. It was hypothesized that customization of software would significantly improve the adoption of HMS in specialist OPDs and enhance the quality EMRs5. We sought to test this hypothesis by implementing a customized test-software in Obstetrics OPD, PEMH Rawalpindi. Findings of this study hold valuable lessons to guide program implementers towards successful implementation of the new HMS in 45 military hospitals and 12 x Armed Forces Medical Institutes across the country. Since HMS is the biggest IT project of Pakistan Army, its success or failure would have huge financial implications for army alongside having an appreciable impact on hospital management and patient care.

But despite this fact, very limited scientific studies have been published on the dynamics of transition to EMRs. To the best of our knowledge, no trial has so far been conducted to test the effects of customization of HMS.


We conducted a comparative interventional trial at obstetrics OPD of PEMH Rawalpindi and CMH Lahore from April 2015 to March 2018. Baseline survey was conducted in April 2015 to evaluate the existing quality of EMRs generated using generic HMS software in vogue. For this purpose, we used 1680 EMRs of 140 women seeking antenatal care in Obstetrics OPD, PEMH Rawalpindi. Selection of women was done using systematic random technique and for each patient's record, 12 EMR fields were included. Twelve EMR fields represented the 12 steps of patient care process that every pregnant woman essentially underwent in accordance with the Hospital SOPs and were routinely recorded for every patient. These 12 fields included patient's particulars (ID), weight (wt), blood pressure (BP), presenting complaints (PC), history of present illness (HOPI), past obstetric, medical and surgical history, personal and drug history, transabdominal ultrasound (TAU) and diagnosis.

Quality of each EMR was defined in terms of its completeness and accuracy. Completeness was defined as the proportion of patient related data entered in HMS while accuracy referred to the conformance between the electronic record and the actual findings recorded on paper prior to entry in HMS6. For data collection, a structured observation checklist including above mentioned EMR fields was designed and pretested. Prospective analysis of EMRs was done by observing the patient care process of 140 women from the moment a woman confirmed her visit in obstetrics OPD to receiving consultation by the obstetrician. The quality of EMR generated at each station was documented in the observational checklist. For example at the obstetric nursing station, it was noted whether patients' BP and weight were recorded in HMS (completeness) and whether the entered values coincided with those noted on paper (accuracy).

The overall completeness and accuracy of EMRs we calculated by adding the completeness and accuracy scores of 12 fields. Once the baseline survey was completed, we collaborated with IT experts to develop and implement a specialty oriented module of HMS for obstetrics. The customized test-HMS was designed based on feedback received from all obstetricians practicing in PEMH Rawalpindi in May 2015 (n=36). Six months after implementation of test-HMS, quality of EMRs generated using test-HMS was again assessed using same tool. We employed chi square test at a significance level of 0.05 to evaluate the difference between the quality of pre and post intervention EMRs. We used Microsoft excel 2006 and SPSS version 19 for data analysis.

To verify the results of our pilot trial and to enhance generalizability, we conducted a cross-sectional assessment of EMR quality at CMH Lahore in March 2018, a year after implementation of the actual customized HMS software (new-HMS) and compared the results with the findings of our pilot project.

Table-I: Effect of test-HMS on completeness of EMRs at obstetrics OPD, MH Rawalpindi, 2015.

HMS used###EMRs Evaluated###Complete EMRs###Incomplete EMRs



Customized (test)###1680###707(42.08)###973(57.92)

Table-II: Effect of test-HMS on accuracy of EMRs at obstetrics OPD, MH Rawalpindi, 2015.

HMS used###EMRs evaluated###Accurate EMRs###Inaccurate EMRs



Customized (test)###1680###546(32.5)###1134(67.5)

Table-III: Comparison of completeness and accuracy of EMRs between BP and past obstetric history EMR fields for Generic HMS at obstetrics OPD, MH Rawalpindi, 2015.

EMR quality###EMRs###BP EMRs###P.Obs.H EMRs###p-value




Table-IV: Comparison of completeness and accuracy of EMRs between ID and TAU EMR fields for generic HMS at Obstetrics OPD, MH Rawalpindi, 2015.

EMR quality###EMRs###ID EMRs###TAUEMRs###p-value




Table-V: Comparison of completeness and accuracy of EMRs between Diagnosis and past Obstetric history EMR fields for test-HMS at obstetrics OPD, MH Rawalpindi, 2015.

EMR quality###EMRs###Diagnosis EMRs###P.Obs.H EMRs###p-value




Table-VI: Comparison of quality of EMRs generated using Generic HMS at MH Rawalpindi and new HMS, CMH Lahore, 2018.

EMR quality parameter###Generic HMS###New HMS###p-value

###(n=1680) No(%)###(n=840) No(%)




Baseline survey done on generic HMS software in 2015 showed that only 33% of patient related information was being entered in HMS with 28% being entered accurately. Introduction of customized test-HMS improved the completeness of EMRs from 33% to 42% which was statistically significant (p<0.001). Similarly, the accuracy of EMRs increased from 28% to 32% which was also statistically significant (p=0.003). Cross tabulation is shown in table-I and II. Comparison of EMR completeness and accuracy among individual HMS fields separately for generic and test HMS also found statistically significant variation. For example, comparing the EMR quality among individual fields for generic software showed that ID and BP records had a significantly better quality than that of past obstetric history (P.Obs.H) or TAU. For test-HMS as well, EMRs of diagnosis were superior in quality to that of past obstetric history (P.Obs.H) as evidenced by cross tabulation in table-III.

Comparison of quality of EMRs generated using generic HMS at PEMH Rawalpindi in 2015 with those produced by the new-HMS at CMH Lahore in 2018 showed a significant improvement in the completeness and accuracy of EMRs as shown in table-VI.


The ability of any HMS in improving patient care, research and health planning is ultimately dependent on the quality of information being generated by it7. Baseline survey done on generic HMS software in 2015 showed that only 33% of patient related information was being entered in HMS with 28% being entered accurately. Although the values improved significantly after introduction of a customized software; Yet they are still well below the target i.e. 90-95%. These values are also lower than the patient HMS attendance rates which were routinely being used to monitor the adoption of generic software at that time with values as high as 85-100%. This finding has 2 important implications. Firstly, it shows that using "attendance rates" alone to measure adoption of HMS, may overestimate the situation on ground. Therefore, inclusion of data quality parameters for appraisal of HMS adoption may be worthwhile during future implementations.

Secondly it suggests that the well accepted benefit of EMR to reduce medical errors may not be achieved in practical settings where data incompleteness and inaccuracies may continue to pose a threat; at least in the initial phases of deployment8. This puts the reliability of HMS as the sole source of patient data in military hospitals in question9. Hence till HMS is well established in military hospitals and the quality of HMS generated records has been verified, it may be appropriate to keep recording the patient information on paper as well otherwise a significant amount of patient related data may be lost. Transition to EMR in clinical settings is often characterized by incomplete adoption and has been studied extensively10. According to the available literature a number of personal, organizational, technical, financial, and legal factors determine the success of EMR adoption11. Among these, technical and individual factors (including user's inertia) play a greater role12.

Informal discussion with various stakeholders during the conduct of this study revealed some of these factors relevant to our setting as well. For example, the users were not confident with the training which was offered to them for using the new software which ranged from no training at all to a maximum of 3 days of classroom teaching/demonstration. User training is recognized as a vital element in successful EMR adoption13. Investing in the training of users including simulation training and introduction of EMR in standard medical education curricula may prove beneficial14,15. Successful EMR training models like Benner's novice to expert model and Lowe's five key principles may be refereed to for developing effective teaching methodology in this regard16. Another factor hindering the desired use of HMS despite provision of the demanded software amendments could be the enormous patient workload in our OPDs which is known to correlate negatively with EMR adoption17.

Offering incentives has also shown promise for boosting EMR adoption18. The difference between the completeness and accuracy of individual HMS fields also gives some idea about additional factors affecting HMS adoption in our OPDs. Some variables for ins-tance patient ID, weight, blood pressure and diagnosis etc were being recorded with significantly higher accuracy and completeness irrespective of the software used. This implies that other factors were also in play effecting the quality of data besides the type of software being used. For example "who" entered that data could make a difference. In our study, patient ID was being entered by staff dedicated and trained for this purpose and showed significantly better quality. Also, weight and blood pressure was entered by an obstetric nurse whose sole task was to record weight and blood pressure and again showed a better quality. Hence, the quality of records can improve if dedicated and trained data entry operators are involved.

The financial impact of such an intervention would however need to be taken in account. Also, the obstetricians were more likely to record presenting complaints and diagnosis compared to other variables like past obstetric history which was otherwise recorded very carefully in paper records. Discussion with obstetricians revealed that filling presenting complaints' and diagnosis' fields was a mandatory requirement by the software and record would not close until the mandatory fields were filled. So, making alterations in the software which necessitate a minimum level of information to be entered can potentially improve data quality.


The results of this study help predict the outcome of the newer version of HMS which is expected to be launched in 45 military hospitals and 12 x Armed Forces Medical Institutes across the country from 2018 to 2020. Replacing HMS software alone cannot be expected to have a significant impact. There is a need for focused research to understand the practical barriers to HMS implementation in military hospitals. Successful adoption of HMS relies on devising evidence based strategies to overcome those barriers and allocating substantial resources (time, money and manpower) to accomplish those strategies. A small proportion of capital if allocated to these complimentary measures, may have a tremendous impact on enhancing the utilization of huge investments already made on the HMS project.


Mr Shakeel Akhtar - (Head of HMS software design team at HMS Cell) for his patience, co-operation and technical assistance in design and implementation of test-HMS software. Miss Rukhsana - (Receptionist and HMS entry operator at Obstetrics OPD, PEMH Rawalpindi) for her cooperation in data collection and entry.

Funding Source

Software (test HMS and new HMS) design and implementation funded by HMS Cell, Medical directorate, GHQ, Rawalpindi.


This study has no conflict of interest to declare by any author.


1. Heisey-Grove D, Danehy LN, Consolazio M, Lynch K, Mostashari F. A national study of challenges to electronic health record adoption and meaningful use. Med Care 2014; 52(2): 144-8.

2. Maekawa Y, Majima Y. Issues to be improved after introduction of a non-customized Electronic Medical Record system (EMR) in a Private General Hospital and efforts toward improvement. Stud Health Technol Inform 2006; 122: 919-20.

3. Johnson SG, Speedie S, Simon G, Kumar V, Westra BL. A data quality ontology for the secondary use of EHR data. AMIA Annu Symp Proc 2015; 2015: 1937-46.

4. Roth CJ, Lannum LM, Dennison DK, Towbin AJ. The current state and path forward for enterprise image viewing: HIMSS-SIIM collaborative white paper. J Digit Imaging 2016; 29(5): 567-73.

5. Martin DB, Kaemingk D, Frieze D, Hendrie P, Payne TH. Safe implementation of computerized provider order entry for adult oncology. Appl Clin Inform 2015; 6(4): 638-49.

6. Dixon BE, Siegel JA, Oemig TV. Electronic health information quality challenges and interventions to improve public health surveillance data and practice. Public Health Rep 2013; 128(6): 546-53.

7. Rothman B, Leonard JC, Vigoda MM. Future of electronic health records: implications for decision support. Mt Sinai J Med 2012; 79(6): 757-68.

8. Bayley KB, Belnap T, Savitz L, Masica AL, Shah N, Fleming NS. Challenges in using electronic health record data for CER: Experience of 4 learning organizations and solutions applied. Med Care 2013; 51(8 Suppl-3): S80-6.

9. Wylie MC, Baier RR, Gardner RL. Perceptions of electronic health record implementation: A statewide survey of physicians in Rhode Island. Am J Med Sci 2014; 127(10): 1010.

10. Pare G, Raymond L, de Guinea AO, Poba-Nzaou P, Trudel MC, Marsan J, et al. Barriers to organizational adoption of EMR systems in family physician practices: A mixed-methods study in Canada. Int J Med Inform 2014; 83(8): 548-58.

11. Amatayakul M. EHR? Assess readiness first. Health care financial management. Healthc Financ Manage 2005; 59(5): 112-3.

12. Pantaleoni JL, Stevens LA, Mailes ES, Goad BA, Longhurst CA. Successful physician training program for large scale EMR implementation. Appl Clin Inform 2015; 6(1): 80-95.

13. Vuk J, Anders ME, Mercado CC, Kennedy RL. Impact of simulation training on self-efficacy of outpatient health care providers to use electronic health records. Intl J Med Inform 2015; 84(6): 423-9.

14. Goveia J, Van Stiphout F, Cheung Z, Kamta B, Keijsers C, Valk G, et al. Educational interventions to improve the meaningful use of electronic health records: A review of the literature: BEME Guide No. 29. Med Teach 2013; 35(11): e1551-60.

15. Wald HS, George P, Reis SP. Electronic health record training in undergraduate medical education: bridging theory to practice with curricula for empowering patient and relationship-centered care in the computerized setting. Acad Med 2014; 89(3): 380-6.

16. Raghavan VV, Chinta R, Zhirkin N. Macro influencers of electronic health records adoption. Int J Electron Health 2015; 8(1): 76-94.

17. Mazur LM, Mosaly PR, Moore C, Comitz E, Yu F, Falchook AD, et al. Toward a better understanding of task demands, work-load, and performance during physician-computer interactions. J Am Med Inform Assoc 2016; 23(6): 1113-20.

18. Jacob JA. Financial incentives are spurring growth of electronic health records. BMJ 2013; 347: f4901.
COPYRIGHT 2018 Asianet-Pakistan
No portion of this article can be reproduced without the express written permission from the copyright holder.
Copyright 2018 Gale, Cengage Learning. All rights reserved.

Article Details
Printer friendly Cite/link Email Feedback
Publication:Pakistan Armed Forces Medical Journal
Article Type:Survey
Geographic Code:9PAKI
Date:Oct 31, 2018

Terms of use | Privacy policy | Copyright © 2022 Farlex, Inc. | Feedback | For webmasters |