Printer Friendly

Evaluating the impact of scenario-based high-fidelity patient simulation on academic metrics of student success.

RESEARCH

ABSTRACT

Despite the ongoing nursing shortage, nurse educators are responsible for preparing students to practice in highly complex health care systems. As nurse educators explore new learning strategies to support an increase in student admissions, they must also evaluate the impact of these strategies on the quality of the educational experience. The study reported here evaluated the impact of scenario-based, high-fidelity patient simulation used to increase student admissions in an associate degree and baccalaureate nursing program in north-central Texas upon students' sense of their own clinical competence, graduating grade point average (GPA GPA
abbr.
grade point average

Noun 1. GPA - a measure of a student's academic achievement at a college or university; calculated by dividing the total number of grade points received by the total number attempted
), and performance on standardized exit examinations. These are measures commonly used by nurse educators as metrics metrics Managed care A popular term for standards by which the quality of a product, service, or outcome of a particular form of Pt management is evaluated. See TQM.  of success.

Key Words High-Fidelity Patient Simulation--Academic Metrics Nursing Students--Clinical Educators

**********

JOINING FORCES, a school of nursing in a liberal arts liberal arts, term originally used to designate the arts or studies suited to freemen. It was applied in the Middle Ages to seven branches of learning, the trivium of grammar, logic, and rhetoric, and the quadrivium of arithmetic, geometry, astronomy, and music.  university in north-central Texas, a nearby community college nursing program, and a 359-bed regional medical center obtained a Texas Higher Education Coordinating Board The Texas Higher Education Coordinating Board is an agency of the Texas state government that oversees all public post-secondary education in Texas.

From 1998 to 2003, it developed a new higher-education plan for the state, called "Closing the Gaps by 2015".
 (THECB THECB Texas Higher Education Coordinating Board ) grant in 2004 for the purpose of developing a Regional Simulation Center (RSC). The primary goal was to increase by 39 percent the total number of students admitted to both entry-level nursing programs. To enable faculty to pursue other activities, including teaching additional students, scenario-based practice with high-fidelity manikins took the place of traditional, hospital-based clinical education with actual patients. Responsibilities for competency education and validation were delegated to four clinically strong, baccalaureate-prepared, laboratory mentors (Sportsman et al., 2009).

When the RSC was established, the Texas Board of Nursing (TBON TBON Tennessee Board of Nursing ) had no regulations regarding the substitution of clinical simulation for traditional clinical experience. However, it did require that nurse faculty hold a master's degree or higher. Because this project used BSN-prepared laboratory mentors in the simulation center, the project director requested and received a waiver The voluntary surrender of a known right; conduct supporting an inference that a particular right has been relinquished.

The term waiver is used in many legal contexts.
 to that rule. Based on the evaluation of the three-year project, reported annually, the TBON in 2008 made the decision to remain silent on limitations to the number of hours Texas students can participate in simulation as part of their clinical experience.

This article reports on the evaluation for the grant as reported to the TBON. The purpose was to determine if participation in scenario-based, high-fidelity patient simulation in the RSC for a portion of the clinical experience traditionally supervised by faculty would influence student outcomes. The research questions for this descriptive, longitudinal study longitudinal study

a chronological study in epidemiology which attempts to establish a relationship between an antecedent cause and a subsequent effect. See also cohort study.
 focused on several areas: students' sense of their own clinical competence; anxiety regarding school performance; attitudes about and interest in learning opportunities; motivation to learn; concentration during learning activities; and satisfaction with the clinical learning environment. Finally, the study evaluated the impact on seniors' graduating grade point average (GPA) and scores on a standardized exit examination.

Literature Review A report by del Bueno (2005) suggested that only 35 percent of new graduates meet entry expectations for clinical judgment when evaluated by the Problem Based Development System (PBDS PBDS Parti Bangsa Dayak Sarawak (Malaysia)
PBDS Performance Based Development System
PBDS Post Boost Detection System
PBDS Professional and Broadcast Digital Systems (London, UK) 
), which uses video simulation to assess nurses' competence. According to according to
prep.
1. As stated or indicated by; on the authority of: according to historians.

2. In keeping with: according to instructions.

3.
 del Bueno, a major cause of this failure is the emphasis in nursing programs on teaching greater amounts of content, rather than the application of knowledge. Assuming del Bueno's findings are correct, providing greater opportunity to apply clinical knowledge through the use of high-fidelity patient simulators (HFPS HFPS Hay Fever Prevention Society
HFPS Home Fallout Protection Survey
) may lead to greater competence among new graduates as reflected in traditional academic markers.

Multiple benefits of patient simulation have been identified in the literature, including: a) the ability to administer care to high-acuity, low-frequency cases, using actual clinical equipment without the potential to harm patients; b) skill development in procedures that require eye-hand coordination and ambidextrous ambidextrous /am·bi·dex·trous/ (am?bi-dek´strus) able to use either hand with equal dexterity.

am·bi·dex·trous
adj.
Able to use both hands with equal facility.
 maneuvers; c) the enhancement of confidence; and d) improved decision-making, teamwork, and communication in times of crisis (Jha, Duncan, & Bates Bates   , Katherine Lee 1859-1929.

American educator and writer best known for her poem "America the Beautiful," written in 1893 and revised in 1904 and 1911.
, 2001; Medley med·ley  
n. pl. med·leys
1. An often jumbled assortment; a mixture: "That night he dreamed he was traveling in a foreign country, only it seemed to be a medley of all the countries he'd ever been to and
 & Home, 2005; Patow, 2005). A number of researchers have used randomized ran·dom·ize  
tr.v. ran·dom·ized, ran·dom·iz·ing, ran·dom·iz·es
To make random in arrangement, especially in order to control the variables in an experiment.
 controlled trials to determine if learners who train with simulators demonstrate greater knowledge and competence in the skill(s) being presented compared to learners using more traditional educational processes (Grantcharov et al., 2004; Steadman et al., 2006). In general, researchers have found that the use of simulation, particularly HFPS, provides learning outcomes that are at least as good, and perhaps better, than other learning methodologies, including practice in an actual patient situation.

Issenberg, McGaghie, Petrusa, Gordon, and Scalese (2005) reviewed and synthesized syn·the·sized  
adj.
1. Relating to or being an instrument whose sound is modified or augmented by a synthesizer.

2. Relating to or being compositions or a composition performed on synthesizers or synthesized instruments.
 existing evidence in 109 studies from five literature databases to answer the question, "What are the features and uses of high-fidelity medical simulations that lead to most effective learning?" They found that published research, while generally weak, suggested that such simulations facilitate learning under the right conditions (providing feedback, repetitive practice, integration of simulation into curricula, a range of levels of difficulty, multiple learning strategies, controlled environment, individualized in·di·vid·u·al·ize  
tr.v. in·di·vid·u·al·ized, in·di·vid·u·al·iz·ing, in·di·vid·u·al·iz·es
1. To give individuality to.

2. To consider or treat individually; particularize.

3.
 learning, defined outcomes, and simulator (1) Software that enables the execution of an application written for a different computer environment. Same as emulator.

(2) Software that models the interactions of hypothetical or real-world objects or business processes.
 validity). Issenberg et al. concluded that while research regarding simulation in medical education needed improvement in terms of rigor rigor /rig·or/ (rig´er) [L.] chill; rigidity.

rigor mor´tis  the stiffening of a dead body accompanying depletion of adenosine triphosphate in the muscle fibers.
 and quality, high-fidelity simulations are educationally effective and simulation-based education complements other forms of education.

Weaver (2011) analyzed an·a·lyze  
tr.v. an·a·lyzed, an·a·lyz·ing, an·a·lyz·es
1. To examine methodically by separating into parts and studying their interrelations.

2. Chemistry To make a chemical analysis of.

3.
 studies published since 1998 on the use of HFPS in undergraduate nursing education. The review found that this teaching-learning strategy benefits students in the areas of knowledge, value, realism, and learner satisfaction. Specifically, it was found that the hands-on learning and "real" decision-making implemented across the nursing curriculum add value to nursing curricula. Findings were mixed in terms of student confidence, transfer of knowledge, and stress reduction.

Despite the weakness of evaluative research, nurse educators have continued to use scenarios programmed for high-fidelity patient simulators as a substitution for clinical supervision in care settings to address limited clinical opportunities. Nehring and Lashley (2004) confirmed the increased use of HFPS through a survey of nursing programs in 18 universities and 16 community colleges. Their survey explored curricular use, faculty time and use, student opinions, evaluation, and other uses of HFPS in research and continuing education continuing education: see adult education.
continuing education
 or adult education

Any form of learning provided for adults. In the U.S. the University of Wisconsin was the first academic institution to offer such programs (1904).
. It was found that community colleges used simulation more frequently than universities, and simulation was most often used to teach physical assessment and critical instances. A slight majority of the sample used this teaching-learning experience as part of required clinical experiences.

Recent attempts to determine the impact of the use of HFPS on nursing student performance have been inconclusive INCONCLUSIVE. What does not put an end to a thing. Inconclusive presumptions are those which may be overcome by opposing proof; for example, the law presumes that he who possesses personal property is the owner of it, but evidence is allowed to contradict this presumption, and show who is . A 2007 pilot study by Radhakrishnan, Roche, and Cunningham identified nursing clinical practice parameters influenced by simulation by evaluating the clinical performance of 12 senior second-degree BSN BSN
abbr.
Bachelor of Science in Nursing
 students in a complex two-patient, simulated assignment. They found that students who participated in patient simulation, in addition to their usual clinical training, had significantly higher scores than the group that only participated in usual clinical training on patient identification and on assessing vital signs. The remainder of their clinical performance was not significantly different from that of the control group.

The Regional Simulation Center Experience The RSC, located in a 3,410 square foot renovated nursing unit at the hospital partner, was equipped with six Laerdal SimMan[TM] high-fidelity patient simulators (four adult and two infant/child manikins) and sufficient equipment to provide nursing care in a variety of scenarios. Faculty developed learning objectives for scenarios consistent with course objectives and worked with the lab mentors to develop realistic patient care scenarios.

The amount of clinical time (CT) students spent in the center varied, depending on the clinical objectives of the course. Courses in which students were assigned to the RSC included health assessment (100

percent of CT), fundamentals (50 percent of CT), two medical-surgical courses (each, 25 percent of CT), childbearing families (8 percent of CT), pediatrics (13 percent of CT), and the final capstone course (20 percent of CT). Students were not assigned to the RSC during their psychiatric psy·chi·at·ric
adj.
Of or relating to psychiatry.


psychiatric adjective Pertaining to psychiatry, mental disorders
 experience or, in the case of BSN students, their community health clinical experience. Initially, faculty for first-year courses developed the majority of the simulation scenarios. As the project progressed and faculty and lab mentors increased their expertise, participation in simulation was included in a number of senior-level courses.

Over the three years of the project, both nursing programs, as well as the partner hospital, used the RSC for competency education/validation. In fact, the center posted more than 20,000 visits during the 34 months of the grant. BSN students represented 80 percent of the total visits; ADN ADN Anchorage Daily News (Alaska newspaper)
ADN Yemen (international vehicle registration)
ADN Ácido Desoxirribonucleico
ADN Acide Désoxyribonucléique (French: DNA) 
 students, 14 percent; and learners from the hospital, 6 percent. In addition, the number of students admitted to both nursing programs exceeded the goal set in the grant. As positive as those outcomes were, they provided no information regarding the impact of participation in scenario-based HFPS upon the metrics for student success used by academia.

The Evaluation THEORETICAL FRAMEWORK When identifying metrics of success for nursing graduates, variables that influence success must be considered. The Baramee and Blegen (2003) model was used as a theoretical framework for all of the research related to the project, including the research reported here. Baramee and Blegen studied variables that influenced graduating grade point average (GPA) and the perception of clinical competence among 885 students graduating from BSN programs in Thailand. Variables believed to influence GPA and sense of clinical competence were categorized cat·e·go·rize  
tr.v. cat·e·go·rized, cat·e·go·riz·ing, cat·e·go·riz·es
To put into a category or categories; classify.



cat
 into input variables (student background/characteristics, school/faculty characteristics) and process variables (use of learning strategies identified in the Learning and Study Skills Inventory [LASSI], e.g., anxiety, motivation, attitude).

Baramee and Blegen (2003) concluded that five variables produced a viable model to explain students' perceptions of their own clinical competence: perception of one's own hardiness, effort in studies, clinical learning environment, student-faculty relationship, and graduating GPA. Path analysis indicated that perception of one's own efforts, clinical learning environment, and graduation GPA had direct effects on students' perceptions of clinical competence. Sense of one's own hardiness had an indirect effect on perceptions of clinical competence through its impact on students' perceptions of their efforts, clinical learning environment, and student-faculty relationship.

DATA COLLECTION INSTRUMENTS Data were collected on outcome variables, such as scores on a standardized exit examination and GPA, students' perceptions of their clinical competence, and process variables, such as anxiety regarding school performance, attitudes about and interest in learning opportunities, motivation to learn, concentration during learning activities, and satisfaction with the clinical learning environment. Four data collection instruments, including a demographic data sheet, were used: the Clinical Competence Appraisal Scale (CCAS CCAS Center for Contemporary Arab Studies
CCAS Cape Canaveral Air Station
CCAS Convention for the Conservation of Antarctic Seals
CCAS Consumer Codes Approval Scheme
CCAS Cross Country Automotive Services
), four subscales from the Learning and Study Skills Inventory (LASSI), and the Clinical Learning Environment Scale (CLE Cle

total elimination clearance.
). Exit examination scores and graduating GPA were used to quantitatively answer the research questions. The data collection instruments are described in Table I on following page.

DATA COLLECTION PROCESS Following approval by the university Human Subjects Review Committee and the opening of the RSC in January 2005, quantitative data were collected in January 2005, 2006, and 2007 from the baccalaureate (BSN) and associate degree (ADN) nursing students (juniors) who had successfully completed their Fundamentals course the previous fall. Data were also collected in April 2005, 2006, and 2007 from the BSN and ADN students (seniors) who were expected to graduate each May. The number of respondents during the six data collection periods totaled 895.

As student cohorts progressed through their course of study over the 34 months of the grant, each group had increasingly more experience in the RSC. For example, 2005 seniors had little or no experience in the RSC prior to data collection at the end of their course of study. In contrast, the 2006 seniors had three semesters of RSC experience before graduation, and the 2007 seniors had up to five semesters. Table 2 (on following page) illustrates the amount of simulation experienced by each cohort cohort /co·hort/ (ko´hort)
1. in epidemiology, a group of individuals sharing a common characteristic and observed over time in the group.

2.
 before data were collected in their junior and senior years.

The standardized exit examination scores for BSN and ADN seniors (2006 and 2007) were collected from each school during the summer of 2007. Scores for the 2005 seniors were not collected; the reporting mechanism for the examination changed between 2005 and 2006, making comparison difficult. Investigators also collected graduating GPA from student transcripts in the summer of 2007.

DATA ANALYSIS Student responses were compared across the 34 months of the grant to evaluate the impact of participation in scenario-based simulation on identified student metrics of academic Success.

Results DEMOGRAPHIC DATA Females accounted for 85 percent of the sample. Sixty-three percent of the total respondents in both schools were between 19 and 29 years old; 25 percent were 30 to 39 years old; 10 percent were in their 40s; and 2 percent were age 50 or older. Slightly less than half had health care experience prior to entering their nursing program. The type of health care experience was not explicitly defined, but anecdotally it was known that respondents had professional experience as licensed practical/vocational nurses or as unlicensed assistive personnel. This variation in the definition of health care experiences may be a limiting factor A factor or condition that, either temporarily or permanently, impedes mission accomplishment. Illustrative examples are transportation network deficiencies, lack of in-place facilities, malpositioned forces or materiel, extreme climatic conditions, distance, transit or overflight rights,  in this research.

FINDINGS FOR RESEARCH QUESTION 1: What is the impact of participation in scenario-based simulation upon students' sense of their own clinical competence, their anxiety regarding school performance, attitude about and interest in learning opportunities, motivation to learn, concentration during learning activities, and satisfaction with the clinical learning environment? The combined data for both nursing programs were compared by year to assess the impact of participation in scenario-based simulation. The amount of simulation the student groups received increased each year of the grant. Table 2 illustrates this increase by semester se·mes·ter  
n.
One of two divisions of 15 to 18 weeks each of an academic year.



[German, from Latin (cursus) s
 of the project for each group.

Junior Responses Mean scores on the Psychomotor psychomotor /psy·cho·mo·tor/ (si?ko-mo´ter) pertaining to motor effects of cerebral or psychic activity.

psy·cho·mo·tor
adj.
1.
 Skills Performance subscale (PSP (PlayStation Portable) See PlayStation. ) of the CCAS were compared by year, without consideration for the type of nursing program. Mean scores dropped over the three years of the study, from 44.41 to 40.71. Juniors in 2005, who had no simulation experience before completing the CCAS, rated their competence in psychomotor skills performance significantly higher (n = 482, f = 15.616, p = .0001) than 2006 and 2007 juniors, who had already participated in simulation.

Senior Responses Senior responses on all subscales of the CCAS, four subscales of the LASSI, and the CLE were compared for the three years of the grant. There was no significant difference in the mean score of the PSP or three CCAS subscales (Teaching/Collaboration, Planning/ Evaluation, Interpersonal in·ter·per·son·al  
adj.
1. Of or relating to the interactions between individuals: interpersonal skills.

2.
 Relations/Communications) among the three groups of seniors. The only CCAS subscale for which there was a significant difference (n = 308, f = 8.723, p = .0001) was Leadership.

For the LASSI, the mean scores on the Attitude, Concentration, and Motivation subscales remained essentially the same over time. The mean score of the Anxiety subscale for 2005 seniors was significantly higher, indicating lower anxiety, than for 2006 and 2007 seniors (n = 327, f = 4.249, p = .015). The mean scores on the CLE for 2005 seniors were significantly lower (n = 339, f = 7.633, p = .001) than for 2006 and 2007 seniors.

FINDINGS FOR RESEARCH QUESTION 2: What is the impact of participation in scenario-based simulation upon seniors' graduating grade point average and scores on the standardized exit examination? The mean scores on the standardized test, as well as the mean graduating GPA, of the three years of seniors were compared. No significant differences were found in either graduating GPA or test scores for these students.

Discussion Two findings from this study had the greatest impact on the organization of clinical experience for nursing students. First, despite the level of simulation the group experienced, there was no significant difference in mean exit examination scores between 2006 and 2007 seniors when the two types of programs were compared. Results of this examination have been correlated cor·re·late  
v. cor·re·lat·ed, cor·re·lat·ing, cor·re·lates

v.tr.
1. To put or bring into causal, complementary, parallel, or reciprocal relation.

2.
 with success on the NCLEX-RN NCLEX-RN National Council Licensure Exam for Registered Nurses  licensing exam (Lauchner, Newman, & Britt britt  
n.
Variant of brit.

Noun 1. britt - the young of a herring or sprat or similar fish
brit

young fish - a fish that is young

2.
, 2006). Similarly, for the three groups of seniors from both schools, there was no significant difference in mean scores for the CCAS Psychomotor Skills Performance, Teaching/Collaboration, Planning/Evaluation, or Interpersonal Relations/Communication subscales. Therefore, the substitution of scenario-based HFPS for time spent in clinical agencies (ranging from 8 percent, Childbearing Families, to 100 percent, Health Assessment) did not negatively affect performance on the standardized exit examination. Nor did it make a difference in seniors' perceptions of their own clinical competence. Both of these findings argue for the substitution of simulation experience for some traditional clinical experiences as a strategy for increasing student admissions when there are limited clinical experiences available to schools.

The significant difference in the mean scores on the PSP subscale for 2005 juniors compared to 2006 and 2007 juniors suggests that simulation early in students' clinical courses may give students a chance to implement psychomotor skills in a dynamic, simulated clinical situation. This is far different from performing a skill correctly in a static situation. The internal and external feedback that students receive in the simulation may provide a glimpse of their actual clinical skill, thereby reducing their perception of competence on psychomotor skills. By participating in simulated patient A simulated patient or standardized patient (SP) (also known as a patient instructor), in health care, is an individual who is trained to act as a real patient in order to simulate a set of symptoms or problems.  events in a safe environment, students may recognize the limits of their competence and the implications for patient safety. This could provide an impetus for greater commitment to learning for these students.

Differences were also found among the mean responses of seniors to one component of the CCAS. Seniors who had little or no experience in simulation perceived themselves to be less competent in leadership skills than those seniors who had participated in simulation throughout their course of study. During the teaching scenarios, small groups of students worked together to provide care, playing various roles including charge nurse, recorder, family member, and/or primary nurse. Perhaps this opportunity to role play enhanced their sense of their competence in leadership activities.

The anxiety of 2005 seniors, who had participated in little or no simulation, was significantly lower than that of 2006 and 2007 seniors. While investigators hoped that participation in simulation of high-risk patient situations would increase students' sense of competence, thereby reducing their anxiety, these experiences seemed to increase their anxiety. While this was not the desired outcome, the greater anxiety level may serve as a motivating influence as new graduates begin to practice.

The anxiety subscale of the LASSI was designed to assess respondents' sense of their anxiety in relation to current learning opportunities. The instrument does not adequately discriminate dis·crim·i·nate  
v. dis·crim·i·nat·ed, dis·crim·i·nat·ing, dis·crim·i·nates

v.intr.
1.
a.
 between anxiety related to educational experiences in the classroom and anxiety related to their clinical experiences. In addition, the respondents' general anxiety level was not evaluated. This is a limitation of the study. It is important to note that the evaluation of students in the scenario-based simulation was formative formative /for·ma·tive/ (for´mah-tiv) concerned in the origination and development of an organism, part, or tissue. , rather than summative Adj. 1. summative - of or relating to a summation or produced by summation
summational

additive - characterized or produced by addition; "an additive process"
; the students did not receive a grade for each simulation. As a result, anxiety related to simulation grades was not a factor in the students' course evaluations.

Despite the elevated sense of anxiety in the 2006 and 2007 graduating seniors who had participated in simulations, the mean scores on the CLE for these students were significantly higher than the mean scores for the 2005 seniors. This suggests that simulation may positively influence students' perceptions of the clinical environment where they were assigned during the last semester of their course of study.

Several factors limit the generalizability of the study findings. The study was implemented in a RSC developed in partnership with a university, community college, and hospital, and located in a renovated nursing unit. Student experiences were directly supervised by BSN-prepared, nonfaculty lab mentors. While both of these characteristics positively influenced the success of the center, there are few centers in the United States United States, officially United States of America, republic (2005 est. pop. 295,734,000), 3,539,227 sq mi (9,166,598 sq km), North America. The United States is the world's third largest country in population and the fourth largest country in area.  with a similar organizational structure. This may reduce the external validity External validity is a form of experimental validity.[1] An experiment is said to possess external validity if the experiment’s results hold across different experimental settings, procedures and participants.  of the study.

There were also threats to internal validity Internal validity is a form of experimental validity [1]. An experiment is said to possess internal validity if it properly demonstrates a causal relation between two variables [2] [3]. . All students enrolled in both types of programs over the three years participated in the study. Juniors and seniors participating in the 2005 data collection were used as a control group because of their limited participation in simulation at that time. However, over the course of the three-year study, the operation of the RSC improved and the staff gained in expertise in developing scenario-based simulations. Thus, the student experience in 2006 and 2007 may be very different beyond the difference in the number of semesters in which students participated in simulation activities. For example, by the third year of the grant, the simulation scenarios were far more complex and the processes for managing the scenarios were more developed than in the first or second year. Similarly, other factors unrelated to the simulation center, including changes in faculty members and clinical agencies, may have affected student experience over time.

Recommendations for Further Study Because of threats to internal and external validity, this study should be replicated using random assignment and a control group that does not participate in the simulation experience. In addition, specific findings should be evaluated in more depth. For example, graduating seniors who participated in simulation activities were more anxious, as measured by the LASSI, than those who had not participated. A more thorough evaluation of the level of student anxiety throughout the course of study should be done to determine if participation in simulation, among all the stressors of nursing school, was the cause of the anxiety. A more sensitive instrument to measure both state and trait trait (trat)
1. any genetically determined characteristic; also, the condition prevailing in the heterozygous state of a recessive disorder, as the sickle cell trait.

2. a distinctive behavior pattern.
 anxiety is strongly recommended.

The BSN students as an aggregate were assigned to the RSC far more than the ADN students were. The impact of the specific hours individual students frequently spent in the RSC upon their sense of competence and anxiety should be considered. Finally, this study explored the relationship between participation in simulation and scores on a standardized exit examination. This correlation should be extended to include NCLEX-RN scores.

In this study, scenario-based HFPS was delivered by BSN-prepared lab mentors. Although this is an excellent model for providing simulation to large numbers of students, maximizing the use of master's and doctorally prepared faculty for other teaching or scholarly activities, faculty members do monitor the simulation experience in most nursing programs. The difference in outcomes, if any, of these two approaches should be explored.

The study evaluated the impact of participation in scenario-based high-fidelity patient simulation upon students' perceptions of clinical competence. The impact of participation in HFPS on clinical competence, as evaluated by faculty and/or practicing nurses, should also be determined. In addition, while there is evidence from other research that participation in scenario-based HFPS is equally or more effective in supporting learning than other teaching methods, there is no evidence that this improved learning has an impact on the delivery of patient care. The impact of participation on patient safety needs evaluation.

As the use of HFPS grows in nursing education, this study provides initial evidence of its impact on the academic success of ADN and BSN students in north-central Texas. The findings point to the need for additional research as simulation becomes an integral component of many nursing students' experience.

About the Authors Susan Sportsman, PhD, RN, ANEF, was dean of the College of Health Sciences and Human Services, and Minnie Rhea rhea, in zoology
rhea (rē`ə), common name for a South American bird of the family Rheidae, which is related to the ostrich. Weighing from 44 to 55 lb (20–25 kg) and standing up to 60 in.
 Wood Professor of Nursing, Midwestern State University Midwestern State University is a public liberal arts college in Texas and is a member of the Council of Public Liberal Arts Colleges. Located in Wichita Falls, Texas, the university has a current enrollment of approximately 6,500 students. , Wichita Falls, Texas Wichita Falls is a city in Wichita County, Texas, United States. As of the 2000 census, the city had a total population of 104,197. It is the principal city of the Wichita Falls Metropolitan Statistical Area, which encompasses all of Archer, Clay and Wichita counties. , when this study was conducted. She will assume the position of consultant at Elsevier on August 15, 201 I. Randall E. Schumacker, PhD, is a professor in the College of Education, University of Alabama, Tuscaloosa. Patti Hamilton, PhD, RN, is dean of graduate studies, Midwestern State University. For more information, contact Dr. Sportsman at susan.sportsman@mwsu.edu.

References

Baramee, J., & Blegen, M. (2003). New graduate perception of clinical competence: Testing a causal model A causal model is an abstract model that uses cause and effect logic to describe the behaviour of a system. See also
[IMG][1]]
  • Bayesian network
  • Causal loop diagram
  • Systems biology
  • Econometrics
  • Forecasting
. International Journal of Nursing Studies, 40, 389-399.

del Bueno, D.A. (2005). Crisis in critical thinking. Nursing Education Perspectives, 26(5), 278-282. doi: 10.1043/1536-5026(2005)026[0278:ACICT]2.0.CO;2

Dunn, S., & Burnett, P. (1995). The development of a clinical learning environment scale. Journal of Advanced Nursing, 22, 1166-1173.

Grantcharov, T. P., Kristiansen, V. B., Bendix, J, Bardram, L., Rosenberg, J., & Funch-Jensen, P. (2004). Randomized clinical trial randomized clinical trial,
n a clinical study where volunteer participants with comparable characteristics are randomly assigned to different test groups to compare the efficacy of therapies.
 of virtual reality simulation for laparoscopic skills training. British Journal of Surgery The BJS (British Journal of Surgery) is a monthly peer reviewed publication targeting general surgeons and the associated sub specialities. At 3.722 it has the highest impact factor of any surgical journal published in the UK. , 91 (2), 146-150. doi: 10.1002/bjs.4407

Issenberg, S. B., McGaghie,W. C., Petrusa, E. R., Gordon, D. L., & Scalese, R.J. (2005). Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME BEME Best Evidence Medical Education  systemic review. Medical Teacher, 27(1), 10-28. doi: 101080/0/4215905000046924

Jha, A., Duncan, B., & Bates, D. (2001). Simulator-based training and patient safety. In Making health care safer: A critical analysis of patient safety practices (pp. 510-517). (Evidence Report/Technology Assessment: Number 43). Rockville, MD: Agency for Healthcare Research and Quality Agency for Healthcare Research and Quality,
n.pr formerly known as the Agency for Health Care Policy and Research, this agency researches the quality of medical care and health services.
 

Lauchner, K., Newman, M., & Britt, R. (2006). Predicting licensure licensure
(lī´snsh
 success with a computerized comprehensive nursing exam: The HESI HESI High Energy Solar Imager  exit exam. CIN CIN cervical intraepithelial neoplasia.
Cervical intraepithelial neoplasia (CIN)
A term used to categorize degrees of dysplasia arising in the epithelium, or outer layer, of the cervix.
: Computers, Informatics Same as information technology and information systems. The term is more widely used in Europe. , Nursing, 24 (Suppl 3), 4S-9S.

Medley, C., &Horne, C. (2005). Using simulation technology for undergraduate nursing education. Journal of Nursing Education, 44(I), 31-34.

Morrison, S., Adamson, C., Nibert, A., & Hsia, S. (2004). HESI exams:An overview of reliability and validity. CIN" Computers, Informatics, Nursing, 22(4), 220-226.

Nehring, W., & Lashley, E (2004) Current use and opinions regarding human patient simulators in nursing education: An international survey. Nursing Education Perspectives, 25(5), 244-248. doi: 10.1043/1094-2831 (2004)025/0244: CUAORH\2.0.CO;2

Patow, C. (2005, March-April).Advancing medical education and patient safety through simulation. Patient Safety and Quality Healthcare. Retrieved from www.psqh.com/marapr05/simulation.html

Radhakrishnan, K., Roache, J., & Cunningham, H. (2007). Measuring clinical practice parameters with human patient simulation: A pilot study. International Journal of Nursing Education Scholarship, 4(1), 1-11. doi: 10.2202/1548-923x.1307.

Schwirian, P. M. (1978). Evaluating the performance of nurses: A multidimensional approach. Nursing Research, 27, 347-351.

Sheetz, L.J. (1999). Baccalaureate nursing student preceptorship programs and the development of clinical competence. Journal of Nursing Education, 28, 29-35.

Sportsman, S., Bradshaw, P., Bolton, C., Lee, M., Townley, N., Watson, M., & Close. (2009). A regional simulation center partnership: A collaboration to improve staff and student competency. Journal of Continuing Education in Nursing, 40(2), 67-73.

Steadman, R., Coates, W., Huang, Y., Matevosian, R., Larman, B., McCullough, L., et al. (2006). Simulation-based training is superior to problem-based learning for the acquisition of critical assessment and management skills. Critical Care Medicine, 34(1). 151-157. doi:10.1097/01CCM CCM Contemporary Christian Music
CCM Critical Care Medicine
CCM County College of Morris (New Jersey)
CCM Chama Cha Mapinduzi (political party, Tanzania)
CCM CORBA Component Model
00001906.42013.94

Weaver, A. (2011). High-fidelity patient simulation in nursing education: An integrative review. Nursing Education Perspectives, 32(I), 27-43). doi: 10.5480/1536-5026-32.1.37

Weinstein, C., Schulte, A., & Palmer, D. (2002). Learning and study strategies inventory (LASSI) users manual (2nd. ed.). Clearwater, FL: H & H Publishing.
Table 1. Description of Data Collection Instruments

INSTRUMENT              PURPOSE                 DESCRIPTION

Demographic Data Sheet  To describe the         Gender, age, nursing
                        demographic             school, previous
                        characteristics of      health care
                        the sample              experience, current
                                                work in health care,
                                                and family health
                                                care experience

Clinical Competency     To assess students'     44-item instrument
Appraisal Scale         perceptions of their    with 5 subscales:
(CCAS)                  own clinical
                        competency, using 6-    a. Psychomotor Skills
(Baramee & Blegen,      point Likert scale      Perception (PSP)
2003) adapted from      (dependent to
the Clinical                                    b. Leadership
Competency Rating
Scale (CCRS) by         independent).           c.Teaching/
Sheetz (1999) and the                           Collaboration
6-DSNP by Schwirian
(1978)                                          d. Planning/
                                                Evaluation

                                                e. Interpersonal
                                                Relationships/
                                                Communication

Learning and Study      To assess how           4 subscales used:
Strategies Inventory    respondents learn and
(LASSI)                 study                   a. anxiety and worry
                                                about school
(Weinstein, Shulte,                             performance (Anxiety)
Palmer, 2002)
                                                b. attitude and
                                                interest (Attitude)

                                                c. concentration and
                                                attention to academic
                                                tasks (Concentration)

                                                d. motivation,
                                                diligence,
                                                self-discipline,
                                                willingness to work
                                                hard (Motivation)

Clinical Learning       Assesses student        23-item survey with 5
Environment Scale       satisfaction with       subscales:
(CLE)                   last semester
                        clinical experience     a. Staff-Student
(Dunn & Burnett,                                Relationships
1995)
                                                b. Nurse Manager
                                                Commitment

                                                c. Patient
                                                Relationships

                                                d. Interpersonal
                                                Relationships

                                                e. Student
                                                Satisfaction

Standarized Exit        To measure student      100-item
Examination             preparedness for the    comprehensive exam
                        NCLEX-RN examination    designed for
                                                administration near
                                                completion of a
                                                professional nursing
                                                curriculum.
                                                Examination also
                                                identifies strengths
                                                and weaknesses of
                                                students-possible
                                                need for remedia-
                                                tion prior to taking
                                                licensure exam.

Graduating Grade        Average of grades
Point Average (GPA)     achieved in all
                        courses required for
                        an ADN or BSN

INSTRUMENT              RELIABILITY/VALIDITY

Demographic Data Sheet  N/A

Clinical Competency     Cronbach's alpha
Appraisal Scale         reliability
(CCAS)                  coefficient  in 2005-
                        2006: 0.819 to 0.953
(Baramee & Blegen,
2003) adapted from
the Clinical
Competency Rating
Scale (CCRS) by
Sheetz (1999) and the
6-DSNP by Schwirian
(1978)

Learning and Study      Alpha reliability
Strategies Inventory    coefficients for
(LASSI)                 subscales:

(Weinstein, Shulte,     Anxiety = .87;
Palmer, 2002)
                        Attitude = .77;

                        Concentration = .86;

                        Motivation = .84.

Clinical Learning       Factors have strong
Environment Scale       substantive face and
(CLE)                   construct validity,
                        as determined by a
(Dunn & Burnett,        confirmatory factor
1995)                   analysis

                        Reliability
                        coefficients range
                        from high (0.85) to
                        marginal (0.63)

Standarized Exit        Kuder Richardson
Examination             Formula 20 calcu
                        lated for all exams.
                        Resulting data used
                        to estimate
                        reliability of exam
                        prior to
                        administration.
                        Reliability estimates
                        based on all previous
                        administrations of
                        the test items on
                        each exam/reflective
                        of most recently
                        updated item analysis
                        (Morrison et. al.,
                        2004).

                        Criterion-related
                        validity obtained
                        from four annual
                        validity studies to
                        determine accuracy in
                        predicting NCLEX-RN
                        outcomes. Based on
                        aggregate data
                        collected from 19,554
                        N/A subjects, found
                        to be 96.36 to 98.46
                        percent accurate in
                        predicting NCLEX-RN
                        scores.

Graduating Grade        NA
Point Average (GPA)

Table 2. Data Collection Process in Relation to Simulation Experience

STUDENT GROUPS          2005                    2006

2005 BSN Seniors        Semester of
                        Simulation

                        Data collection
                        instruments in April:
                        Demographic data
                        sheet, CCAS, LASSI,
                        CLE

2005 BSN Juniors/2006   1 Semester of           2 Semesters of
BSN Seniors             Simulation              Simulation

                        Data collection         Data collection
                        instruments in          instruments in April:
                        January: Demographic    CCAS, LASSI, CLE
                        data sheet, CCAS

2006 BSN Juniors/2007                           3 Semesters of
BSN Seniors                                     Simulation

                                                Data collection
                                                instruments in
                                                January: Demographic
                                                data sheet, CCAS

2007 BSN Juniors

2005 ADN Seniors        No Simulation

                        Data collection
                        instruments in April:
                        Demographic data
                        sheet, CCAS, LASSI,
                        CLE

2005 ADN                No Simulation           2 Semesters of
Juniors/2006                                    Simulation
ADN Seniors             Data collection
                        instruments in          Data collection
                        January: Demographic    instruments in April:
                        data sheet, CCAS        CCAS, LASSI, CLE

2006 ADN Juniors/2007                           Semesters of
ADN Seniors                                     Simulation

                                                Data collection
                                                instruments in
                                                January: Demographic
                                                data sheet, CCAS

2007 ADN Juniors

STUDENT GROUPS          2007                    TOTAL SEMESTERS OF
                                                SIMULATION

2005 BSN Seniors                                1 Semester of
                                                Simulation

2005 BSN Juniors/2006                           3 Semesters of
BSN Seniors                                     Simulation

2006 BSN Juniors/2007   2 Semesters of          5 Semesters of
BSN Seniors             Simulation              Simulation

                        Data collection
                        instruments in April:
                        Demographic data
                        sheet, CCAS

2007 BSN Juniors        2 Semesters of          2 Semesters of
                        Simulation              Simulation

                        Data Collection
                        Instruments in
                        January: demographic
                        data Sheet, CCAS

2005 ADN Seniors                                No Simulation

2005 ADN                                        2 Semesters of
Juniors/2006                                    Simulation
ADN Seniors

2006 ADN Juniors/2007   2 Semesters of          5 Semesters of
ADN Seniors             Simulation              Simulation

                        Data collection
                        instruments in April:
                        CCAS, LASSI, CLE

                                                3 Semesters of
2007 ADN Juniors        3 Semesters of          Simulation
                        Simulation

                        Data collection
                        instruments in
                        January: Demographic
                        data sheet, CCAS

Note. CCAS = Clinical Competence Appraisal Scale; LASSI =
Learning and Study Skills Inventory; CLE = Clinical Learning
Environment Scale
COPYRIGHT 2011 National League for Nursing, Inc.
No portion of this article can be reproduced without the express written permission from the copyright holder.
Copyright 2011 Gale, Cengage Learning. All rights reserved.

 Reader Opinion

Title:

Comment:



 

Article Details
Printer friendly Cite/link Email Feedback
Title Annotation:TEACHING WITH TECHNOLOGY / ACADEMIC METRICS
Author:Sportsman, Susan; Schumacker, Randall E.; Hamilton, Patti
Publication:Nursing Education Perspectives
Geographic Code:1U7TX
Date:Jul 1, 2011
Words:5087
Previous Article:The impact of a simulation lab experience for nursing students.
Next Article:Are you computing in the clouds? Understanding cloud computing.
Topics:

Terms of use | Copyright © 2014 Farlex, Inc. | Feedback | For webmasters