Printer Friendly

Reimagining information literacy instruction in an evidence-based practice nursing course for undergraduate students.


This case report describes the redesign process for an undergraduate evidence-based practice (EBP) nursing course, for which the nursing liaison librarian has served as both co-instructor and coinstructional designer. The course is part of the undergraduate, outcomes-based core curriculum and teaches sophomore nursing undergraduates the principles of the research process; teaches students to identify the strengths and limitations of research articles in relation to EBP; and builds student confidence in their abilities to execute competencies in information literacy, data management, and scholarly communication. Course enrollment typically ranges between sixty and sixty-five students per semester, and the course is offered in both the spring and fall semesters.

Six years prior to the redesign detailed in this report, the course had undergone a redesign in the IMPACT Program. IMPACT, a campus-wide initiative [1], aims to incorporate student-centered teaching practices and learning technologies into courses [2, 3]. Faculty work with a support team of instructors from the libraries, the Center for Instructional Excellence, and campus Information Technology: Teaching and Learning Technologies. In courses that have gone through IMPACT redesigns, faculty report significant increases in student activity and engagement and perceive an improvement in students' critical thinking skills [2]. The nursing liaison librarian had been co-teaching the course for one academic year. Prior to her involvement, the previous nursing liaison librarian was involved with the course and advised on its initial IMPACT redesign.

After the undergraduate EBP nursing course's initial IMPACT redesign, a curriculum shift occurred. The information literacy-based competencies taught in the course were considered better suited for sophomores, who are just beginning research projects, as opposed to seniors, who are preparing to graduate. Though the course would be taken by less-experienced students, course learning objectives were set in accordance with accreditation standards and remained fixed. These objectives were numerous and wide-ranging:

1. describe the principles of research and the process of EBP;

2. use information and information technologies ethically, legally, and proficiently;

3. explain the purpose and methodology of various types of quantitative and qualitative research designs;

4. evaluate the quality of research evidence to determine scientific merit, strengths, and limitations relevant to clinical practice;

5. examine the economic, legal, and ethical issues related to conducting research;

6. discuss the process of translating research evidence into practice; and

7. demonstrate the characteristics of an innovator that are necessary for EBP, including leadership, a sense of inquiry, flexibility to change, awareness of self and the environment, effective communication, critical thinking, lifelong learning, and professionalism [4].

The original course curriculum assumed that students had already mastered basic information literacy competencies, and while appropriate for an audience of seniors, that assumption did not hold true for sophomores. Another redesign was needed to achieve all the aforementioned course learning objectives using activities and assessments that were appropriate for sophomore-level undergraduates.

Additionally, the faculty and librarian coinstructors observed a decrease in the sophomore students' engagement in the course. We hypothesized that this was because many students failed to complete the required readings and other nongraded prework, possibly because they concurrently took other difficult courses and the heavy course load challenged their time-management and study skills. This was especially evident as the student-focused course design required students to lead and propel course discussions. Therefore, another redesign objective was to increase student motivation and participation.

The course redesign sought to maintain a student-centered approach. Well-designed student-centered learning approaches motivate students to take an active role in the learning process [5-9].

Findings from cognitive and educational psychology, particularly Deci and Ryan's self-determination theory and Dunlosky's review of effective learning techniques, were considered. Deci and Ryan's self-determination theory provided a motivational framework that advised that learning experiences should be based on the fulfilling of three needs:

1. "Autonomy," feelings of volition and choice, which are supported by endorsement of behavior and student ownership of the learning process;

2. "Competence," the extent to which students believe they have mastered content and are able to perform academically; and

3. "Relatedness/Relevance," feelings of belongingness and connectedness with others and with the material presented in class [10].

Educational psychologist Dunlosky tested ten learning techniques and concluded that practice testing (i.e., self-testing) and distributed practice (i.e., implementing a schedule of practice that spreads out study activities over time) are both highly effective learning techniques. His findings also suggest that interleaved practice (i.e., implementing a schedule of practice that mixes different kinds of problems and materials in one study session) is particularly effective for math and concept learning. These time-saving techniques could prove especially useful for sophomore students who are still establishing study skills. For example, findings from Dunlosky's research suggest that the popular approach of rereading material is inefficient and that time would be better spent practice testing [11].

Together, these theories helped form the framework for a course redesign that provides motivation for learning and equips students with effective learning practices.


The Blended Librarians Adapted ADDIE Model (BLAAM), Bell and Shank's instructional systems design process adapted for academic librarians, was used to plan the course redesign. BLAAM consists of five phases: "Assess," "Objectives," "Develop," "Deliver," and "Measure" [12].


The Assess phase involved gaining an understanding of the needs of the current environment, including an assessment of course outcomes and student deficiencies. During this phase, the nursing liaison librarian discussed learning outcomes with the faculty instructor and conducted an informal needs assessment via reference interviews and similar structured conversations with students to better understand their challenges and needs. The deliverable for this phase was a problem statement: "Student engagement and participation performance during class suggests that students are not completing assigned readings and prework activities."


The Objectives phase established the process for what the instruction design needs to accomplish to be considered successful. Bell and Shank suggest an "Audience-Behavior-Condition-Degree" (A-B-C-D) process for developing design objectives [12]. For this redesign, the audience was sixty-two sophomore-level nursing students in a four-credit, in-person course. The behavior was increased student engagement and participation. The condition was that the learner related the knowledge that they gained from completing pre-work assignments to actively engage in class activities, ultimately building confidence in their ability to execute information literacy competencies. The standard for determining the degree to which the learner achieved the objective was based on instructional observation (i.e., instructors' perception of increased engagement during in-class activities) and assessment performance.

The objective of the course redesign was to create a learning experience that meets course objectives and encourages student motivation and participation by providing autonomy, competence, and relatedness. We aimed to encourage students to adopt effective learning techniques by introducing course readings and prework assignments that followed an interleaved practice, mixing different kinds of problems and materials in weekly assignments. Also, we wanted to improve student participation and engagement during in-class group activities as measured by qualitative and quantitative assessments, including instructors' observations of student performance during group work and the response rates of low-stakes, in-class quizzes. Course modules followed a distributed practice, spreading out study activities over time and iteratively building on information literacy competencies.


The Develop phase focused on the production process for creating an instruction service using a four-step model: "Prototype," "Create/Build," "Formative Evaluation," and "Revision" [12]. In the Prototype step, we designed a mock-up of a sample course flow. Newly redesigned course assignments--including pre-assignments, in-class assignments, and post-class assignments or homework--followed an interleaved practice approach. This mixture of problems and materials included reading assignments that required students to write summarizations of to-be-learned information; use discussion boards and social media outlets to pose and respond to a "Why" question (elaborative interrogation approach); and use self-paced modules and videos accompanied by quiz questions that required self-explanation of how newly acquired information related to previously known information.

In the Create/Build step, we decided what materials to produce and what types of media to include. The development of new activities and assessments was the heart of the course redesign. The new course approach introduced basic information literacy competencies and then built on them, allowing students to think critically about how the information literacy competencies related to the course objectives. Supplemental Appendix A provides an example storyboard for an in-class search strategy building activity.

Useful tools and media for newly launched activities included Solstice, a wireless content sharing technology for classrooms that was already available at the university; HotSeat, a home-grown application allowing learners to screencast questions and comments in class using short message service (SMS) texting, iOS and Android devices, and desktop and mobile websites; Twitter; the JoVe video library, for which the library already held a subscription; NurseLogic 2.0 web-based interactive tutorials that guide students through foundational concepts; and ThePoint, a digital textbook companion that includes practice quizzes, interactive flashcards, and case studies. The course was also moved to an active-learning classroom that better supported group work and use of Solstice and HotSeat. Supplemental Appendix B details a full course schedule with examples of the revised course flow and the redesigned assignments and assessments.

In the Formative Evaluation step, we tested draft versions of the proposed activities on graduate and undergraduate research assistants, librarians, and discipline faculty members.

In the Revision step, we used feedback from the formative evaluation to finalize the redesigned course schedule and course assignments. An example of the final version of an in-class search activity was the "Searching as Strategic Exploration Building Block Activity" [13].


The Delivery phase process consisted of three steps: "Diffusion," "Training," and "Resource Allocation and Budget." In the Diffusion step, we developed a plan to adopt the instructional product. In our four-credit-hour course, students meet face-to-face in the classroom for two hours per week and spend an additional two hours per week in self-guided team meetings. During the course, students complete a literature review, a data analysis project, and a professional poster in a mixture of individual and group work. The Blackboard Learning Management System is used to organize and deliver course content.

The course is hosted in an active learning classroom that supports technology-enabled active learning: tables and chairs are mobile; instructors and students can screenshare with Solstice; and Hotseat allows both students and instructors to pose and answer questions. Hotseat can also track which students ask and answer questions, which can be used as a participation measurement. The course's redesigned approach relies on a distributed practice model and consists of two distinct parts. In part one, students learn about the research process, learn to select and use research-topic appropriate databases, build a literature search based on clearly defined research questions, synthesize findings with clear results and conclusions, and use proper American Psychological Association (APA) formatting. Each of these competencies is delivered iteratively, and they build on each other until students are able to create a carefully crafted research agenda.

In the second half of the course, students put their newly gained skills to work and complete both team and individual research projects. Students learn to use Zotero to manage and share bibliographic data, are introduced to the data management cycle, and complete a data analysis project using Twitter data. Final projects include an oral presentation of an individual research project, an oral presentation based on a group Twitter data project, and a poster presentation based on the group research project and presented at the university's annual undergraduate research symposium.

In the Training step, we identified the skills needed to execute a successful redesign. Both course instructors were familiar with student-centered instruction as participants of the IMPACT program. Additionally, the librarian instructor was an alumnus of the Association of College & Research Libraries (ACRL) "Immersion Teacher Track Program." We determined further training on course assessment and qualitative research analysis was needed to effectively measure student learning, so the librarian attended an ACRL "Assessment in Action" workshop.

In the Resource Allocation and Budget step, we determined the funding needed for a successful implementation. Because this redesign built on an existing student-centered course on a campus that was heavily invested in supporting student-centered learning, many useful tools were already available. Still, the redesign project was funded by a small Library Innovation Award, library-sponsored funding to encourage librarians and disciplinary faculty to collaborate and develop new learning experiences. Resource allocations included professional development funding ($1,500 for travel to the American Library Association Annual Conference), supplies ($235 for 5 books on instructional design and research methodology), and technology ($750 for an iPad Pro with keyboard).


The Measure phase consisted of pre- and post-course surveys (supplemental Appendix C) that assessed student confidence ratings for several information literacy, data management, and scholarly communication-related competencies. Completion of both surveys was optional, and both surveys were digitally distributed via anonymous links to a Qualtrics survey. Twenty-five students completed the pre-course survey, and 54 students completed the post-course survey. The survey's Likert items were coded for data analysis: 1=Strongly agree, 2=Agree, 3=Somewhat agree, 4=Neither agree nor disagree, 5=Somewhat disagree, 6=Disagree, 7=Strongly disagree. Differences between pre- and post-course survey responses were analyzed using 2-sample t-tests assuming unequal variance. We found significantly increased student confidence, reflected by lower ratings, in using APA style formatting after the course (t(41)=3.02, p=0.004). All other confidence ratings, however, were unchanged between pre- and post-course surveys (Figure 1).

Subscribing to Marshall McLuhan's popular phrase, "the medium is the message," we also sought to understand student preferences for receiving new information. At the end of the course, students were asked to report their preferred learning media, with multiple selections allowed. The overwhelming preferred learning medium was in-class lectures and activities (Figure 2).


We believe the course redesign was a success, because we noted improved student engagement throughout the course, and post-course assessments suggested that students were mostly confident in their abilities to execute information literacy competencies. However, there were no statistically significant gains for most competencies after the course. We speculate that this was because after completing the course, students had a better understanding of the complexities of information literacy competencies and were able to more critically consider their execution. This was best illustrated in the shift in student opinion regarding their ability to evaluate the quality of research evidence, which requires higher order thinking [14] and in which student confidence was lower after completing the course.

We also noted that both assessments were voluntary, and no points were awarded for their completion, which might have produced volunteer bias. Study bias research suggests that participants who volunteer to take part in low-incentive studies tend to have different characteristics from the general population of interest; for example, they tend to be more approval-motivated and have had more robust educational experiences [15]. Despite the mostly null results of statistical analysis in relation to student confidence in executing information literacy competencies, we believe that another indicator of improved student engagement was the marked increase in participation in the post-course survey (87% response rate), compared with the pre-course survey (40% response rate).

The results of the survey of preferred learning media are also interesting. Even after completing a student-centered course that provided a carefully curated selection of learning media--including in-class activities, lectures, readings, videos, and self-paced modules--sophomore students overwhelmingly preferred to learn via in-person lectures and in-class activities. These preferences are common amongst students who are new to flipped classrooms and student-centered learning [16], but using a theoretical framework to inform course redesign (such as our use of Bell's instructional design model), integrating a mixture of high- and low-stakes assessments into course design, and flipping the entire course and not just selecting activities can help make the adoption of student centered learning practices more successful and lead to improved student engagement [16].



[1.] Mcmurtie B. How Purdue professors are building more active and engaged classrooms. Chron Higher Educ. 2018 Oct. (Available from: <>. [cited 25 Jul 2019].)

[2.] FitzSimmons J. IMPACT data dashboard [Internet]. IMPACT; 25 Sep 2018 [cited 25 Jul 2019]. <>.

[3.] Maybee C, Tomalee D, Riehle CF. Making an IMPACT: campus-wide collaboration for course learning and space transformation. Coll Res Libr News. 2013 Jan;74(1):32-5.

[4.] Maybee C, Carlson J, Slebodnik M, Chapman B. It's in the syllabus: identifying information literacy and data information literacy opportunities using a grounded theory approach. J Acad Librariansh. 2015 Jul;41(4):369-76.

[5.] Boyer EL, Moser D, Ream TC, Braxton JM. Scholarship reconsidered: priorities of the professoriate. San Francisco, CA: Carnegie Foundation for the Advancement of Teaching; John Wiley & Sons; 2015.

[6.] Huber MT. The scholarship of teaching and learning in and across the disciplines. Bloomington, IN: Indiana University Press; 2013.

[7.] McKinney K. Enhancing learning through the scholarship of teaching and learning: the challenges and joys of juggling. John Wiley & Sons; 2010.

[8.] Melton BF, Bland HW, Chopak-Foss J. Achievement and satisfaction in blended learning versus traditional general health course designs. Int J Scholarsh Teach Learn. 2009;3(1):26.

[9.] Smith RA. Moving toward the scholarship of teaching and learning: the classroom can be a lab, too! Teach Psychology. 2008 Oct;35(4):262-6.

[10.] Deci EL, Ryan RM. Self-determination theory: a macrotheory of human motivation, development, and health. Can Psychology/Psychologie Canadienne. 2008 Aug;49(3):182-5.

[11.] Dunlosky J, Rawson KA, Marsh EJ, Nathan MJ, Willingham DT. Improving students' learning with effective learning techniques: promising directions from cognitive and educational psychology. Psychol Sci Public Interest. 2013 Jan;14(1):4-58.

[12.] Bell SJ, Shank, JD. Academic librarianship by design: a blended librarian's guide to the tools and techniques. American Library Association; 2007.

[13.] McGowan B. Searching as strategic exploration building block activity [Internet]. Libr Faculty Staff Creative Materials; Dec 2018 [cited 25 Jul 2018], < fscm/22/>.

[14.] Adams NE. Bloom's taxonomy of cognitive learning objectives. J Med Libr Assoc. 2015 Jul;103(3):152-3. DOI:

[15.] Brassey J, Mahtani K, Spencer EA, Heneghan C. Catalogue of bias collaboration: volunteer bias. Catalogue Bias. 2017. <>.

[16.] McNally B, Chipperfield J, Dorsett P, Del Fabbro L, Frommolt V, Goetz S, Lewohl J, Molineux M, Pearson A, Reddan G, Roiko A, Rung A. Flipped classroom experiences: student preferences and flip strategy in a higher education context. Higher Educ. 2017 Feb;73(2):281-98.


Storyboard for the design of an in-class search activity

Name: Evidence-Based    Title: Create a         Date of production:
Practice (EBP) Course   search strategy         January 23, 2017

Description of activity: "Searching as          Action details &
Strategic Exploration: Building Block           notes
Activity" This hands-on activity will
complement a lecture on search building,        Record a closed-
which includes teaching the use of Boolean      caption video lecture
operators; selection of keywords, natural       on how to build a
language, and controlled vocabulary; use of     basic search in both
wildcards; and selection of appropriate         PubMed and CINAHL.
databases.                                      Provide video in
                                                advance of class, as
Programming notes Embed lecture video in        a pre-work
Blackboard and track views. Use Camtasia or     assignment.
PowerPoint to embed quiz questions into
lecture videos and have students submit         The search examples
answers to quiz questions as homework.          will be based on a
                                                comparison, outcome
                                                (PICO) question.

                                                Maps to:

                                                Unit 2 (Weeks 3-6):
                                                Information literacy
                                                and quantitative
                                                literacy, building
                                                search strategies

                                                Redesign objective 2:
                                                Students will
                                                participate and
                                                engage in in-class


Sample course schedule

Unit                   Course objectives        Class activities

Unit 1 (Weeks 1-2):                             Syllabus, textbook,
course introduction                             and rubric review Time
                                                management and
                                                effective learning
                                                techniques with
                                                learning styles
                                                inventory (in-class
                                                survey) American
                                                Association (APA)
                                                writing style overview
                                                Download Zotero and
                                                Word plug-ins on
                                                personal computers
                                                Data visualization:
                                                creating graphs with
                                                Excel and Tableau
                                                Declare group research
                                                topic selection
                                                Declare individual
                                                research topic
                                                selection Twitter data
                                                analysis, group
                                                project: samples from
                                                previous semesters

Unit 2 (Weeks 3-6):    Describe the             Lectures and in-class
information literacy   principles of research   activities Information
and quantitative       and the process of EBP   literacy: selecting
literacy               in relation to health    databases; building
                       care Use information     search strategies;
                       and information          locating, retrieving,
                       technologies             and organizing
                       ethically, legally,      research articles;
                       and proficiently         building literature
                       according to the         review tables;
                       Association of College   preparing a reference
                       & Research Libraries     list; synthesizing
                       (ACRL) Framework for     literature
                       Information Literacy     Quantitative literacy:
                       for Higher Education     validity and
                       Explain the purpose      reliability;
                       and methodology of       interpretation and
                       various types of         critique of
                       quantitative and         quantitative data;
                       qualitative research     intro to SafeRx
                       design in health care    database; ethical
                       Examine economic,        reasoning Group
                       ethical, and legal       research project:
                       issues related to        refine search
                       conducting research      strategies, create a
                                                PRISMA flow diagram

Unit 3 (Weeks 7-16):   Evaluate the quality     Complete Twitter data
deliverables           of research evidence     analysis group project
                       to determine             Complete and present
                       scientific merit,        individual research
                       strengths, and           project Complete and
                       limitations relevant     present group project:
                       to clinical practice.    finalize poster
                       Discuss the process of   project for
                       translating research     undergraduate research
                       evidence into practice   fair
                       Demonstrate the
                       characteristics of an
                       innovator that are
                       necessary for
                       practice (EBP), which
                       include leadership, a
                       sense of inquiry,
                       flexibility to change,
                       awareness of self and
                       of the environment,
                       critical thinking,
                       lifelong learning, and

Unit                   Assignments

Unit 1 (Weeks 1-2):    Required readings
course introduction    Supplementary course
                       materials: assigned
                       quizzes, videos, and
                       recorded lectures
                       Choose 4/6 group
                       members and consider
                       group project topic,
                       consider using GroupMe
                       Consider an individual
                       research topic Utilize
                       Melnyk's Critically
                       Appraising Evidence
                       resources: general
                       appraisal tools,
                       checklist, evaluation

Unit 2 (Weeks 3-6):    Required textbook and
information literacy   journal article
and quantitative       readings Follow
literacy               directions for Twitter
                       group project in
                       Instruction Manual
                       View videos and other
                       materials in
                       Blackboard Complete
                       National Institutes of
                       Health (NIH)
                       Completion for
                       Protecting Human
                       Research Participants
                       Individual research
                       project: develop a
                       research question and
                       search strategy,
                       select appropriate
                       databases, retrieve
                       and organize research

Unit 3 (Weeks 7-16):   Required textbook and
deliverables           journal article
                       readings View videos
                       and other
                       materials in
                       Blackboard Complete
                       Twitter trawl project
                       Complete group
                       project: locate and
                       retrieve articles;
                       evaluate, organize,
                       and summarize research
                       findings; oral
                       presentation in class
                       Complete individual
                       project: finalize
                       poster project for
                       undergraduate research


Evidence-based practice course student confidence survey

                                Strongly   Disagree   Somewhat
                                disagree              disagree

I feel confident in my
ability to select appropriate
databases when looking for

I feel confident in my
ability to build a search
that will help me find the
information I need (e.g.,
create a problem,
intervention, comparison,
outcome, time [PICOT]
question, select appropriate
keywords, set inclusion

I feel confident in my
ability to retrieve the full
text for article citations.

I feel confident in my
ability to share and explain
how I retrieved search

I feel confident in my
ability to use American
Psychological Association
(APA) style formatting when
writing research papers.

I feel confident in my
ability to use citation
management tools, like
Zotero, to organize citations
and remove duplicates.

I feel confident in my
ability to evaluate the
quality of research evidence
to determine scientific
merit, strengths, and

                               Neither    Somewhat   Agree   Strongly
                               agree nor    agree              agree

I feel confident in my
ability to select appropriate
databases when looking for

I feel confident in my
ability to build a search
that will help me find the
information I need (e.g.,
create a problem,
intervention, comparison,
outcome, time [PICOT]
question, select appropriate
keywords, set inclusion

I feel confident in my
ability to retrieve the full
text for article citations.

I feel confident in my
ability to share and explain
how I retrieved search

I feel confident in my
ability to use American
Psychological Association
(APA) style formatting when
writing research papers.

I feel confident in my
ability to use citation
management tools, like
Zotero, to organize citations
and remove duplicates.

I feel confident in my
ability to evaluate the
quality of research evidence
to determine scientific
merit, strengths, and


Bethany Sheriese McGowan, Assistant Professor of Library Science and Health Sciences Information Specialist. Library of Engineering and Science. Purdue University. West Lafayette. IN

Received January 2019; accepted May 2019

Bethany Sheriese McGowan

See end of article for author's affiliation.

Caption: Figure 1 Student confidence ratings in executing information literacy practices before and after completing an evidence-based practice (EBP) course

Caption: Figure 2 Students' preferred learning media for information literacy instruction
COPYRIGHT 2019 Medical Library Association
No portion of this article can be reproduced without the express written permission from the copyright holder.
Copyright 2019 Gale, Cengage Learning. All rights reserved.

Article Details
Printer friendly Cite/link Email Feedback
Title Annotation:CASE REPORT
Author:McGowan, Bethany Sheriese
Publication:Journal of the Medical Library Association
Date:Oct 1, 2019
Previous Article:"Game on!" Teaching gamification principles for library instruction to health sciences information professionals using interactive, low-tech...
Next Article:Implementing and assessing a service to demonstrate public impact of faculty research in news and policy sources.

Terms of use | Privacy policy | Copyright © 2020 Farlex, Inc. | Feedback | For webmasters