Student searching behavior and the web: use of academic resources and Google.ABSTRACT This article reports results of two user studies of search engine use conducted to evaluate the United Kingdom's national academic sector digital information services See Information Systems. and projects. The results presented here focus on student searching behavior and show that commercial Internet search engines dominate students' information-seeking strategy. Forty-five percent of students use Google as their first port of call when locating information, with the university library catalogue used by 10 percent of the sample. Results of students' perceptions of ease of use, success, time taken to search, and reasons for stopping a search are also presented. ********** As part of its commitment to developing the use of electronic resources and infrastructures, including the Internet, as an educational resource, the United Kingdom has expended ex·pend tr.v. ex·pend·ed, ex·pend·ing, ex·pends 1. To lay out; spend: expending tax revenues on government operations. See Synonyms at spend. 2. considerable funds to facilitate the convergence of new learning environments with digital library services and to develop a coherent Information The coherent information is an entropy measure used in quantum information theory. It is a property of a quantum state ρ and a quantum channel 
to support <a onmouseover=) higher education higher educationStudy beyond the level of secondary education. Institutions of higher education include not only colleges and universities but also professional schools in such fields as law, theology, medicine, business, music, and art. (Ingrain in·grain tr.v. in·grained, in·grain·ing, in·grains 1. To fix deeply or indelibly, as in the mind: & Grout Grout A binding or structural agent used in construction and engineering applications. Grout is typically a mixture of hydraulic cement and water, with or without fine aggregate; however, chemical grouts are also produced. , 2002). (1) The resulting IE is both an enabling infrastructure, designed to facilitate the interoperability The capability of two or more hardware devices or two or more software routines to work harmoniously together. For example, in an Ethernet network, display adapters, hubs, switches and routers from different vendors must conform to the Ethernet standard and interoperate with each other. of heterogeneous Not the same. Contrast with homogeneous. heterogeneous - Composed of unrelated parts, different in kind. Often used in the context of distributed systems that may be running different operating systems or network protocols (a heterogeneous network). services, and an impressive collection of online resources. While it continues to expand in size, scope, and complexity, formative evaluation Formative evaluation is a type of evaluation which has the purpose of improving programmes. It goes under other names such as developmental evaluation and implementation evaluation. has been a key part of the IE. In recent years, a number of government-sponsored projects have sought to investigate and profile the way students use electronic information services within higher and further education. This article focuses on student Web searching behavior and reports on some of the related studies conducted at the Centre for Research in Library & Information Management (CERLIM CERLIM Centre for Research in Library and Information Management (Manchester Metropolitan University) ) at the Manchester Metropolitan University History During the last third of the 20th century MMU grew through the combination of several colleges, some of which were founded in the 19th century. The mergers began on 1st January 1970, when Manchester Polytechnic was formed from Manchester College of Art and Design, the and at the Centre for Studies in Advanced Learning Technologies (CSALT CSALT Constant Stress Accelerated Life Test(ing) ) at Lancaster University Lancaster University (officially the University of Lancaster) is a collegiate campus university in Lancaster, England. The University is frequently placed in the top 20 UK universities in national league tables and in the top 10 for research, notably with its 6* Management . The results of these studies are significant not only to the IE but also to other subject portal projects and to online library research in general. SURVEY OF EXISTING SEARCH ENGINE USE RESEARCH We begin our analysis with an examination of recent research on search engine use. First we analyze research on general Internet users Internet user n → internauta m/f Internet user Internet n → internaute m/f , and then we look at the work focusing on student users. Search engine usage is difficult to measure because search engines--and the Internet in general--are not controlled environments, such as a library home page or a specific information database. As such, it has been difficult to apply the traditional model of recall and precision used in evaluating information retrieval information retrieval Recovery of information, especially in a database stored in a computer. Two main approaches are matching words in the query against the database index (keyword searching) and traversing the database using hypertext or hypermedia links. (IR) systems to Internet search engines (SEs). A further major limitation to search engine use research is that users are adopting different information-seeking strategies than those used in more traditional contexts (Ford, Wilson, Foster, Ellis, & Spink, 2002;Jansen, Spink, & Saracevic, 2000). Jansen also points out that the behavior of Web searchers follows the principle of least effort The principle of least effort is a theory of user behavior held among researchers in the field of library and information science. The principle states that an information-seeking client will tend to use the most convenient search method, in the least exacting mode available. (Zipf, 1949). This has also been recorded by Marchionini (1992), who stated that "humans will seek the path of least cognitive resistance" (p. 156), and Griffiths (1996), who found that "increasing the cognitive burden placed on the user ... can affect successful retrieval of information. Where an application required fewer actions from the user, greater success was achieved as there was less possibility for a user to make an error" (p. 203). An informative review of Web searching studies by Jansen and Pooch (2001) compares the searching characteristics of Web information seekers with those of users of traditional IR systems, but their study separates out Online Public Access Catalogue (OPAC OPAC - Online Public Access Catalog ) users from general IR system users. So, for example, they found that OPAC searchers express their information needs in queries of one to two terms, while Web searchers use approximately two terms and IR searchers six to nine terms per query. Searching session length also differed, with Web searchers usually using two queries per session and typically viewing no more than ten documents from the results list, OPAC searchers using two to five queries and viewing fewer than fifty documents, and IR searchers using seven to sixteen queries and viewing ten documents per session. In addition, while 37 percent of IR searchers use Boolean operators One of the Boolean logic operators such as AND, OR and NOT. , only 8 percent of Web searchers and 1 percent of OPAC searchers use more advanced searches. Other observations of the average Web searcher (Spink, Wilson, Ellis, & Ford, 1998; Ellis, Ford, & Furner, 1998) point out that ineffective use may be caused by a lack of understanding of how a search engine interprets a query. Few users are aware of whether or not a search service defaults to "and" or "or" and expect a search engine to automatically discriminate dis·crim·i·nate v. dis·crim·i·nat·ed, dis·crim·i·nat·ing, dis·crim·i·nates v.intr. 1. a. between single terms and phrases. Also, devices such as relevance feedback Relevance feedback is a feature of some information retrieval systems. The idea behind relevance feedback is to take the results that are initially returned from a given query and to use information about whether or not those results are relevant to perform a new query. work well if the user ranks ten or more items, when in reality users will only rank one or two items for feedback (Croft CROFT, obsolete. A little close adjoining to a dwelling-house, and enclosed for pasture or arable, or any particular use. Jacob's Law Dict. , 1995). Koll (1993) found that users provide few clues as to what they want, approaching a search with an attitude of "I'll know it when I see it," which creates difficulties in formulation formulation /for·mu·la·tion/ (for?mu-la´shun) the act or product of formulating. American Law Institute Formulation of a query statement. Larsen (1997) is of the opinion that Internet search systems will evolve to meet the behavior of the average Web searcher. Thus it can be seen that there has been a shift toward the introduction of search features that appear to respond to the ways in which users actually search these systems, for example, search assistance, query formulation, query modification, and navigation. The notion that improved interaction may be key to improving results is attractive in principle but not necessarily true in reality. Nick Lethaby of Verity ver·i·ty n. pl. ver·i·ties 1. The quality or condition of being true, factual, or real. 2. Something, such as a statement, principle, or belief, that is true, especially an enduring truth: Incorporated, paraphrased in Andrews (1996), pointed out that users do not want to interact with a system beyond entering in a few keywords. A separate research project conducted to develop a methodology for the evaluation of Internet Search Engines from a user's perspective (DEVISE--Dimensions in Evaluation of Internet Search Engines) also found that interaction was little valued by users as the Interaction dimension had the weakest correlation with users' overall rating of satisfaction, where Efficiency had the strongest correlation, followed by Effectiveness, Utility, and then Interaction (Johnson, Griffiths, & Hartley, 2001, 2003). It can thus be assumed that most users will not use advanced search features, nor enter complex queries, nor want to interact with search systems. As a consequence, systems such as search engines are now trying to automate To turn a set of manual steps into an operation that goes by itself. See automation. query formulation, shifting the burden of formulating precise or extensive terminology from the user to the system. Student Studies Beyond general studies of search engine users, a number of studies have focused on the student population. Cmor and Lippold (2001) put forward a number of observations from their experiences of student searching behavior on the Web. These findings can be summarized as follows: (1) students use the Web for everything; (2) they may spend hours searching or just a few minutes; (3) searching skills vary and students will often assess themselves as being more skilled than they actually are; and (4) they will give discussion list comments the same academic weight as peer-reviewed journal peer-reviewed journal Refereed journal Academia A professional journal that only publishes articles subjected to a rigorous peer validity review process. Cf Throwaway journal. articles. Navarro-Prieto, Scaife, and Rogers (1999) sought to develop an empirically based model of Web searching in which twenty-three students were recruited from the School of Cognitive and Computer Science at the University of Sussex. Ten of these participants were computer science students and thirteen were psychology students. Their findings highlight a number of interesting points: (1) while the computer science students are more likely to be able to describe how search engines develop their databases, neither of the two groups has a clear idea of how search engines use the queries to search for information; (2) most participants considered their levels of satisfaction with the results of their search to be "good" or "OK," and (3) most participants cannot remember their searches and tend to forget those search engines and queries that did not give any successful results. From their research Navarro-Prieto, Scaife, and Rogers (1999) were able to identify three different general patterns of searching: 1. Top-down strategy, where participants searched in a general area and then narrowed down their search from the links provided until they found what they were looking for Looking for In the context of general equities, this describing a buy interest in which a dealer is asked to offer stock, often involving a capital commitment. Antithesis of in touch with. . 2. Bottom-up strategy, where participants looked for a specific keyword provided in their instructions and then scrolled scroll n. 1. a. A roll, as of parchment or papyrus, used especially for writing a document. b. An ancient book or volume written on such a roll. 2. A list or schedule of names. 3. through the results until they found the desired information. This strategy was most often used by experienced searchers. 3. Mixed strategies, where participants used both of the above in parallel. However, this last approach was only used by experienced participants. Twidale, Nichols, Smith, and Trevor (1995), in a study that informed the development of the online journal on digital archiving, Ariadne, considered the role of collaborative learning Collaborative learning is an umbrella term for a variety of approaches in education that involve joint intellectual effort by students or students and teachers. Collaborative learning refers to methodologies and environments in which learners engage in a common task in which each during information searching. Quoting relevant literature, they identified the common searching problems as retrieving zero hits; retrieving hundreds of hits; frequent errors; little strategy variation; and locating few of the relevant records. The only specific searching issue addressed was that of "errors made in searching," which described how simple typing errors typing error n → faute f de frappe typing error typing n → Tippfehler m typing error n → in a sound strategy led to few hits and subsequently led to the strategy being abandoned. More general observations revealed a number of collaborative interactions between students, which were noted as the following: (1) students will often work in groups (containing 2-4 individuals) around a single workstation, discussing ideas and planning their next actions; (2) groups work on adjacent workstations, discussing what they are doing, comparing results, and sometimes seeming to compete to find the information; (3) individuals work on adjacent workstations, occasionally leaning over to ask their neighbor for help, and (4) individuals work at separate workstations monitoring the activity of others. Finally, a large-scale, UK-funded study, called the User Behaviour Monitoring and Evaluation Framework, was designed to investigate and profile the use of electronic information services by students within higher and further education in the UK. The framework specifically focuses on the development of a longitudinal lon·gi·tu·di·nal adj. Running in the direction of the long axis of the body or any of its parts. profile of the use of electronic information services (EIS (1) (Executive Information System) An information system that consolidates and summarizes ongoing transactions within the organization. It provides top management with all the information it requires at all times from internal and external sources. ) and the development of an understanding of the triggers of and barriers to use (Banwell et al., 2004)). Within this framework, two different research projects (now completed) were created to evaluate service usage trends. The JUSTEIS JUSTEIS JISC Usage Surveys Trends in Electronic Information Services project (JISC JISC Joint Information Systems Committee (UK) JISC Japan Industrial Standards Committee JISC Joint Industry Safety Committee Usage Survey Trends: Trends in Electronic Information Service) surveyed trends in electronic information service usage; the JUBILEE jubilee (j  `bĭlē), in the Bible, a year when alienated property and land were restored, slaves were manumitted, debts were forgiven, and a general sabbatical year was observed in project (JISC User Behaviour in Information Seeking Information seeking is the process or activity of attempting to obtain information in both human and technological contexts. Information seeking is related to, but yet different from, information retrieval (IR). :
Longitudinal Evaluation of Electronic Information Services) undertook a
longitudinal study longitudinal studya chronological study in epidemiology which attempts to establish a relationship between an antecedent cause and a subsequent effect. See also cohort study. of electronic information service use. JUBILEE and JUSTEIS found that undergraduate students mainly use electronic information systems for academic purposes connected to assessment, although some leisure use was reported, and use of search engines predominated over all other types of electronic information systems. Postgraduate postgraduate after first degree graduation, the registerable degree in veterinary science. postgraduate degree may be a research degree, e.g. PhD, or a course-work masterate with a vocational bias, or any combination of these. students undertaking a degree by research were observed to have a different pattern of use from that of postgraduate students undertaking a degree on a taught course, and overall some of the postgraduate students used JISC-negotiated services and specialist electronic information systems more than undergraduates. Use of electronic journals by both academic staff and postgraduate students was relatively infrequent in·fre·quent adj. 1. Not occurring regularly; occasional or rare: an infrequent guest. 2. . Patterns of use of electronic information systems varied among subject disciplines, and academic staff were found to exert a greater influence over undergraduate and postgraduate use of electronic information systems than library staff. In addition, friends, colleagues, and fellow students were also influential. Different models of information skills provision and support were found in the different institutions and different disciplines participating in these studies. Banwell et al. (2004) suggest that patterns of use of electronic information systems become habitual Regular or customary; usual. A habitual drunkard, for example, is an individual who regularly becomes intoxicated as opposed to a person who drinks infrequently. . The EDNER and EDNER+ Studies The search engine usage project we have been involved with since 2000 is called the Evaluation of the Distributed National Electronic Resource (EDNER) Project. (2) Since its successful completion in 2003, we were awarded a one-year extension until July 2004, hence the additional title, EDNER+. The aim of the EDNER studies was to develop understanding of users' searching behavior within the IE by asking them to assess a selection of IE services according to according to prep. 1. As stated or indicated by; on the authority of: according to historians. 2. In keeping with: according to instructions. 3. a range of defined criteria--Quality Attributes. Given the limitations of search engine research and the shift in recent years from the usage of performance indicators to measures of outcome and impact within libraries (Brophy, 2004), we have developed a Quality Attributes approach for this research. The classic definition of quality as "fitness for a purpose" was developed by Garvin (1987) into an eight dimension, or attribute, model, which can be used as a framework for determining the overall quality of a product or service. This approach has since been adapted for use in libraries and information services by Marchand (1990), Brophy and Coulling (1996), Brophy (1998), and Griffiths and Brophy (2002). Griffiths and Brophy adapted the Quality Attributes by changing the emphasis of one attribute, changing the concept of one attribute, and introducing two additional attributes (Currency and Usability How easy something is to use. Both software and Web sites can be tested for usability. Considering how difficult applications are to use and Web sites are to navigate, one would wish that more designers took this seriously. See user interface and usability lab. ), thus producing a set of ten attributes: Performance, Conformance con·for·mance n. Conformity. Noun 1. conformance - correspondence in form or appearance conformity agreement, correspondence - compatibility of observations; "there was no agreement between theory and , Features, Reliability, Durability, Currency, Serviceability (system) serviceability - The ease with which corrective maintenance or preventative maintenance can be performed on a system (e.g. by a hardware service technician). Higher serviceability improves availability and reduces service cost. Serviceability is one component of RAS. , Aesthetics aesthetics (ĕsthĕt`ĭks), the branch of philosophy that is concerned with the nature of art and the criteria of artistic judgment. , Perceived Quality, and Usability. A further discussion and presentation of results related to individual attributes is given by Griffiths (2003). The work reported here focuses on results related to discovery and location of resources, resource use, and students' perceptions of quality For the first EDNER study, test searches were designed (one for each of the services to be used by the participants, fifteen in total). These searches were of sufficient complexity to challenge the user without being impossible to answer and were individually tailored for each of the services evaluated. Participants were recruited via Manchester Metropolitan University's Student Union Job Shop; twenty-seven students from a wide course range took part in the study, and each student was paid for his or her participation. One-third of the sample consisted of students from the Department of Information and Communications who were studying for an information and library management degree, while the remaining two-thirds of the sample were studying a wide variety of subjects (being at various stages of their studies). No restrictions were placed on them having computer experience, Internet experience, or familiarity with search engines. Testing was conducted in a controlled environment based within the Department of Information and Communications. Each participant searched for the fifteen test queries and completed questionnaires for each task undertaken. The EDNER+ study investigated student use of eighteen services, which were selected from the presentation layer of the IE. Follow-up questions related to the first EDNER study were included. Individual tasks were created for each service, questionnaires were developed and piloted, and methods of analysis were agreed upon Adj. 1. agreed upon - constituted or contracted by stipulation or agreement; "stipulatory obligations" stipulatory noncontroversial, uncontroversial - not likely to arouse controversy . Thirty-eight students were recruited from thirty-four subjects across the university. These students then undertook two days of searching. None of these participants was studying for an Information and Library Management degree. Each participant used all eighteen services and provided feedback on each service via individual questionnaires. Subjects studied included art, sociology, Spanish, primary education, English, law, and computing computing - computer . Data gathered during both studies were analyzed an·a·lyze tr.v. an·a·lyzed, an·a·lyz·ing, an·a·lyz·es 1. To examine methodically by separating into parts and studying their interrelations. 2. Chemistry To make a chemical analysis of. 3. in two ways: quantitative data were analysed using SPSS A statistical package from SPSS, Inc., Chicago (www.spss.com) that runs on PCs, most mainframes and minis and is used extensively in marketing research. It provides over 50 statistical processes, including regression analysis, correlation and analysis of variance. (Statistical Package for the Social Sciences (statistics, tool) Statistical Package for the Social Sciences - (SPSS) The flagship program of SPSS, Inc., written in the late 1960s. ["SPSS X User's Guide", SPSS, Inc. 1986]. ), and open-response question data were analyzed using qualitative techniques. Results The EDNER studies were concerned with two main questions: (1) how do students discover and locate information, and (2) how do services (and aspects of services) rate in a student evaluation, and what criteria are most important to them (results of this work are presented in Griffiths, 2003). The following section presents a selection of the results related to discovery and location of information. Students' Use of Search Engines Dominates Their Information-Seeking Strategy Students were asked to find information on fifteen set tasks, designed to be typical of information seeking in an academic environment, and to complete a questionnaire after each task. Every time they started a new task we asked them where they went first to try to find relevant information. The following presents the most frequently cited starting points Noun 1. starting point - earliest limiting point terminus a quo commencement, get-go, offset, outset, showtime, starting time, beginning, start, kickoff, first - the time at which something is supposed to begin; "they got an early start"; "she knew from the as found in the first EDNER study: * 45 percent of students used Google as their first port of call when locating information * The second most highly used starting point was the university OPAC, used by 10 percent of the sample * Next comes Yahoo, used by 9 percent of the students as the first source they tried * Lycos was used first by 6 percent * Alta Vista See AltaVista. (World-Wide Web) Alta Vista - A World-Wide Web site provided by Digital which features a very fast Web and Usenet search engine. As of April 1996 its word index is 33GB in size. , Ask Jeeves Noun 1. Ask Jeeves - a widely used search engine accepting plain English questions or phrases or terms trademark - a formally registered symbol identifying the manufacturer or distributor of a product , and BUBL BUBL Bulletin Board for Libraries (UK Joint Academic Network) BUBL Bathysphere Underwater Biological Laboratory (Fairport, New York) BUBL Broaching Universal Buoyant Launcher (US DoD) were all used as a first resource by 4 percent (each) of the sample of students Results from the EDNER+ study found that * 22 out of 38 participants use an SE every day * 2 use an SE three to six times a week * 9 use an SE once or twice a week * 2 use an SE every other week * 3 use an SE once or twice a month Of the search engines chosen, 23 used Google, 4 used a combination of Google and Yahoo, 3 used Yahoo, and 5 used a combination of a variety of SEs. Some students exhibited confusion regarding services, listing the library catalogue and the BBC as BBC AS Bø Byggecompagni As search engines they had used. It is clear that the majority of participants use a search engine in the first instance. This concurs with the JUBILEE and JUSTEIS results, which found that use of SEs predominates over all other types of EIS. Search engines are liked for their familiarity and because they have provided successful results on previous occasions. Individual search engines were frequently described by students as "my personal favourite," and phrases such as "tried and tested," "my usual search engine," and "trusted" were frequently given by the students when asked why they chose this source first. Google's popularity was also expressed in many comments about the service, such as: "Google is very straight forward. You put in your word and it searches. It also corrects spellings to rectify rec·ti·fy v. 1. To set right; correct. 2. To refine or purify, especially by distillation. your search. Bright, eye-catching--simple. Not confusing con·fuse v. con·fused, con·fus·ing, con·fus·es v.tr. 1. a. To cause to be unable to think with clarity or act with intelligence or understanding; throw off. b. "; "Most popular search engine. I always use this for any search"; and "I find the site very helpful. It seems to have whatever I want. I'm happy with it. It is simple but complete." Students' Use of Academic Resources Is Low After search engines, the most frequent starting point was the university library OPAC, followed to a lesser degree by a known academic resource. Thus BUBL, Emerald, Ingenta, and BIDS were all mentioned by participants. There was a very marked difference between information and library management students and those studying for other degrees. The former group was much more likely to prefer these academic resources as a first search tool for similar reasons as the search engine users. Comments such as "Quick and easy to find," "used to it," "thought it would have the relevant information," and "I always use the University electronic journal search first" were typical among these students. Again, ease of use, familiarity, and reliability were key factors in their choice. Information and library management students used the library OPAC to provide details of, and access to, journals. As might be expected, they knew that they would find such information there. They expected to use "bibliographic databases For computer programs to manage an individual's bibliographic references, see Reference management software A bibliographic or library database is a database of bibliographic information. across different subject disciplines," and they also more frequently sought out access to sites with "academic information as opposed to commercial." Some displayed quite a detailed knowledge of the resources available through the library Web site. One student searching for a parenting article "assumed PsychInfo would have an abstract of the article and you can search by either author or keyword"; another, wanting a source on using questionnaires to collect data, "thought there might be something on methodology in the statistics section." The information management students used the library home page to find a route to subject categories too. For example, one user seeking information on wildlife tours looked for an "organisation on safaris On Safari was a children's game show series set in the jungle that was produced by Television South, and aired on the ITV network for 4 seasons from 1982 until 1985. " via the Tourism link; another chose the Biology link as a possible, though unsuccessful, route to an image of the brain. A third "thought the library home page would have a section for science in general" (it does not) from where one can look for a link to the NASA NASA: see National Aeronautics and Space Administration. NASA in full National Aeronautics and Space Administration Independent U.S. Web site and then tried the Web of Science before resorting to Google. This group of students also made more frequent use of services such as BUBL, Emerald, Ingenta, and BIDS. One described BUBL as a "known academic resource with selected/quality sites of interest to academic disciplines" and used it to answer a question on early dynastic dy·nas·ty n. pl. dy·nas·ties 1. A succession of rulers from the same family or line. 2. A family or group that maintains power for several generations: Egypt. In contrast, another user made the point that, when searching for an article, it was easier to try Google first--"quite good at finding articles"--because otherwise there would be a need to "look at a few different databases, e.g., Emerald, BUBL etc." Only two students mentioned using the Resource Discovery Network (RDN RDN Relative Distinguished Name (TMN) RDN Resource Discovery Network (UK) RDN Regional District of Nanaimo (Nanaimo, BC, Canada) RDN Redirected Number RdN Ragazzi Della Nord ) (although in no instance was it the first action taken): one seeking information on research methodology, and another as a possible route to an image of the brain, though this was unsuccessful and the student resorted to Yahoo. The library OPAC was also used by non-information management students to locate information, though to a much lesser degree, and always when looking for journals or articles. "I thought the library pages listed all articles" and "Thought it (an article) was most likely to be in the library catalogue" were two reasons given. One student used the library OPAC because "I knew that the University holds a large source of electronic journals." However, this action was taken only when a search engine search had failed. Another user searching for an article on "parenting" resorted to the library OPAC because part of it "is medically based so I thought it would be the best place to look." Other comments indicate some confusion amongst students about the OPAC, describing it as "A search engine for the library, to find books and catalogues" and "With this search engine ... it is easy and straight forward to use." It seems that students' use of resources is now very colored by their experience with search engines, which in turn may lead to expectations that may not be realistic for different types of services. Among all users, the library OPAC was chosen for its familiarity, its ease of use, its ability to retrieve relevant information, and mostly because there was a clear expectation among some participants that certain types of information resources (1) The data and information assets of an organization, department or unit. See data administration. (2) Another name for the Information Systems (IS) or Information Technology (IT) department. See IT. would be found there. The fact that the most frequent users were information management students might suggest that, when lecturers are aware of and train their students to use the resources that the library provides, their students will become familiar with them and will use them. If this is not done, the status quo [Latin, The existing state of things at any given date.] Status quo ante bellum means the state of things before the war. The status quo to be preserved by a preliminary injunction is the last actual, peaceable, uncontested status which preceded the pending controversy. approach seems to be resorting to a search engine, with varying degrees of success. Levels of use of the library OPAC recorded by the EDNER+ study showed that * 4 out of 38 participants had never used the library OPAC * 4 only use it occasionally * 10 use it once or twice a month * 3 use it every other week * 10 use it once or twice a week * 1 uses it 3 to 6 times a week and * 5 use it every day One participant failed to report his/her level of use. Bibliographic database use was recorded as follows: * 21 out of 38 participants never use bibliographic databases * 3 use them occasionally * 6 use them once or twice a month * 3 use them every other week * 4 use them once or twice a week and * 1 student reported that he/she uses them three to six times a week Of the students who do use bibliographic databases, 3 stated that they use Web of Science, 3 stated that they use Emerald, and 2 listed FAME. All other bibliographic databases were only listed by one participant each: these included SOSIG SOSIG Social Science Information Gateway , Ingenta, Butterworths, Lexis Lexis® An online legal information service that provides the full text of opinions and statutes in electronic format. Subscribers use their personal computers to search the Lexis database for relevant cases. They may download or print the legal information they retrieve. Nexis, and Questia Social Science Library. Use of Amazon.com for locating information, especially about videos, proved to be popular. Four users looking for the Manchester distributor of an Albert Einstein video went immediately to Amazon to seek this information because "Amazon is a global source for videos" that "sometimes has distribution details and other possible names for the video." Perceptions of Use, Success, and Why Students Stop Searching When participants were asked how easy it was to locate information, the following responses were recorded: * 50 percent found it easy to locate the required information * 35 percent found it difficult * 15 percent had no view either way Participants' reasons for finding tasks easy included: "Easy enough to find using the search engines"; "Easier to find formal institutions because they usually have a Web site and these are more often than not listed as recommended sites on the library home page via corresponding subject pages"; "Very easy and direct search taking a small amount of time"; and "It was easy once I went back to Google. Ingenta just messed me about." Where participants found a task difficult, the following comments were made: "Why doesn't someone make a good search engine devoted to articles? It's hard to find an article without an author"; "It is very difficult to search for something specific"; "It was easy to find an abstract, I just couldn't find the full article," and "Got disheartened dis·heart·en tr.v. dis·heart·ened, dis·heart·en·ing, dis·heart·ens To shake or destroy the courage or resolution of; dispirit. See Synonyms at discourage. ." When participants were asked to locate a Web site to find specific information, 70 percent responded that they were successful, and 30 percent responded that they were unsuccessful. When asked to find information via a specific service, 74 percent responded that they were successful, and 17 percent were unsuccessful (9 percent did not know). Check questions were included to ensure that participants were not overgenerous in their reports of success. From these results it is clear that, even when users can find information, it is not always an easy task. This may have serious implications for developers of services as a number of studies (Griffiths, 1996; Johnson, Griffiths, & Hartley, 2001) have shown that users will often trade performance for the path of least cognitive resistance (minimum effort and time). Students were asked to search for as long (or short) a time as they wanted provided that they spent no longer than 30 minutes on any one service. This upper limit was imposed as a result of other research (Craven CRAVEN. A word of obloquy, which in trials by battle, was pronounced by the vanquished; upon which judgment was rendered against him. & Griffiths, 2002), which found that the average time taken to search for information is between 15 and 19 minutes. The majority of students in this study spent an average of between 1 and 15 minutes searching for information. The DEVISE project (Johnson, Griffiths, & Hartley, 2001) also found that Efficiency correlated cor·re·late v. cor·re·lat·ed, cor·re·lat·ing, cor·re·lates v.tr. 1. To put or bring into causal, complementary, parallel, or reciprocal relation. 2. most strongly with General Satisfaction, with Effectiveness second, which may suggest that the amount of time and effort required from the user matters more than the relevance of the items found. Students were also asked why they stopped trying to locate information, with the following reasons given: * Found information = 70 percent * Unable to find Web site within time allowed = 15 percent * Could not find a Web site and gave up = 12 percent * Technical problems affected search = 3 percent Participants who were unable to find a Web site within the time allowed usually stated that they had run out of time. Among those who "Couldn't find a Web site and gave up," frustration at being unable to complete the task was expressed. "It is frustrating frus·trate tr.v. frus·trat·ed, frus·trat·ing, frus·trates 1. a. To prevent from accomplishing a purpose or fulfilling a desire; thwart: when you can't find what you are looking for" or "frustration; all sites were irrelevant" were typical remarks. The lack of success was described as "hitting a brick wall" or not "getting anywhere." Some admitted that they simply did not have any further search strategies, saying they "Don't know Don't know (DK, DKed) "Don't know the trade." A Street expression used whenever one party lacks knowledge of a trade or receives conflicting instructions from the other party. where else to search for it," "I have searched everywhere I can think of," or "didn't know where else to go." This frustration was also reflected in some of the comments of those who encountered "Technical problems." These problems were usually expressed as "slowness." "Internet was very slow" was the most usual comment. "Taking ages to get to some sites," "Server could not contact host and very slow for pages to show," or "Pages would not open" were other complaints. One respondent In Equity practice, the party who answers a bill or other proceeding in equity. The party against whom an appeal or motion, an application for a court order, is instituted and who is required to answer in order to protect his or her interests. remarked that he/she "decided to stop, as if I was doing a search for myself I would not have spent that much time." It may be frustrating for the developers of resources to accept that speed of access may be a criterion on which users will evaluate a service, but studies have shown that this is an important indicator for some users (Johnson, Griffiths, & Hartley, 2001). One respondent gave a very simple reason for stopping--"Teatime!" Student Perceptions of Quality One of the main aims of the IE is to provide a managed quality resource for staff and students in higher and further education. During discussions with various stakeholders Stakeholders All parties that have an interest, financial or otherwise, in a firm-stockholders, creditors, bondholders, employees, customers, management, the community, and the government. involved with the development of the IE, it became clear that common definitions of what is meant by quality electronic resources could not be assumed. Therefore, participants were asked during testing to indicate what quality meant to them in terms of information available via electronic services (they were not asked to relate their responses to any one particular service). Four criteria were presented to them with which they could either agree or disagree. Participants were also asked to add any additional criteria that were not listed but were important to them. Table 1 presents their responses. Additional criteria listed by students included (1) links to related areas; (2) understanding language used; (3) resources relevant; (4) speed of response; (5) resources useful; (6) resources valuable; (7) clear information; (8) source; (9) accessible; (10) timeliness; (11) presentation; and (12) references. DISCUSSION AND CONCLUSIONS These results raise a number of important and interesting issues: * Students prefer to locate information or resources via a search engine above all other options, and Google is the search engine of choice. * Students' use of academic resources is low. * Students find it difficult to locate information and resources. * Students may trade quality of results for effort and time spent searching. * Students' use of SEs now influences their perception and expectations of other electronic resources. Students either have little awareness of alternative ways of finding information to the search engine route or have tried other methods and still prefer to use Google--a situation we now refer to as the "Googling phenomenon." Beyond this, even when students are able to locate information it is not always easy (even when using Google), and with a third of participants failing to find information, user awareness, training, and education need to be improved. While 70 percent of participants felt that they were successful in locating a Web site that provided the required information, only half of these thought that it was easy to locate information. Only the information management students frequently used library resources first to locate information, though some also used search engines either as a first resort or as a backup. And while there were some indications that other students knew about and used library resources, their use was much less common. Students prefer particular favorite search engines, though the reasons they give for their preferences are common across all search engines. Some users indicated that, if their first search strategy did not work, they had a string of similar resources to use as a backup: "Lycos, then Google, Yahoo, Alta Vista," "Google, Alta Vista, Excite, Northern Light," or "Goto.com, Yahoo, Lycos" were typical comments. Others tried a search engine first, and if this failed they turned to a different kind of search tool: "Google then Ingenta," "Google, Biology section of library home page, RDN, Yahoo," for example. One reason for some of the problems that students experience when using electronic resources may be that the hierarchical A structure made up of different levels like a company organization chart. The higher levels have control or precedence over the lower levels. Hierarchical structures are a one-to-many relationship; each item having one or more items below it. arrangement of current IE subject gateways is confusing to them. Hierarchies are notoriously difficult to navigate (1) "Surfing the Web." To move from page to page on the Web. (2) To move through the menu structure in a software application. horizontally so that, once down a particular branch, students may be unable to navigate successfully to an "unrelated" branch. They are effectively lost. Secondly, without a firm grasp of the overall "shape" of the subject, they may find it difficult to identify the correct branches to follow. It would be remarkable if students in the early years of higher education did have a clear conceptual map of their discipline--this is one of the things they are learning. Thirdly, there may be subject-specific factors at work: for example, the structure of chemistry as a discipline may be easier to follow than that of, say, social science. Many networked information services provide information to the desktop, which is quality assured in some way, for example, by the institution's library, by academic publishers, and by the development of the IE itself. As such, users do not always have to concern themselves with exhaustive searches encompassing many resources in order to be satisfied that they have the best information they can get. Indeed, this may be said to be the age of information satisfying--when something is good enough for the purpose rather than seeking to optimize optimize - optimisation the result (Simon, 1957). Recent studies of the use of electronic resources found that, when users seek information, almost all users will only look at the first page of results (for example, Craven & Griffiths, 2002; Sullivan 1998, 2002). Most users are satisfied that these initial ten or so results are good enough to answer their information need. Users are rarely interested in a comprehensive, high-recall search but rather are satisfied with the retrieval of a few relevant hits. In addition our research indicates that students are confused as to the meaning of quality when it comes to assessing academic resources. Viewed in the light of the findings of Cmor and Lippold (2001), who stated that students will give the same academic weight to discussion list comments as peer-reviewed journal articles, it would seem that students are poor evaluators of the quality of academic online resources. The original premise of the Perceived Quality attribute is that users make their judgments about a service based on incomplete information and that they will come to this judgment based on its reputation among their colleagues and acquaintances and their preconceptions and instant reactions to it. If the notion of quality conveys so many different meanings to students, it poses something of a challenge to the academic community in encouraging students to understand and use quality-assured electronic resources. It is also apparent that, from a methodological perspective, further work is needed to explore the meaning of Perceived Quality and the interpretation of user responses to this area of enquiry. Fundamentally different understandings of information quality could otherwise lead to questionable conclusions being drawn by researchers and service providers. Students' use of SEs now influences their perception and expectations of other electronic resources. While the preference for very simple search engine approaches is prevalent, it is important to note that this does not mean that students are necessarily best served by this approach. Indeed, it may be that students would get better results using specialist subject gateways, but most students do not take this approach. Exclusive use of any commercial SE coupled with a lack of awareness and understanding of peer-reviewed, quality resources is not in the best interest of students or academic staff. As service providers and developers, it is crucial that we learn lessons from those commercial search engines that dominate students' use and embed em·bed also im·bed v. em·bed·ded, em·bed·ding, em·beds v.tr. 1. To fix firmly in a surrounding mass: embed a post in concrete; fossils embedded in shale. those lessons into academic resources that students can find and use easily. Table 1. Student's Responses to Definitions of Quality Criteria Reliable Current Accurate Refereed Yes 52% 81% 89% 26% No 48% 19% 11% 74% NOTES (1.) More than twenty years TWENTY YEARS. The lapse of twenty years raises a presumption of certain facts, and after such a time, the party against whom the presumption has been raised, will be required to prove a negative to establish his rights. 2. ago the UK began its strong commitment toward harnessing the Internet for higher education. First, the universities' governmental funding bodies A funding body is an organisation that provides funds in the form of research grants or scholarships. Research Councils Research Councils are funding bodies that are government-funded agencies engaged in the support of research in different disciplines and established the Joint Information Systems Committee (JISC) to deal with networking and specialist information services and to advise and support the UK's higher and further education institutions. During the 1990s the JISC was given the remit To transmit or send. To relinquish or surrender, such as in the case of a fine, punishment, or sentence. An individual, for example, might remit money to pay bills. TO REMIT. To annul a fine or forfeiture. 2. to explore and facilitate the convergence of new learning environments with digital library services and to develop a coherent Information Environment to support learning, teaching, and research. Initially known as the Distributed National Electronic Resource (DNER DNER Departamento Nacional de Estradas de Rodagem (Brazil) DNER Distributed National Electronic Resource ), the JISC Information Environment now provides both infrastructure and services to support the whole of the UK postschool academic sector. (2.) The UK's Resource Discovery Network (RDN) was initially called the Distributed National Electronic Resource (DNER). REFERENCES Andrews, W. (1996). Search engines gain tools for sifting content on the fly. Web Week, 2(11), 41-42. Banwell, L., Ray, K., Coulson, G., Lonsdale, R., Urquhart, C., Armstrong, C. et al. (2004). The JISC user behaviour monitoring and evaluation framework. Journal of Documentation, 60(3), 302-320. Brophy, P. (1998). It may be electronic but is it any good? Measuring the performance of electronic services. In Robots to knowbots: The wider automation agenda: Jan. 28-30, 1998, Melbourne Convention Centre: Proceedings (pp. 217-230). Melbourne: Victorian Association for Library Automation. Brophy, P. (2004). The quality of libraries. In K. Hilgermann, K. and P. te Borkhorst (Eds.), Die effektive Bibliothek: Roswitha Poll zum 65. Geburtstag [The Effective Library] (pp. 30-46). Munich: Saur. Brophy, P., & Coulling, K. (1996). Quality management for information and library managers. Aldershot, England: Gower. Cmor, D., & Lippold, K. (2001). Surfing surfing, sport of gliding toward the shore on a breaking wave. Surfers originally used long, cumbersome wooden boards but now ride lightweight synthetic boards that allow a greater degree of maneuverability. vs. searching: The Web as a research tool. Paper presented at the 21st Annual Conference of the Society for Teaching and Learning in Higher Education, June 14-16, Newfoundland. Retrieved November 16, 2004, from http://staff.library.mun.ca/~DCmor/stlhe/. Craven, J., & Griffiths, J. R. (2002). 30,000 different users ... 30,000 different needs? Design and delivery of distributed resources to your user community. In P. Brophy, S. Fisher, & Z. Clarke (Eds.), Libraries without walls 4: The delivery of library services to distant users (pp. 173-186). London: Facet. Croft, W. B. (1995). What do people want from information retrieval? D-Lib Magazine D-Lib Magazine is an on-line magazine dedicated to digital library research and development. Content of current and past issues are available free of charge. The publication is financially supported by the Defense Advanced Research Projects Agency (as part of the Digital , November. Retrieved November 16, 2004, from www.dlib.org/dlib/november95/11croft.html. Ellis, D., Ford, N., & Furner J. (1998). In search of the unknown In Search of the Unknown a module for the Dungeons & Dragons roleplaying game, designed for use with the Dungeons & Dragons Basic Set rules. In all, the adventure ran through six different printings in addition to a preproduction version that appeared in user: Indexing and hypertext hypertext, technique for organizing computer databases or documents to facilitate the nonsequential retrieval of information. Related pieces of information are connected by preestablished or user-created links that allow a user to follow associative trails across the and the World Wide Web. Journal of Documentation, 54(1), 28-47. Ford, N., Wilson, T. D., Foster, A., Ellis, D., & Spink, A. (2002). Information seeking and mediated me·di·ate v. me·di·at·ed, me·di·at·ing, me·di·ates v.tr. 1. To resolve or settle (differences) by working with all the conflicting parties: searching. Part 4. Cognitive styles Cognitive style is a term used in cognitive psychology to describe the way individuals think, perceive and remember information, or their preferred approach to using such information to solve problems. in information seeking. Journal of the American Society for Information Science and Technology The American Society for Information Science and Technology (also referred to as ASIST or ASIS&T) is an organization of information professionals. Established in 1937, the organization sponsors an annual conference and publishes proceedings from this conference under , 53(9), 728-735. Garvin, D. A. (1987). Competing on the eight dimensions of quality. Harvard Business Review Harvard Business Review is a general management magazine published since 1922 by Harvard Business School Publishing, owned by the Harvard Business School. A monthly research-based magazine written for business practitioners, it claims a high ranking business readership and , November/December, 101-109. Griffiths, J. R. (1996). Development of a specification for a full text CD-ROM CD-ROM: see compact disc. CD-ROM in full compact disc read-only memory Type of computer storage medium that is read optically (e.g., by a laser). user interface. Unpublished master's thesis, Manchester Metropolitan University, England. Griffiths, J. R. (2003). Evaluation of the JISC Information Environment: Student perceptions of services. Information Research, 8(4). Retrieved November 16, 2004, from http://informationr.net/ir/8-4/paper160.html. Griffiths, J. R., & Brophy, P. (2002). Student searching behaviour in the JISC Information Environment. Ariadne, 33. Retrieved November 16, 2004, from http://www.ariadne.ac.uk/issue33/edner/. Ingram, C., & Grout, C. (2002). A distributed national electronic resource for learning and teaching. In P. Brophy, S. Fisher, & Z. Clarke (Eds.), Libraries without walls 4: The delivery of library services to distant users (pp. 111-121 ). London: Facet. Jansen, B.J., & Pooch, U. W. (2001). A review of Web searching studies and a framework for future research. Journal of the American Society for Information Science and Technology, 52(3), 235-246. Jansen, B.J., Spink, A., & Saracevic, T. (2000). Real life, real users and real needs: A study and analysis of user queries on the web. Information Processing information processing: see data processing. information processing Acquisition, recording, organization, retrieval, display, and dissemination of information. Today the term usually refers to computer-based operations. and Management, 36(2), 207-227. Johnson, F., Griffiths, J. R., & Hartley, R.J. (2001). DEVISE: A framework for the evaluation of Internet Search Engines. Resource Report 100. Retrieved November 16, 2004, from http://www.cerlim.ac.uk/projects/devise/index.php. Johnson, F., Griffiths, J. R., & Hartley, R.J. (2003). Task dimensions of user evaluations of information retrieval systems. Information Research, 8(4). Retrieved November 16, 2004, from http://informationr.net/ir/8-4/paper157.html. Koll, M. (1993). Automatic relevance ranking: A searchers' complement to indexing. In N. Mulvany (Ed.), Indexing, providing access to information: Looking back, looking ahead: The proceedings of the 25th annual meeting of the American Society of Indexers (pp. 55-60). Port Aransas, TX: American Society of Indexers. Larsen, R. L. (1997). Relaxing assumptions: Stretching the vision. D-Lib Magazine, April. Retrieved November 16, 2004, from http://www.dlib.org/dlib/april97/04larsen.html. Marchand, D. (1990). Managing information quality. In I. Wormell (Ed.), Information quality: Definitions and dimensions (pp. 7-17). London: Taylor Graham Taylor Graham (born June 3, 1980 in Fair Oaks, California) is an American soccer central defender, who is currently with Seattle Sounders of USL 1st Division. Graham played five years of college soccer at Stanford University, registering as a walk-on his freshman year of . Marchionini, G. (1992). Interfaces for end user information seeking. Journal of the American Society for Information Science, 43(2), 156-163. Navarro-Prieto, R., Scaife, M., & Rogers, Y. (1999). Cognitive strategies in Web searching. Proceedings of the 5th conference of Human Factors and the Web. Retrieved November 16, 2004, from http://zing.ncsl.nist.gov/hfweb/proceedings/navarro-prieto/index.html. Simon, H. (1957). Models of man: Social and rational. New York New York, state, United States New York, Middle Atlantic state of the United States. It is bordered by Vermont, Massachusetts, Connecticut, and the Atlantic Ocean (E), New Jersey and Pennsylvania (S), Lakes Erie and Ontario and the Canadian province of : Wiley. Spink, A., Wilson, T., Ellis, D., & Ford, N. (1998). Modeling users' successive searches in digital environments. D-Lib Magazine, April. Retrieved November 16, 2004, from www.dlib.org/dlib/april98/04spink.html. Sullivan, D. (1998). Counting clicks and looking at links. Search Engine Watch Search Engine Watch (SEW) is a website that provides news and information about search engines and search engine marketing. [1] Search Engine Watch was started by Danny Sullivan in 1996. . Retrieved November 16, 2004, from http://searchenginewatch.com/sereport/article.php/2166431. Sullivan, D. (2002). Search engine placement tips. Search Engine Watch. Retrieved November 16, 2004, from http://searchenginewatch.com/webmasters/article.php/2168021. Twidale, M. B., Nichols, D. M., Smith, G., & Trevor, J. (1995). Supporting collaborative learning during information searching. In Proceedings of CSCL CSCL Computer Supported Cooperative Learning '95: The First International Conference on Computer Support for Collaborative Learning: October 17-20, 1995, Indiana University Indiana University, main campus at Bloomington; state supported; coeducational; chartered 1820 as a seminary, opened 1824. It became a college in 1828 and a university in 1838. The medical center (run jointly with Purdue Univ. , Bloomington, Indiana Bloomington is a city in south central Indiana. Located about 50 miles southwest of Indianapolis, it is the seat of Monroe County. As of the 2000 U.S. Census, Bloomington had a total population of 69,291, making it the 7th largest city in Indiana. (pp. 367-374). Mahwah, NJ: Lawrence Erlbaum. Zipf, G. (1949). Human behaviour and the principle of least effort. Reading, MA: Addison-Wesley. Jillian R. Griffiths, Centre for Research in Library and Information Management (CERLIM), Manchester Metropolitan University, Faculty of Humanities, Law and Social Science, Geoffrey Manton Building, Rosamond Street Rosamond Street is a road approximately 700 metres long with about 70 houses on it, in the suburb of Hornsby, Australia. The street is the home of Mt. Wilga Manor, Mt. Wilga Private Hospital, and Hornsby Rifle Range. West, Manchester, M15 6LL, United Kingdom; and Peter Brophy, Director, Centre for Research in Library and Information Management (CERLIM), Manchester Metropolitan University, Faculty of Humanities, Law and Social Science, Geoffrey Manton Building, Rosamond Street West, Manchester, M15 6LL, United Kingdom. |
|
||||||||||||||||||
Printer friendly
Cite/link
Email
Feedback
Reader Opinion