Printer Friendly
The Free Library
22,728,960 articles and books

User centered evaluation of an automatically constructed hyper-textbook.

As hypertext systems Noun 1. hypertext system - a database management system that allows strings of text (`objects') to be processed as a complex network of nodes that are linked together in an arbitrary way  become widely available and their popularity increases, attention has turned to converting existing textual tex·tu·al  
Of, relating to, or conforming to a text.

textu·al·ly adv.
 documents into hypertextual form. An important issue in this area is the fully automatic production of hypertext hypertext, technique for organizing computer databases or documents to facilitate the nonsequential retrieval of information. Related pieces of information are connected by preestablished or user-created links that allow a user to follow associative trails across the  for learning, teaching, training, or self-referencing. Although many studies have addressed the problem of producing hyper-books, either manually or semi-automatically, the actual usability How easy something is to use. Both software and Web sites can be tested for usability. Considering how difficult applications are to use and Web sites are to navigate, one would wish that more designers took this seriously. See user interface and usability lab.  of hyper-books tools is still an area of ongoing research. This article presents an effort to investigate the effectiveness of a hyper-textbook for self-referencing produced in a fully automatic way. The hyper-textbook is produced using the Hyper-TextBook methodology. We developed a task-based evaluation scheme and performed a comparative user-centred evaluation between a hyper-textbook and a conventional, printed form of the same textbook textbook Informatics A treatise on a particular subject. See Bible. . The results indicate that the hyper-textbook, in most cases, improves speed, accuracy, and user's satisfaction in comparison to the printed form of the textbook.


The motivation for the work reported in this paper can be found in the explosive use of hypertext systems for teaching, learning, training, or simply satisfying an information need. This technology is a relatively new arrival in educational settings, and evaluation studies conducted on hypertext systems' usability as educational tools produce contradictory results (Mayes Mayes is a surname, and may refer to:
  • Adrian Mayes
  • Alan Mayes
  • Bernard Mayes
  • Colin Mayes
  • Derrick Mayes
  • Elaine Mayes
  • Frances Mayes
  • Ian Mayes
  • Joel B.
, Kibby & Anderson Anderson, river, Canada
Anderson, river, c.465 mi (750 km) long, rising in several lakes in N central Northwest Territories, Canada. It meanders north and west before receiving the Carnwath River and flowing north to Liverpool Bay, an arm of the Arctic
, 1990). In addition, previous work in the evaluation of hyper-books has not provided researchers with conclusive evidence CONCLUSIVE EVIDENCE. That which cannot be contradicted by any other evidence,; for example, a record, unless impeached for fraud, is conclusive evidence between the parties. 3 Bouv. Inst. n. 3061-62.  towards either superiority or inferiority of these books in comparison to conventional educational material. Even a brief review of this literature would require a much longer space than we have (Egan, Remde, Gomez Gomez or Gómez is a common Spanish surname. The Portuguese spelling is Gomes, while in Catalan it is rendered as Gomis. People
  • Alfonso Gomez (1980–), Mexican-American professional boxer
  • Andrés Gómez (1960–), Ecuadorian tennis player
, Landauer Landauer is a surname, and may refer to:
  • Bernhard Landauer
  • Gustav Landauer, German anarchist, writer, and critic
  • M. H. Landauer, Writer on Jewish mysticism; born in 1808 at Kappel
  • Rolf Landauer, German-American physicist; born in 1927 at Stuttgart
, Eberhardt, & Lochbaum 1989; Leventhal
  • John Leventhal
  • Harold Leventhal
  • Norman B. Leventhal
  • Adam Leventhal
  • Rick Leventhal
  • Paul Leventhal, nuclear protester
, Maynatt Teasley, Instone, Schertler Rohalman, & Farhart, 1993; Tebbutt, 1999). However, because of some promising evaluation results in favour of hypertext systems, the need for further evaluation arises.

The aim of the work reported in this article is to investigate the effectiveness of a particular model of a hyper-textbook directed specifically to the task of self-referencing. A hyper-textbook is the result of converting a textbook into its hypertextual form. A textbook is a book containing facts about a specific subject, and it is used by people studying that subject. Although a textbook is often used for learning and teaching, in many cases it is also used for reference and fact finding, in particular after the subject dealt by the textbook has already been studied. This is not only the case for teaching material, but also for technical manuals, documentation, and handbooks.

The hyper-textbook we used was developed using the Hyper-Textbook methodology described inCrestani & Melucci (1998a). This methodology enabled the production of a hypertext in a fully automatic way. The evaluation was conducted using a task-based methodology partially developed in the context of the Esprit Working group "Mira." We believe there is a great need for methodologies and tools for the fully automatic production of hypertext to be published on the Web. This is particularly true for documents that are used for self-referencing purposes, such as teaching material (notes, textbooks), software/hardware documentation, technical manuals, and so forth. Only an inexpensive production of such material will encourage its full availability on the Web.

The article is structured as follows. First, a brief introduction to the Hyper-TextBook system is provided. Then the experimental design adopted for the evaluation of a hyper-textbook is presented. Following the experimental design is the section devoted to the presentation and analysis of the experimental results. In the last section the conclusions of the work are reported and some issues around which future work is evolving is suggested.


As hypertext systems become widely available and their popularity increases, attention has turned to converting existing textual documents into hypertextual form. Many projects have focussed on such tasks, for example, SuperBook Superbook (アニメ 親子劇場 Anime Oyako Gekijo; Animated Parent and Child Theater) is an anime television series produced by Tatsunoko Productions in Japan in conjunction with the Christian Broadcasting Network in the (Egan et al., 1989) and CORE(Egan, Lesk, Ketchum Ketchum may refer to: Towns, cities, and lakes
  • Ketchum, Idaho, chiefly known as the site of Ernest Hemingway's suicide
  • Ketchum, Oklahoma
  • Lake Ketchum, Washington
Companies and corporations
  • Ketchum Inc.
, Lochbaum, Remde, Littman, & Laundauer, 1991). Most of the research in this area has been concerned with the effective identification of inter-document and cross-document links to enable a user to access information in a nonlinear A system in which the output is not a uniform relationship to the input.

nonlinear - (Scientific computation) A property of a system whose output is not proportional to its input.
 way (Frisse, 1988; Smeaton Smeaton may refer to:
  • Smeaton, Victoria, an Australian town
  • Smeaton (surname), people with the surname Smeaton
See also
  • Great Smeaton, an English village
  • Little Smeaton, an English village
 & Morrissey, 1995; Agosti, Crestani, & Melucci, 1997; Allan Allan can refer to:
  • Allan, Saskatchewan, Canada
  • Alan (Barbie doll) or Allan, Barbie's friend
  • Allan, a Clan Grant split (or sept)
  • Ahlawat or Allan, an ethnic clan in India
  • Allan, the Allaine's lower course, in France
  • Allan
, 1997). The Hyper-TextBook project is not an exception.

The methodology developed in the context of the Hyper-TextBook project has a long history. InAgosti, Colotti, and Gradenigo (1991) a two-level conceptual model of hypertext called EXPLICIT was presented. This model enables the user to have a clear frame of reference during the browsing See browse.  of a large structured hypertext built from a single large document or collection of documents. Later, Agosti and Crestani developed a methodology for the construction of a hypertext organised according to according to
1. As stated or indicated by; on the authority of: according to historians.

2. In keeping with: according to instructions.

 that model(1993). The methodology makes use of Information Retrieval information retrieval

Recovery of information, especially in a database stored in a computer. Two main approaches are matching words in the query against the database index (keyword searching) and traversing the database using hypertext or hypermedia links.
 (IR) techniques for extracting and linking semantic See semantics. See also Symantec.  objects like index terms or parts of text. A few years later, TACHIR Tachir was a district of the old Armenian region of Gougarq, that was ruled by the family Tachiratsi. See also
  • List of regions of old Armenia
, a tool that automates that technique, was developed and tested(Agosti, Crestani, & Melucci, 1995).

In 1998, the Hyper-TextBook project in which a methodology and a tool for the automatic construction of hyper-textbooks from textbook(Crestani & Melucci, 1998a) were developed. The Hyper-Text-Book methodology makes use of the experience gained with EXPLICIT and TACHIR to automatically produce a hyper-textbook written in HTML HTML
 in full HyperText Markup Language

Markup language derived from SGML that is used to prepare hypertext documents. Relatively easy for nonprogrammers to master, HTML is the language used for documents on the World Wide Web.
 that can be browsed with any web browser The program that serves as your front end to the Web on the Internet. In order to view a site, you type its address (URL) into the browser's Location field; for example,, and the home page of that site is downloaded to you. . The construction of a hyper-textbook is carried out by the Hyper-TextBook tool in a batch way. Hyper-TextBook takes as input a number of files containing an electronic version of the textbook and of the subject index (accepting a number of different formats) and produces as output the entire hyper-textbook in a large number of HTML files. The entire process can be done off-line and requires only the specification of some parameters necessary for the evaluation of similarity Similarity is some degree of symmetry in either analogy and resemblance between two or more concepts or objects. The notion of similarity rests either on exact or approximate repetitions of patterns in the compared items.  between pages, between terms, and between terms and pages. Depending on the size of the textbook the automatic authoring of the hyper-textbook can requite re·quite  
tr.v. re·quit·ed, re·quit·ing, re·quites
1. To make repayment or return for: requite another's love. See Synonyms at reciprocate.

2. To avenge.
 minutes or hours, bu t does not require any human intervention A procedure used in a lawsuit by which the court allows a third person who was not originally a party to the suit to become a party, by joining with either the plaintiff or the defendant. .

A full description of the project is outside the scope of this article. Here we will briefly present an example of the use of a hyper-textbook produced using the Hyper-TextBook methodology. The example describes how a user can browse (1) To view the contents of a file or a group of files. Browser programs generally let you view data by scrolling through the documents or databases. In a database program, the browse mode often lets you edit the data. See Web browser.  and search a hyper-textbook, the same used for the evaluation reported in this article. This hyper-textbook, Information Retrieval by Van Rijsbergen(1979), is available at


Figurela shows the home page of the hyper-textbook. Three entry points for browsing are available. The first one allows access to the hypertextual version of the subject index, from which the user can go to a term. The second entry point corresponds to the list of pages. The third entry point permits access to the table of contents. We assume here that a user goes directly to the subject index where he/she selects a particular term that best represents what he/she is looking for Looking for

In the context of general equities, this describing a buy interest in which a dealer is asked to offer stock, often involving a capital commitment. Antithesis of in touch with.

Figure1b is the page for the term "cluster profile" of the subject index. From this page the user can access:

* the list of pages relevant to the current term (according to its patterns of occurrences in the pages);

* the list of terms similar to the current term (according to the pattern of co-occurrence of terms in the textbook); and

* other terms linked through the manually inserted "see also" links (according to the author's subject index).

Suppose the user chooses to see the list of pages relevant to the term. Figure2a reports the list of textbook pages ranked relevant to the term "cluster profile." As this term was not associated to any pages by the author, the list of linked pages was built using the pages linked to the term "cluster representative." It is worth noticing that the top ranked page is one of those that was pointed out as relevant by the textbook author in the subject index, but the following one, for example, was not. This means that the technique used to infer semantic links This article or section may be confusing or unclear for some readers.
Please [improve the article] or discuss this issue on the talk page.
 is able to preserve the author's judgements of relevance, as well as to identify some additional relevant pages(Crestani & Melucci, 1998b). Links are ranked according to the normalised normalised - normalisation  term weight within the textbook page.

Figure2b contains page 51 of the textbook. The user arrived at that page just by clicking on the page number. The hyper-textbook displays, for each page, the page number, a summary, and the full text of the page. Both at the top and at the bottom of each page some buttons are located that link the current page to the next page, to the previous page, to terms describing the content of the page, and to similar pages. Links to the next and previous pages enable a linear reading of the textbook. Links to terms describing the content of the page or to similar pages enables a non-linear navigation of the hyper-textbook according to the EXPLICIT model.

Figure 3a shows the list of similar pages linked to the current page. Links are ranked according to a normalised page similarity measure based on the distribution of terms A categorical term is said to be distributed, if all individual members of that category are accounted for. In a statement like "All A are either B or C", the term A is distributed, because all elements of the set A are pinpointed.  in the pages.

The user can also see the terms that are similar to a selected term, as depicted de·pict  
tr.v. de·pict·ed, de·pict·ing, de·picts
1. To represent in a picture or sculpture.

2. To represent in words; describe. See Synonyms at represent.
 in Figure 3b, which reports the list of terms similar to the term "cluster profile." Links are ranked according to a normalised term similarity measure.


Evaluation is a very important issue in the area of hypertext construction and hypertext usability. This motivated mo·ti·vate  
tr.v. mo·ti·vat·ed, mo·ti·vat·ing, mo·ti·vates
To provide with an incentive; move to action; impel.

 us to carry out an in-depth evaluation of the Hyper-TextBook system as a fully automatic way of electronically authoring hyper-textbooks from textbooks. At this stage, we decided to concentrate our evaluation on the usability of the final product, the hyper-textbook, instead of the efficiency of the automatic authoring process.

Research Hypothesis

We made the following experimental hypothesis: The hyper-textbook is a more effective tool for seeking information than the original printed form of the textbook.

The textbook chosen for the testing of the above hypothesis was Van Rijsbergen's Information Retrieval (2nd edition), henceforth From this time forward.

The term henceforth, when used in a legal document, statute, or other legal instrument, indicates that something will commence from the present time to the future, to the exclusion of the past.
 referred to as the textbook. The primary reason behind this choice can be ascribed to the fact that Van Rijsbergen, who owns the copyright of the book, granted us permission for its use for the evaluation reported in this article.

Evaluation Scenario

Once the research hypothesis has been established the discussion should turn to the basic design settings upon which the testing of the hypothesis will be carried out. In this case, the independent variable has two levels: the presence (hyper-textbook) or absence (printed textbook) of hypertext functionalities. Participants in the evaluation have to perform some tasks with and without the assistance of hypertext links and of hyper-textbook additional features. The dependent variable is the effectiveness of the participants in completing these tasks. The primary objective is to prove that any variation of the effectiveness between participants is attributed only to the change in the level of the independent variable, that is, to the additional functionalities enabled by the hyper-textbook.

Since the independent variable has two levels, the same number of groups of participants will be employed. One group will perform some tasks using the hyper-textbook, while the other group will perform the same tasks using the printed form of the textbook. In our case, due to restrictions on both time and resources, each group consisted of 10 participants, arguably ar·gu·a·ble  
1. Open to argument: an arguable question, still unresolved.

2. That can be argued plausibly; defensible in argument: three arguable points of law.
, a number deemed adequate to produce significant experimental results. The participants were postgraduate postgraduate

after first degree graduation, the registerable degree in veterinary science.

postgraduate degree
may be a research degree, e.g. PhD, or a course-work masterate with a vocational bias, or any combination of these.
 students doing a conversion course m Computer Science with little, or no, experience in the subject of the textbook.

The issue of keeping the irrelevant variables under control while testing the validity of a research hypothesis is crucial. For the control of irrelevant variables the independent groups design was adopted.

The Experiment

Each participant was assigned as·sign  
tr.v. as·signed, as·sign·ing, as·signs
1. To set apart for a particular purpose; designate: assigned a day for the inspection.

 to one of the two levels of the independent variable and was presented with seven questions. The same questions were given to all participants regardless of the group they belonged to. Questions were of two categories: open-ended and close-ended. The close-ended ones were supplemented by a list of four answers of which only one was correct. Questions included terms occurring in the subject index, and/or in the table of contents and or in paragraph titles. The answers to the questions used in the experiments were given by the author of the textbook. This evaluation procedure is supposed to mimic a student using the book for some homework or examination. For more details about the experiment and the actual questions seeNtioudis (1998).

Unknown to the participants, some of the questions were designed to be well suited for answering using the conventional, printed textbook, while the rest exploited, partially or fully, the functionality of the hyper-textbook. The two groups of questions were of equal size.

After a short practice session, each participant had a time limit to answer each of the seven questions. Participants were allowed to type in "I don't know Don't know (DK, DKed)

"Don't know the trade." A Street expression used whenever one party lacks knowledge of a trade or receives conflicting instructions from the other party.
" as an answer, at any time before the end of the specific time limit, if they felt that they could not find the answer. Apart from the participants' time for completing the assigned task, the experimenter took note of the steps taken by the participants to accomplish the task of answering each question. This was done to reveal participants' strategies in completing the assigned task. At the end, each participant was asked to complete a questionnaire, and after that, a brief discussion took place to gather comments on the experimental procedure.


As stated previously, the dependent variable the authors wished to examine through experimentation was the effectiveness of the users in the process of satisfying an information need by searching in a textbook. To achieve this goal, a set of criteria covering the aspects of the dependent variable had to be defined. These criteria were:

* the accuracy of the answers;

* the speed with which the search for the answers was completed; and

* the subjective opinion of the users about the assistance provided by the different forms of the textbook in completing the task assigned to them.

Apart from establishing the research hypothesis, the purpose of the set of criteria was to draw conclusions about the effectiveness of the hypertextbook in the task of aiding a user satisfying an information need. Since the evaluation of the hyper-textbook is substantially user-centred, the performance of the users under such task-based environment can be an indication of the effectiveness of the hyper-textbook.


The actual performance of the users in the task of satisfying an information need must be measured. In this case, an obvious way to do so was to take into account the "correct answers" found by the participants. However, since the questions were of two different types (open-ended and close-ended), issues of judging their correctness arise.

Assessing the correctness of the answers for close-ended questions is quite easy. On the other hand, assessing the correctness of open-ended questions A closed-ended question is a form of question, which normally can be answered with a simple "yes/no" dichotomous question, a specific simple piece of information, or a selection from multiple choices (multiple-choice question), if one excludes such non-answer responses as dodging a  is more complicated. Since open-ended questions do not have a predefined answer, the participant may give the answer which, according to his/her opinion, thinks is the correct one. Answering open-ended questions involves composition and is a more creative process than just selecting an answer from a list of predefined answers. Therefore, the task of assessing the correctness of such questions requires adopting a scoring method to apply to each answer. A list of terms relevant to each open-ended question was developed. Copies of the answers were then given to an assessor who scored them "blindly" with the lists of terms. In this case, the success rate for each question was defined as the ratio (in %) of the number of terms contained both in the participant's answer and in the list. In any case, no answer to a question or "I don't know" was considered as a wrong answer and the success rate in answering that question was set to 0%.


The experimenter wrote down the time the participant spent in answering each question. This measure was used as an indication of the speed with which the participants performed the assigned tasks. It provided evidence about which experimental condition facilitated the faster execution of the user-performed task, although other factors may affect that condition, like, for example, the familiarisation Noun 1. familiarisation - the experience of becoming familiar with something

experience - the accumulation of knowledge or skill that results from direct participation in events or activities; "a man of experience"; "experience is the best
 of each participant with the interface and functionalities of the hyper-textbook.

Subjective Opinion of the Participants

In both experimental groups, participants were asked to state their opinion about the difficulty in answering the questions. In the group using the hyper-textbook, participants were also asked to state their opinion about the difficulty of navigating (networking, hypertext) navigating - Finding your way around. Often used of the Internet, particularly the World-Wide Web.

A browser is a tool for navigating hypertext documents.
 in the hyper-textbook. The information was collected from the questionnaire that each participant completed. In both cases, difficulty was measured on a scale from 1 (Very easy) to 5 (Extremely difficult). The questionnaire for the group using the hyper-textbook also contained a question referring to what the users found most difficult in using the hyper-textbook. Finally, two questions on whether the time to answer the questions was enough and on what would help participants answer questions in a more efficient way, were in every questionnaire. Although the opinions of the participants, as expressed in the final three questions and in the postexperimental discussion sessions, cannot be quantified, they can provide interesting and useful insights into the utilisa tion of the two different forms of the textbook.


For convenience, the group of participants assigned to work with the hyper-textbook will be referred to as group H, while the group of participants that performed the experiment using the conventional, printed textbook will be known as group P.


The data presented in Table 1 have been acquired by averaging the results of the success rate of the answer to each question over the total number of answers, thus producing the average success rate values per question type. The success rate for group H in answering the close-ended questions was marginally greater than that for group P. On the other hand, for the open-ended questions, the success rate of group P was a bit higher than the success rate of group H. To establish the statistical significance of these results, t-tests were performed, indicating that, with probability of error Probability of error in hypothesis testing
In hypothesis testing in statistics, two types of error are distinguished.
  • Type I errors which consist of rejecting a null hypothesis that is true; this amounts to a false positive result.
 0.05, the results are attributed to the change of level of the independent variable and not to chance factors.

All participants from group H provided an answer to the open-ended questions while participants from group P failed to do so in two cases. By "failed to provide an answer" it is implied that no answer to a specific question was given or the participant typed in "I don't know." This means that, for the open-ended questions, group H answered (either correctly or not) 4% more questions than group P. Nevertheless, group P had a higher success rate than group H which means that answers from group H were not as complete and correct as answers from group P.


Table 2 presents the average speed results. For close-ended questions, group P was marginally faster than group H, although this difference is not statistically significant. For open-ended questions, however, results were quite the opposite. The fastest group was group H with an average time of 279.9 sec. for answering each question, while group P had a average time of 311.9 sec. T-tests attributed these results to the change of level of the independent variable, with probability of error 0.05.

Subjective Opinion of the Participants

Regarding the perceived difficulty of the questions, Table4 shows that 82% of the participants in group H think that questions were relatively easy to answer. The same opinion was expressed by 90% of the participants in group P.

As far as time to answer is concerned, roughly 90% of the participants in both groups thought the time was enough (Table3). Bearing in mind that participants were nonexperts in the field of Information Retrieval, the results are indicative of the aid of the medium in answering the questions.

In addition, participants in group H were asked to rate navigation in the hyper-textbook on a scale from 1 (Very easy) to 5 (Extremely Difficult) when completing their questionnaires. The results depicted in Table4 indicated that only 18% found it difficult. This means that most of the participants clearly understood EXPLICIT and the navigation of the hyper-textbook.

Participant Strategies

Participants' strategies in answering the questions using the hyper-text-book comprised an extensive use of, primarily, the Subject Index and, secondary, the Table of Contents. In fact, 80% of the participants in group H started their search from the subject index. Every time a specific term from to pages judged as similar to that term. Most of the time (70%) the link that lead to terms judged as similar to a previously selected term from the subject Index, was not used.

By selecting the link leading to similar pages, a list of similar pages was presented to the user. Only 10% of the participants examined all the pages in that screen. The first three pages with the higher scores were the ones examined by the majority of users. Participants using the printed form of the textbook adopted an obvious strategy: look for a specific term in the subject index unless the question explicitly identified the chapter where the answer could be found.


As expected, the results of our experimentation did not provide definitive indications over the refutation ref·u·ta·tion   also re·fut·al
1. The act of refuting.

2. Something, such as an argument, that refutes someone or something.

Noun 1.
 or approval of the research hypothesis under testing. The outcome of the analysis of the experimental data was that only in some of the experimental tasks the hyper-textbook was superior in matters of accuracy and speed. In a number of tasks, participants using the printed textbook performed better than participants using the hyper-textbook. The advantage of each form of the textbook over the other was, in most cases, marginal and in some cases not statistically significant.

In addition, the interpretation of the differences in effectiveness of some experimental conditions is problematic, to say the least. Why hypertextbook users were slightly better in speed for open-ended questions and slightly better in accuracy for close-ended ones? What else can we gather from the subjective impressions of users, a part from the obvious? More evaluation work is definitely needed.

Nevertheless, despite its clear limitations, the evaluation enabled us to identify some ways of improving the usability and the effectiveness of the hyper-textbook. These directions pertain to pertain to
verb relate to, concern, refer to, regard, be part of, belong to, apply to, bear on, befit, be relevant to, be appropriate to, appertain to
 both the re-design of the hypertextbook and its re-evaluation, following a formative formative /for·ma·tive/ (for´mah-tiv) concerned in the origination and development of an organism, part, or tissue.  design evaluation approach. In particular:

* the need for a better interface, reflecting in a better way the underlying model of the hyper-textbook (which was not understood by a small number of users), but maintaining the appearance of the printed textbook (so that users can locate quickly both the Subject Index and the Table of Content);

* better formatting of the text in each page to improve readability read·a·ble  
1. Easily read; legible: a readable typeface.

2. Pleasurable or interesting to read: a readable story.
 (more similar to a page of a book than to a Web page); particularly important was considered the highlighting of terms when a text page was reached from a term page;

* the need for the integration of a global search function in the hyper-textbook, to enable users to locate a section in the book pertinent PERTINENT, evidence. Those facts which tend to prove the allegations of the party offering them, are called pertinent; those which have no such tendency are called impertinent, 8 Toull. n. 22. By pertinent is also meant that which belongs. Willes, 319.  to an information need without browsing (as requested by a number of IT minded users); and

* the presence of unnecessary and confusing con·fuse  
v. con·fused, con·fus·ing, con·fus·es
a. To cause to be unable to think with clarity or act with intelligence or understanding; throw off.

 features that needed to be removed, for example, the page summary.

A new version of Hyper-Textbook taking these results into account has been produced and is available at http://www.cs.strath strath  
n. Scots
A wide, flat river valley.

[Scottish Gaelic srath, from Old Irish; see ster-2 in Indo-European roots.
.ac.ukh/~fabioc/htb/. Even though this version is currently being used successfully as a teaching tool, a new evaluation is currently under way to reassess reassess

to reconsider the value or importance of

reassessment n

Verb 1. reassess - revise or renew one's assessment
 the usability of the constructed hyper-textbooks and continue to improve it.

Another important line of research that we are pursuing and that originated from the results of this study is related to the integration of "appearance" and "functionalities" in the authoring of hyper-textbooks. In the Visual Book project(Landoni, 1997), Landoni explored the importance of the visual component of the book metaphor in the production of "good" electronic books. The original aspect of the Visual Book project was the importance given to the visual components of the physical book when designing electronic books together with the interpretation of an electronic book as part of an electronic library intended as an informative system with specific and innovative features. The Visual Book was studied within the context of an electronic library by following an original approach which has highlighted and exploited its relation with the real object it imitates. In particular a new aspect, which has not been exploited to date, is that of visual rhetoric Visual rhetoric is the fairly recent development of a theoretical framework describing how visual images communicate, as opposed to aural or verbal messages. The study of visual rhetoric is different from that of visual or graphic design, in that it emphasizes images as rational  which is important to the design of both paper and e lectronic books.

The definition of visual rhetoric is tied, at least in a first instance, to the concept of text rhetoric, from which it is derived, as this is a well-established and popular example of rhetoric applied to written information. The idea is to define those parts that are more important for the comprehension comprehension

Act of or capacity for grasping with the intellect. The term is most often used in connection with tests of reading skills and language abilities, though other abilities (e.g., mathematical reasoning) may also be examined.
 of the meaning of the text. To achieve this purpose verbal and/or graphical techniques can be used. In fact, a document can be interpreted as a visible representation of a text according to its semantic contents(Southall, 1989). Thus visual rhetoric is simply the translation into graphical terms of the text rhetoric which results from both the logical structure of the text and its pragmatic component. It provides the reader with a graphical mark up language that is immediately recognisable on the basis of previous reading activity. Different graphical presentations suggest different readings and affect deeply the interpretation of the contents of the same text. These observations lead one to conclude that vi sual rhetoric is a crucial aspect for both reading and browsing a document, as the findings of the Visual Book project have confirmed.

From the previous brief description of the Visual Book project, it is clear that the Visual Book and the Hyper-TextBook have lot of similarities when it comes to their approach to electronic publishing An umbrella term for non-paper publishing, which includes publishing online or on media such as CDs and DVDs. . They both take the readers as the centre of the whole system and pay particular attention to their real needs. Both systems are the result of a careful study on what sort of electronic publications can be of real use to a specific category of users (scientists for the Visual Book, students for the Hyper-TextBook) and what additional features may they require or take profit from in the electronic version. A difference between the two projects is that while the Visual Book concentrates on the presentation issues, by looking for new presentation paradigms suitable for the electronic media in the attempt to improve the visual quality of the electronic version to be at least comparable with the paper one, the Hyper-TextBook focuses instead on providing additional features related to the electronic media in order t o make the electronic version more flexible and powerful than the paper one.

It looks reasonable to expect that the Visual Book and the Hyper-TextBook approaches together could result in an enhanced Visual Hyper-TextBook. This could be achieved by providing the Hyper-TextBook with a visual interface that will take advantage of the Visual Book experience and its positive findings. The Visual Hyper-TextBook will then offer a very rich environment to study further issues related to the production of electronic book. We are already working in this direction (Landoni, Crestani, & Melucci, 2000).
Table 1

Success Rate Values (in%) for Answering Questions

Type of questions      Group H  Group P

Close-ended questions  95       90
Open-ended questions   63.2     68.4
Table 2

Speed Results (in seconds) for Answering Questions

Type of questions      Group H  Group P

Close-ended questions  113.4    108.7
Open-ended questions   279.9    311.9
Table 3

Participants Opinion on Whether There was Enough Time to Answer the

Was the time enough?  Group H  Group P

        Yes             90       89
         No             10       11
Table 4

Participant Opinion (in %) About the Difficulty of the Questions

Was the time enough?  Group H  Group P

1 (very easy)           10        9
2                        2        0
3                       70       80
4                       18       11
5 (very difficult)       0        0


The authors would like to thank a number of people: Keith van Rijsbergen for making available the textbook used in this experimentation, Massimo Melucci, Silvia Gabrielli, Monica Landoni, and Jane Reid for their useful suggestions on the evaluation methodology. Spyridon Ntioudis carried out this work as partial fulfilment ful·fill also ful·fil  
tr.v. ful·filled, ful·fill·ing, ful·fills also ful·fils
1. To bring into actuality; effect: fulfilled their promises.

 of the requirements for a M.Sc. in Advanced Information Systems at the University of Glasgow The University of Glasgow (Scottish Gaelic: Oilthigh Ghlaschu, Latin: Universitas Glasguensis) was founded in 1451, in Glasgow, Scotland.  under the supervision of Fabio Crestani. The design and implementation of Hyper-TextBook were carried out by Fabio Crestani and Massimo Melucci at the University of Padova, Italy.


Agosti, M., Colotti, R., & Gradenigo, G. (1991). A two-level hypertext retrieval model for legal data. In Proceedings of ACM (Association for Computing Machinery, New York, A membership organization founded in 1947 dedicated to advancing the arts and sciences of information processing. In addition to awards and publications, ACM also maintains special interest groups (SIGs) in the computer field.  SIGIR SIGIR Special Interest Group on Information Retrieval (Association for Computing Machinery)
SIGIR Special Inspector General for Iraq Reconstruction
, pp. 316-325, Chicago, IL, USA.

Agosti, M., & Crestani, F. (1993). A methodology for the automatic construction of a hypertext for information retrieval. In Proceedings of the ACM Symposium symposium

In ancient Greece, an aristocratic banquet at which men met to discuss philosophical and political issues and recite poetry. It began as a warrior feast. Rooms were designed specifically for the proceedings.
 on Applied Computing computing - computer , pp. 745-753, Indianapolis, IN, USA.

Agosti, M., Crestani, F., & Melucci, M. (1995). Automatic authoring and construction of hypertext for Information Retrieval. ACM Multimedia Systems. 3(1), 15-24.

Agosti, M., Crestani, F., & Melucci, M. (1997). On the use of information retrieval techniques for the automatic construction of hypertexts. Information Processing information processing: see data processing.
information processing

Acquisition, recording, organization, retrieval, display, and dissemination of information. Today the term usually refers to computer-based operations.
 and Management, 33(2), 133-144.

Allan, J. (1997). Building hypertext using information retrieval. Information Processing and Management, 33(2), 145-159.

Crestani, F., & Melucci, M. (1998a). A case study of automatic authoring: from a textbook to a hyper-textbook. Data and Knowledge Engineering, 27(1), 1-30.

Crestani, F., & Melucci, M. (1998b). A methodology for the enhancement of a hypertext version of a textbook by the automatic insertion insertion n. the addition of language at a place within an existing typed or written document, which is always suspect unless initialled by all parties.  of links in the subject index. In Proceedings of the IEEE (Institute of Electrical and Electronics Engineers, New York, A membership organization that includes engineers, scientists and students in electronics and allied fields.  ADL'98 Conference, (pp. 157-166), Santa Barbara Santa Barbara (săn'tə bär`brə, –bərə), city (1990 pop. 85,571), seat of Santa Barbara co., S Calif., on the Pacific Ocean; inc. 1850. , CA, USA.

Egan, D., Lesk, M., Ketchum, R., Lochbaum, C., Remde, J., Littman, M., & Landauer, T. (1991). Hypertext for the electronic library? CORE sample results. In Proceedings of ACM Hypertext'91, (pp. 299-3 12), San Antonio San Antonio (săn ăntō`nēō, əntōn`), city (1990 pop. 935,933), seat of Bexar co., S central Tex., at the source of the San Antonio River; inc. 1837. , TX, USA.

Egan, D., Remde, J., Gomez, L., Landauer, T., Eberhardt, J., & Lochbaum, C. (1989). Formative design-evaluation of SuperBook. ACM Transactions on Information Systems, 7(1), 30-57.

Frisse, M. (1988). Searching for information in a medical handbook
For the handbook about Wikipedia, see .

This article is about reference works. For the subnotebook computer, see .
"Pocket reference" redirects here.
. Communications of the ACM (publication) Communications of the ACM - (CACM) A monthly publication by the Association for Computing Machinery sent to all members. CACM is an influential publication that keeps computer science professionals up to date on developments. , 31(7), 880-886.

Landoni, M. (1997). The visual book system: a study of the use of the visual rhetoric in the design of electronic books. Unpublished doctoral dissertation dis·ser·ta·tion  
A lengthy, formal treatise, especially one written by a candidate for the doctoral degree at a university; a thesis.


, Department of Information Science, University of Strathclyde The University of Strathclyde (Scottish Gaelic: Oilthigh Srath Chluaidh) is a university in Glasgow, Scotland. History
The university originated as Anderson's Institution in 1796.
, Glasgow, Scotland, UK.

Landoni, M., Crestani, F., & Melucci, M. (2000). The visual book and the hyper-textbook: Two electronic books one lesson? In Proceedings of the RIAO Conference, (pp. 247-265).

Leventhal, L., Mynatt Teasley, M., Instone, K., Schertler Roland, D., & Farhat, J. (1993). Sleuthing Sleuthing
See also Crime Fighting.

Alleyn, Inspector

detective in Ngaio Marsh’s many mystery stories. [New Zealand Lit.: Harvey, 520]

Archer, Lew

tough solver of brutal crimes. [Am. Lit.
 in HyperHolmes: An evaluation of using hypertext vs. a book to answer questions. Behaviour & Information Technology, 12(3), 149-164.

Mayes, T., Kibby, M., & Anderson, T. (1990). Learning about learning from hypertext. In Jonassen, D. & Mandl, H. (Eds.), Designing hypermedia hypermedia: see hypertext.

The use of hyperlinks, regular text, graphics, audio and video to provide an interactive, multimedia presentation. All the various elements are linked, enabling the user to move from one to another.
 for learning, NATO NATO: see North Atlantic Treaty Organization.
 in full North Atlantic Treaty Organization

International military alliance created to defend western Europe against a possible Soviet invasion.
n See Anxiety Sensitivity Index.
 Series, (pp. 227-250). Heidelberg, Germany: Springer-Verlag.

Ntioudis, S. (1998). User centred evaluation of an automatically constructed hyper-textbook. Unpublished M.Sc. dissertation, Department of Computing Science, University of Glasgow, Glasgow, Scotland.

Smeaton, A., & Morrissey, P. (1995). Experiments on the automatic construction of hypertext from text. Technical Report CA-0295, School of Computer Application, Dublin, Ireland.

Southall, R. (1989). Interfaces between the designer and the document. In J. Andre, R. Furuta, & V. Quint, (Eds.). Structured documents, (pp. 119-131). Cambridge, UK: Cambridge University Press Cambridge University Press (known colloquially as CUP) is a publisher given a Royal Charter by Henry VIII in 1534, and one of the two privileged presses (the other being Oxford University Press). .

Tebbutt, J. (1999). User evaluation of automatically generated semantic hypertext links in a heavily used procedural manual. Information Processing and Management, 35(1), 1-18.

Van Rijsbergen, C.J. (1979). Information retrieval (2nd ed). London, UK: Butterworths.
COPYRIGHT 2002 Association for the Advancement of Computing in Education (AACE)
No portion of this article can be reproduced without the express written permission from the copyright holder.
Copyright 2002, Gale Group. All rights reserved. Gale Group is a Thomson Corporation Company.

 Reader Opinion




Article Details
Printer friendly Cite/link Email Feedback
Author:Ntioudis, Spyridon P.
Publication:Journal of Educational Multimedia and Hypermedia
Article Type:Statistical Data Included
Geographic Code:1USA
Date:Mar 22, 2002
Previous Article:Learning Strategies and Hypermedia Instruction.
Next Article:Peer-to-peer networking collaboration within education.

Related Articles
Evaluating Digital Libraries for Teaching and Learning in Undergraduate Education: A Case Study of the Alexandria Digital Earth ProtoType (ADEPT).
Undertake a quantitative risk analysis of S. enteritidis in eggs.
ShowCase. (Forecasting).
Evaluating the treatment of L2 writing: an analysis of French textbooks.
Applying the Technology Acceptance Model (TAM) to educational hypermedia: a field study.
Optimizing interconnect performance with eye diagrams: eye measurements can be used as an interconnect optimization tool with frequency, time and...
Improving performance support systems through information retrieval evaluation.
Gene-environment interactions: fundamentals of ecogenetics.

Terms of use | Copyright © 2014 Farlex, Inc. | Feedback | For webmasters