Enhancing the trustworthiness of qualitative research in international business.
* Reliability, validity, generalisability and objectivity are fundamental concerns for quantitative researchers. For qualitative research Qualitative research
Traditional analysis of firm-specific prospects for future earnings. It may be based on data collected by the analysts, there is no formal quantitative framework used to generate projections. , however, the role of these dimensions is blurred. Some researchers argue that these dimensions are not applicable to qualitative research and a qualitative researcher's tool chest should be geared towards trustworthiness trustworthiness Ethics A principle in which a person both deserves the trust of others and does not violate that trust and encompass issues such as credibility, dependability, transferability and confirmability.
* This paper advocates the use of formalised Adj. 1. formalised - concerned with or characterized by rigorous adherence to recognized forms (especially in religion or art); "highly formalized plays like `Waiting for Godot'"
formalistic, formalized and software-based procedures for the analysis and interpretation of qualitative interview data. It is argued that International Business research, with a focus on international datasets, equivalence issues, multiple research environments and multiple researchers, will benefit from formalisation Noun 1. formalisation - the act of making formal (as by stating formal rules governing classes of expressions)
systematisation, systematization, rationalisation, rationalization - systematic organization; the act of organizing something . The use of software programmes is deemed to help to substantiate To establish the existence or truth of a particular fact through the use of competent evidence; to verify.
For example, an Eyewitness might be called by a party to a lawsuit to substantiate that party's testimony. the analysis and interpretation of textual interview data.
Keywords: Qualitative Research. Interviews. Trustworthiness * Reliability * Equivalence * Emic and Etic Emic and etic (also known as "nemic" and "netic" when used in an inter-cultural marketing context) are terms used by some in the social sciences and the behavioral sciences to refer to two different kinds of data concerning human behavior. Approaches
The International Business literature predominantly deals with an empirical and analytical research agenda. The focus is on quantitative methodologies, pursuing well-defined research problems with rigorous empirical investigations (Yang/Wang/Su 2006). We argue that research in International Business (IB) often deals with dynamic and volatile situations that demand creative and flexible research designs and methodologies (Ghauri/ Gronhaug 2005, McDonald 1985). Many scholars suggest exploratory research Exploratory research is a type of research conducted because a problem has not been clearly defined. Exploratory research helps determine the best research design, data collection method and selection of subjects. and qualitative methodologies to capture multi-dimensional phenomena (Anderson 1983, Yin 2003) and non-linear, sometimes fuzzy fuzz·y
adj. fuzz·i·er, fuzz·i·est
1. Covered with fuzz.
2. Of or resembling fuzz.
3. Not clear; indistinct: a fuzzy recollection of past events.
4. , patterns of our realities (Firat 1997, Sinkovics/ Penz/Ghauri 2005). These perspectives are supported by methodological arguments, that qualitative methodologies can help to find "meaning behind the numbers", provide flexibility without requiring large samples (Sykes 1990) and offer a clear and holistic view of the context (Denzin/Lincoln 1994, Ghauri/Gronhaug 2005, Ruyter/Scholl 1998). Moreover, driven by the globalisation of markets, production, and diverse business environments, there is an increasing emphasis on comparative empirical research Noun 1. empirical research - an empirical search for knowledge
inquiry, research, enquiry - a search for knowledge; "their pottery deserves more research than it has received" methodology (Cavusgil/Das 1997, Knight/Spreng/Yaprak 2003, Sekaran 1983). As a result, cross-national and/or cross-cultural perspectives which emerged in the psychological literature (e.g., Berry 1989, Pike 1966, Triandis/Berry 1980) were quickly adopted in other fields and extended to areas such as Management, International Business and Marketing (see e.g., Cavusgil/Das 1997, Peng/Peterson/Shyi 1991, Steenkamp/Baumgartner 1998, Earley/Singh 1995) (1). However, despite calls for more integrative research, and attempts to breaking down the 'positivist-epistomological' divide, the adoption of qualitative methodologies in IB is still scarce (Parkhe 1993, Peterson 2004, Yang/Wang/Su 2006). It is against this background that we endeavour to consider methodological issues for qualitative International Business research, particularly that building on text narratives from interviews.
Problem and Purpose
The literature offers a vast collection of methods for qualitative inquiry Qualitative Inquiry is an bi-monthly academic journal on qualitative research methodology. It focuses on methodological issues raised by qualitative research, rather than the research's content or results. References
tr.v. sys·tem·a·tized, sys·tem·a·tiz·ing, sys·tem·a·tiz·es
To formulate into or reduce to a system: "The aim of science is surely to amass and systematize knowledge" , regularize reg·u·lar·ize
tr.v. reg·u·lar·ized, reg·u·lar·iz·ing, reg·u·lar·iz·es
To make regular; cause to conform.
reg , and coordinate the work of observation, recording, and analysis (Ghauri/Gronhaug 2005, Miles 1979). This is particularly important in the International Business field, where coordinating multi-cultural research teams and integrating their joint efforts aggravates the challenges.
This paper is concerned with fundamental principles of research quality, particularly how to make qualitative research findings more trustworthy. Some researchers suggest the adoption of alternative terminology and procedures for the qualitative research process. Strictly speaking Adv. 1. strictly speaking - in actual fact; "properly speaking, they are not husband and wife"
properly speaking, to be precise , quantitative criteria such as objectivity and validity, are not deemed applicable to qualitative inquiry (Denzin/Lincoln 1994, Lincoln/Guba 1984). Hence, to establish "trustworthiness" of qualitative research, credibility, dependability, transferability and confirmability need to be established. The purpose of this paper is to suggest specific research strategies for dealing with qualitative data, especially data that stem from interviews. We advocate formalised procedures of gathering, analysing and interpreting qualitative data and discuss these issues in view of the emergence of computer assisted qualitative data analysis software (CAQDAS CAQDAS Computer Assisted Qualitative Data Analysis Software (UK networking project) ). Although formalisation and the aim to establish trustworthy research results does not necessarily presuppose pre·sup·pose
tr.v. pre·sup·posed, pre·sup·pos·ing, pre·sup·pos·es
1. To believe or suppose in advance.
2. To require or involve necessarily as an antecedent condition. See Synonyms at presume. CAQDAS, we maintain that its application enhances the trustworthiness and thus quality of qualitative inquiry. Out of a range of available CAQDAS packages, we decided to use N*Vivo. It not only helps researchers and managers in their pursuit to systematize and organise their work (Marshall 2001) but also offers group features (Richards 2000), which are particularly helpful in the coordination of IB research (Mangabeira/Armstrong/Sprokkereef 1996, Peterson 2004).
The contribution of this paper is on two levels. We contribute conceptually and methodologically, and the aim is to stimulate discussion in the field. We first develop a conceptual framework For the concept in aesthetics and art criticism, see .
A conceptual framework is used in research to outline possible courses of action or to present a preferred approach to a system analysis project. which links standards and stages in the analysis of interview-based data. We then exemplify ex·em·pli·fy
tr.v. ex·em·pli·fied, ex·em·pli·fy·ing, ex·em·pli·fies
a. To illustrate by example: exemplify an argument.
b. our conceptual and methodological thinking by introducing a project on knowledge management. Therein company managers from various international consulting companies communicate their views on practices and procedures of knowledge sharing and knowledge management.
Adopting Formal Criteria for Interview-based Qualitative IB Research
Qualitative research may include multiple methods such as, case studies, ethnography ethnography: see anthropology; ethnology.
Descriptive study of a particular human society. Contemporary ethnography is based almost entirely on fieldwork. and participant observation participant observation,
n a method of qualitative research in which the researcher understands the contex-tual meanings of an event or events through participating and observing as a subject in the research. , grounded theory, biographical and participative inquiries (Strauss/Corbin 1994). Within the field of qualitative IB research, the case study methodology is the most prevalent method (Pauwels/Matthyssens 2004). Similarly, there are a range of specific methods for collecting empirical material, such as interviewing, observational techniques, semiotic semiotic /se·mi·ot·ic/ (se?me-ot´ik)
1. pertaining to signs or symptoms.
2. pathognomonic. analysis etc. The analysis of text-based in-depth interviews is the most widely employed methodology for firm-level IB research, as published material in major journals (DuBois/Reeb 2000) such as, Journal of International Business Studies JIBS, the Journal of International Business Studies, (ISSN: 0047-2506, eISSN: 1478-6990) is the official publication of the Academy of International Business (AIB) and is published by Palgrave Macmillan. (JIBS JIBS Journal of International Business Studies (Academy of International Business)
JIBS JISC-assisted Bibliographic Dataservices ), Management International Review (MIR), Journal of World Business (JWB JWB Jewish Welfare Board (now Jewish Community Centers Association)
JWB John Wilkes Booth
JWB Johnny Walker Black (Whiskey brand)
JWB Jewelbox (C++ class library) ) and International Business Review (IBR IBR
see infectious bovine rhinotracheitis.
see infectious bovine rhinotracheitis/infectious pustular vulvovaginitis. ) reveals.
The Relevance of the Emic-Etic Discussion for Qualitative Research in International Business
IB research transcends political or cultural boundaries and therefore is inherently comparative in nature. A tension exists, however, regarding cross-cultural research traditions and the fundamental understanding of how to deal with comparative issues. Some scholars propose to work intensively within a single cultural context in order to discover and comprehend indigenous phenomena, while others advocate extensively research across cultures in order to produce results that are valid in international contexts (Berry 1989). The basic split in orientations to research stems from work in cross-cultural anthropology by linguist lin·guist
1. A person who speaks several languages fluently.
2. A specialist in linguistics.
[Latin lingua, language; see Kenneth Pike (1966) who coined the terms "emic" and "etic" using the suffixes of the terms phonemic pho·ne·mic
1. Of or relating to phonemes.
2. Of or relating to phonemics.
3. Serving to distinguish phonemes or distinctive features. and phonetic pho·net·ic
1. Of or relating to phonetics.
2. Representing the sounds of speech with a set of distinct symbols, each designating a single sound. . In linguistic analysis these terms distinguish sound structure, as analysed by a linguist (phonetics phonetics (fōnĕt`ĭks, fə–), study of the sounds of languages from three basic points of view. Phonetics studies speech sounds according to their production in the vocal organs (articulatory phonetics), their physical properties ), from the meaning of the sounds to the native speaker (phonemics pho·ne·mics
n. (used with a sing. verb)
The study and establishment of the phonemes of a language.
pho·nemi·cist n. ) (Morey/Luthans 1984, Pike 1966).
The "emic" and "etic" terms have since developed to denote de·note
tr.v. de·not·ed, de·not·ing, de·notes
1. To mark; indicate: a frown that denoted increasing impatience.
2. general research orientations which were long understood to be dichotomous di·chot·o·mous
1. Divided or dividing into two parts or classifications.
2. Characterized by dichotomy.
di·chot and contrasting views rather than equally applicable. Emic research centres on the native, that is, the insider's view of reality. Thus, the emic approach emphasises phenomena which occur in a particular culture by using only concepts employed in that culture (Buckley/Chapman 1997). Contrastingly, etic designates the orientation which is taken by outside researchers. Behaviours and phenomena are described using external criteria which are imposed by the researcher. While researchers adopting an emic approach may obtain a very accurate within-culture description, probably by employing qualitative techniques, they will not be able to compare emic-results obtained in one culture with emic-results from another culture. Emic research, which builds on subjectivist sub·jec·tiv·ism
1. The quality of being subjective.
a. The doctrine that all knowledge is restricted to the conscious self and its sensory states.
b. , idiographic id·i·o·graph·ic
Relating to or concerned with discrete or unique facts or events: History is an idiographic discipline, studying events that cannot be repeated.
Adj. 1. , qualitative and insider perspectives (Morey/Luthans 1984) suggests designs are not necessarily comparative in nature. Eric researchers, on the other hand, impose universal categories on their data and can, therefore, make comparisons (Davidson et al. 1976). This imposition of universal categories, however, may prove to be difficult because by choosing particular categories researchers might miss the most important aspects of the phenomena which they originally intended to study. The challenge to obtain observations that are both adequate within the cultural description of a phenomenon and that are cross-culturally comparable has been described as the emic-etic dilemma (Davidson et al. 1976).
The dilemma is more pronounced in cross-cultural research and attempts have been made to overcome the tension between these traditions. Conceptually, Berry's (1989) "imposed etics-emics-derived etics" operationalisation, which basically presents a sequence of reasonable and necessary research steps for intercultural research, provides a bridging link. Buckley/Chapman (1997), contribute to the debate by exploring the usefulness of 'native categories' in management research. By native they mean self-generated and valid in any local context. They suggest that in search for objectivity, western management studies have often overemphasised rational, positivist pos·i·tiv·ism
a. A doctrine contending that sense perceptions are the only admissible basis of human knowledge and precise thought.
b. perspectives. Contrasting interpretevist approaches, and thus native categories, can in fact be seen as vital steps towards adequate positivist research (Buckley/Chapman 1997). However, it appears as if theoretical discussion had failed to inform methodology and research practice (Lonner 1999). Therefore it is not surprising to learn from reviews of cross-cultural research that an overwhelming majority of published work (up to 93 percent) used "imposed-etic" designs (Jackson/Niblo 2003). This inevitably leads to ethnocentric eth·no·cen·trism
1. Belief in the superiority of one's own ethnic group.
2. Overriding concern with race.
eth cross-cultural comparisons and biases towards mostly Western perspectives. Moreover, while the conceptual underpinnings of the emic-etic dilemma relate equally well to quantitative and qualitative research, most of the work is effectively quantitative.
We argue that IB research should take more emic (i.e., subjectivist/ qualitative/ insider) perspectives, which then could be translated into etic (i.e., objectivist/quantitative/outsider) terms and used as valuable input for further studies. Both approaches are however, considered complementary to each other and provide essential building blocks for IB research. We strongly believe that advocating one approach over the other is not beneficial, rather a hindrance hin·drance
a. The act of hindering.
b. The condition of being hindered.
2. One that hinders; an impediment. See Synonyms at obstacle. to the development of the field.
Bias and Equivalence--Relevant Concepts in Qualitative Research
Building on the choice of location on the emic-etic continuum, qualitative research needs to further consider two closely related concepts, equivalence and bias (Poortinga 1989). From a conceptual perspective, these two concepts are on the opposite of two extremes. Measurements are considered equivalent when they are unbiased. A bias is therefore indicated by the presence of factors that challenge the validity of cross-cultural comparisons. Only when bias is absent and equivalent measures are present, we can compare scores, otherwise no useful comparison can be made (Brislin/Lonner/Thorndike 1973). Van de Vijver/Poortinga (1997) discuss three different biases and common causes for them, namely construct bias, method bias and item bias. (2) Construct bias can occur when there is an incomplete overlap of definitions of the construct across cultures. Measurement of this dimension by means of questionnaires or open-ended questions will therefore necessarily reveal different response patterns. Poor sampling of all the relevant behaviours may be another cause for construct bias. The Chinese Culture Connection (1987) for instance raised concern about the incorporation of Western psychological knowledge into non-Western systems. Their criticism was consecutively incorporated into Hofstede's cultural measure, by the inclusion of the "Confucian Dynamism" dimension, which reflects a dynamic, future-oriented mentality (Hofstede/Bond 1988).
Method bias may develop out of different social desirability levels or differential response styles such as extremity extremity /ex·trem·i·ty/ (eks-trem´i-te)
1. the distal or terminal portion of elongated or pointed structures.
1. scoring and acquiescence Conduct recognizing the existence of a transaction and intended to permit the transaction to be carried into effect; a tacit agreement; consent inferred from silence. . Hui/Triandis (1989) for instance found that Hispanics exhibit a stronger tendency for extreme checking on Likertscales than non-Hispanics. By drawing on this finding, it is suggested that individuals from different countries will demonstrate different response patterns in qualitative interview settings. Language proficiency Language proficiency or linguistic proficiency is the ability of an individual to speak or perform in an acquired language. As theories vary among pedagogues as to what constitutes proficiency, there is little consistency as to how different organisations and language dynamics of cross-cultural researchers is another pragmatic concern, especially in interview situations (Piekkari/Welch 2004).
What van de Vijver andPoortinga (1997) call 'item bias' refers to poor item translations or inadequate item formulation. For our purposes, this is more appropriately termed stimulus bias. Biases can be introduced by translating stimulus questions wrongly, inappropriate use of contextual explanations which might trigger different associations with the respondent and ultimately lead to fundamentally different response statements.
Salzberger, Sinkovics, and Schlegelmilch (1999) look specifically into the equivalence aspect. They present a conceptual model, which builds on Churchill and Iacobucci's (1995) hierarchical view of relationships and stages in the empirical research process. Four stages are identified, a) problem definition, b) data collection, c) data preparation and d) data analysis. Within each of these stages equivalence issues are pertinent and have to be addressed accordingly, in order to ensure comparability and consequently reliable and valid results. At the problem definition stage, equivalence of research topics represents the minimum requirement for meaningful comparisons across national or cultural borders. The international researcher needs to assess whether a phenomenon under investigation serves the same function in another cultural context.
At the data collection stage, qualitative researchers need to look into equivalence of research methods, research units and equivalence of research administration to rightfully contrast findings. Usually researchers will aim to collect the qualitative data in the same way, e.g. by means of face-to-face interviews or observational methods. Recent developments in marketing research for instance involve the computerisation of focus groups, whereby group members interact with each other using specially designed software, rather than using a moderator (Kiely 1998). However, while this approach may be well suited to tap into relevant focus group members in one country, this approach may be difficult to employ across borders due to technological and infrastructural differences (Craig/Douglas 2005) or language differences (Welch/Piekkari 2006).
As far as data preparation is concerned, measures to ensure equivalence involve the equal handling of qualitative interview response, systematic and standardised coding across all cross-cultural groups and the development of coherent code-sets which can be facilitated by the use of text-analysis programmes.
CAQDAS--Making Qualitative Analysis Qualitative Analysis
Securities analysis that uses subjective judgment based on nonquantifiable information, such as management expertise, industry cycles, strength of research and development, and labor relations. more Trustworthy
Many software tools are available for qualitative researchers, ranging from simple freeform text-storage and retrieval products such as askSAM, FileMaker Pro or text-counting and sorting packages such as TextPack PC (Zuell/Landmann/Geis 2002) to advanced and state-of-the-art systems such as Atlas.ti, C-I-SAID, Decision Explorer, Ethnograph, HyperResearch, N*Vivo, Nud*ist, MaxQDA and the open-source programme Weft-QDA. The latter products allow for the grouping and linking of concepts by building on features such as code-banks, master-lists and family trees This is an index of family trees available. It includes noble, politically important and royal families as well as fictional families and thematic diagrams. Europe
Many researchers express concerns related to the potential theoretical, political and methodological costs of computer use in qualitative research (Coffey/Holbrook/Atkinson 1996, Jack/Westwood 2006). There are also suggestions that the ease with which text can be coded in qualitative text analysis programmes and subsequently be incorporated into statistical software packages such as SPSS A statistical package from SPSS, Inc., Chicago (www.spss.com) that runs on PCs, most mainframes and minis and is used extensively in marketing research. It provides over 50 statistical processes, including regression analysis, correlation and analysis of variance. or SAS (1) (SAS Institute Inc., Cary, NC, www.sas.com) A software company that specializes in data warehousing and decision support software based on the SAS System. Founded in 1976, SAS is one of the world's largest privately held software companies. See SAS System. offers an inherent temptation to quantify qualitative research. Hesse-Biber (1996, p. 25) notes that qualitative research might be "colonized Colonized
This occurs when a microorganism is found on or in a person without causing a disease.
Mentioned in: Isolation " by the reliability and validity criteria of quantitative research Quantitative research
Use of advanced econometric and mathematical valuation models to identify the firms with the best possible prospectives. Antithesis of qualitative research. , therefore unleashing "Frankenstein's monster". This may give way to the "industrialisation" of the qualitative research process (Harbison/Myers 1959) where neopositivist methodology is suggested to be universally applicable. The epistemological e·pis·te·mol·o·gy
The branch of philosophy that studies the nature of knowledge, its presuppositions and foundations, and its extent and validity.
[Greek epist consequences of the adoption of such methods "that fit the requirements for objectivity, neutrality and the separation of subject and object" (Jack/Westwood 2006, p. 484) are suggested to lead to decontextualisation and a superficial attempt to legitimise Verb 1. legitimise - make legal; "Marijuana should be legalized"
decriminalise, decriminalize, legalise, legalize, legitimate, legitimatise, legitimatize, legitimize and depoliticise procedures that do not serve the qualitative research community well. As Jack and Westwood (2006) argue, "(Qualitative) research methods are not innocent: they are political" (Jack/Westwood 2006, p. 482). There is also concern that CAQDAS, by reinforcing and even inflating the tendency for the code-and-retrieve process that underpins most approaches to qualitative data analysis may result in the fragmentation of textual materials on which researchers work and it may detract de·tract
v. de·tract·ed, de·tract·ing, de·tracts
1. To draw or take away; divert: They could detract little from so solid an argument.
2. researchers from providing creative input (Bryman/Bell 2003, Burgess 1996, Fielding/Lee 1998).
We do not share these concerns and believe that the danger of methodological biases and distortions arising from the use of certain software packages is exaggerated (Kelle 1997). In fact, CAQDAS facilitates transparency in the dialogue between researcher and textual data, therefore improves confirmability through external audit (Maxwell 1997). We further support the idea that CAQDAS enhances creative views on data which by its very nature requires "flexibility, fluidity and continual renegotiation" (Easterby-Smith/Thorpe/ Lowe 2002). Nonetheless, while CAQDAS separates data organisation and researcher creativity, it ultimately increases creative freedom. Miles and Huberman (1994) argue that CAQDAS facilitates the organisation and analysis of large volumes of data, therefore potentially overcomes limitations and weaknesses associated with qualitative research. The use of CAQDAS thus formalises the way in which researchers can look at their textdata, thus reinforcing their methodological rigour rig·our
n. Chiefly British
Variant of rigor.
rigour or US rigor
This formalisation also serves as a mechanism to overcome anecdotalism in qualitative research (Silverman 1985). Some researchers have a tendency to use quotations from interview transcripts or field notes with little relationship to the prevalence of the underlying phenomenon which they are aiming to discuss. The formalised and collective bargaining collective bargaining, in labor relations, procedure whereby an employer or employers agree to discuss the conditions of work by bargaining with representatives of the employees, usually a labor union. between multiple, international researchers not only makes coding and retrieval much faster and more efficient, it also enhances the transparency of the process of conducting qualitative data analysis and supports theory building, which transcends beyond descriptive-interpretative research.
An important operational issue which exemplifies this point is pertinent in the efforts involved to coordinate multi-lingual research teams. Mangabeira, Armstrong, and Sprookkereef (1996) argue that teams working on a project may experience problems and challenges in coordinating the coding of text when different people are involved in this activity. However, some analysis software such as N*Vivo offer appropriate features to cope with the international dimension of research. It also features a software supplement that allows text merging (Richards 2000). Hence, research teams can merge their work and continue analysis in the combined project or ask questions across the whole merged project.
Overall, it is argued that the use of CAQDAS such as N*Vivo provides procedural advantages compared to traditional means of text analysis and ultimately helps in the formalisation of processes which contribute to more reliable research findings. While evidently there are tremendous advantages in the management of textual data and record keeping, the major contribution of CAQDAS is the application of standards, coding and searching procedures (King/Keohane/Verba 1994).
Adopting Formal Criteria for Qualitative Research
The traditional concepts of reliability and validity are universally accepted as playing key roles in the evaluation of rigour in research (Nunnally 1978). Quantitative researchers devote much of their attention to these fundamental concerns of research in their empirical examination. However, reliability and validity have a somewhat uncertain place in the repertoire of the qualitative methodologist (Armstrong et al. 1997). Some researchers argue that these dimensions are grounded on a different paradigmatic See paradigm. view and are therefore not directly applicable to qualitative research. This perspective has not always served the qualitative research community well because certain qualitative research has proven inefficient and the uncertainty regarding the validity standards has inhibited clear evaluation of merits and achievements of well-done qualitative research (Borman/LeCompte/ Goetz 1986).
Against this background, some have sought to apply the concepts of reliability and validity to the practice of undertaking qualitative research (Kirk/Miller 1986, LeCompte/ Goetz 1982, Lincoln/Guba 1984, Denzin 1994) and have proposed to use alternative terms and ways of assessing qualitative research, such as credibility, transferability, dependability and confirmability. Credibility is defined by Guba and Lincoln (1989) as being parallel to internal validity Internal validity is a form of experimental validity . An experiment is said to possess internal validity if it properly demonstrates a causal relation between two variables  . . It focuses on establishing a match between the constructed realities of respondents and those realities represented by the researcher(s). Transferability is considered parallel to external validity External validity is a form of experimental validity. An experiment is said to possess external validity if the experiment’s results hold across different experimental settings, procedures and participants. or generalisability in quantitative research. It depends on the degree to which salient conditions overlap or match (Crawford/Leybourne/Arnott 2000). Dependability is a criterion which is considered equivalent to reliability and similarly concerned with the stability of the results over time. Confirmability is what objectivity is to quantitative research. Researchers need to demonstrate that their data and the interpretations drawn from it are rooted in circumstances and conditions outside from researchers' own imagination and are coherent and logically assembled (Ghauri 2004).
Ultimately, the issue of validity in qualitative research "is ... a question of whether the researcher sees what he or she thinks or thinks what he or she sees" (Kirk/Miller 1986) so that there is evidence in the data which describes clearly how the data were interpreted. Good scientific research requires explicit, codified cod·i·fy
tr.v. cod·i·fied, cod·i·fy·ing, cod·i·fies
1. To reduce to a code: codify laws.
2. To arrange or systematize. , and public methods to generate and analyse data (Merton 1949). This is "truism" to quantitative research but is equally important for qualitative research: The procedures and methods applied are meant to be public. If the method and logic of a researcher's observations and inferences are left implicit, the scholarly community has no way of judging the validity of what was done. Learning from applied methods or attempts to arrive at similar results requires transparent processes (King/Keohane/Verba 1994).
Table 1 below builds on these discussions and offers a framework for enhancing the quality of International Business Research. The rows of the table represent commonly acknowledged stages in a research process (see e.g., Churchill/Iacobucci 2005, Ghauri/ Gronhaug 2005, Lee 1999, Salzberger/Sinkovics/Schlegelmilch 1999, Yin 2003), the columns point out standards and schemes (Potter 1996) which need to be addressed to enhance quality. Lee (1999, p. 146) argues that "the ideas of reliability and validity apply equally well to both [qualitative and quantitative research]". This is why we use both the traditional terminology and the terms (credibility, dependability, transferability and confirmability) proposed by Guba and Lincoln (1989) and Denzin 1994. Our argument also holds that programs such as N*Vivo can in fact help to add rigour to the qualitative research process. This corresponds to the thinking of e.g. Richards and Richards (1994), although others have critically disputed the use of computers (see e.g. Marshall 2001 for a good review of the arguments of CAQDAS as rigorous or rigid tools). The rightmost right·most
Farthest to the right: in the rightmost lane of the highway.
Adj. 1. rightmost - farthest to the right; "in the rightmost line of traffic" column in Table 1 focuses on the outcome, the research report. By making the analytic logic transparent and addressing the issues listed in the research report, we will greatly enhance the research outcome and trust and confidence in its findings.
To develop our discussions further, we use an empirical example from a knowledge-management study. N*Vivo software Vivo Software was a pioneer internet streaming media company which was acquired by RealNetworks in March 1998. Vivo Software designed the Vivo Video/Audio platform, including its encoding tools and end-user VivoActive Player. is used to guide the discussion of rigour and quality issues in an international context. The section headings follow the conceptual discussion in Table 1, enriched with results from the empirical knowledge management context.
"Getting started"--Conceptual Context for the Practical N*Vivo Application
We deem the knowledge management study provides a timely and appropriate context for highlighting rigour and trustworthiness issues in international business research. With respect to credibility and confirmability our study embarked on established theories and leading literature in the field. Knowledge management as a topic of managerial decision making has become increasingly popular for international companies (e.g., Bennett/Gabriel 1999, Buckley/Carter 2000, 2002, Mudambi 2002). The role of knowledge resources in developing and maintaining competitive advantages have been addressed in the literature (see e.g., Davenport/Prusak 1998, De Geus 1988, Kim 1993, Prahalad/Hamel 1990, Stata 1990), so have the flows and transfer of knowledge within multinationals (e.g., Foss/Pedersen 2002). Particularly, key references on knowledge management (e.g., Bennett/Gabriel 1999, Buckley/Carter 2000, 2002, Mudambi 2002), human resource management and motivational aspects (e.g., Hislop 2003, Kim 1993, MacNeil 2003) with regard to 'knowledge workers' were included to gain further insight (Ardichvili/Page/ Wentling 2003, Kubo/Saka 2002, Osterloh/Frey 2000, Osterloh/Frost/Frey 2002, Smith/ Rupp 2003). However, with respect to the individual level of knowledge management, there is a shortage of empirical work on employees' willingness to share knowledge. Touching the issue of transferability, we emphasize that the concept of knowledge sharing needs to be studied in more depth and width. We start by assuming that the issue of knowledge sharing is related to the mechanics of interpersonal relations between managers and employees. The way in which managers and employees interact, the specific organisational and environmental context as well as social factors will impact on knowledge sharing. For firms, such as IT consultancies, where knowledge, knowledge-sharing and its' dissemination are crucial, management targets behaviour indirectly through norms, values, and culture. These are dependent on social relations, identity formation and ideology and not the behaviour of employees itself, therefore it is hard to measure the output of such management styles (Hislop 2003, Karreman/Alvesson 2004). It is commonly agreed that the success of knowledge management rests on the willingness of employees to share their knowledge. However, people demonstrate an inherent resistance to it (Hislop 2003).
The empirical part of this study addresses this gap in research on knowledge-management and interpersonal relations and practically applies conceptual and methodological considerations on qualitative IB research. A knowledge-based industry context is chosen to empirically investigate the company-manager-employee interactions where a socio-ideological form of control is expected to manage the so-called knowledge-worker.
Research Design and Development of Research Questions
In order to facilitate the evaluation of the empirical grounding and credibility of our qualitative study we followed Corbin/Strauss' grounded theory approach (1990, 1998) as a general methodological road map. They suggest canons, procedures, and evaluative criteria for research trigger a dynamic, yet interrelated in·ter·re·late
tr. & intr.v. in·ter·re·lat·ed, in·ter·re·lat·ing, in·ter·re·lates
To place in or come into mutual relationship.
in process of data collection and analysis. This process harmonizes well with our goal to inductively in·duc·tive
1. Of, relating to, or using logical induction: inductive reasoning.
2. Electricity Of or arising from inductance: inductive reactance. explore the interpersonal relationships in MNC's knowledge sharing without relying on established theoretical assumptions about knowledge sharing.
The grounded theory approach fits well into CAQDAS as N*Vivo supports "[...] new modes of interaction and organization using methodology that is attentive to issues of interpretation and a process not binding itself too closely to longstanding assumptions" (Suddaby 2006, p. 633). The software is furthermore beneficial in terms of storing and organising a lot of data in different formats and sizes. It enables creative and informed discussion among involved researchers with different cultural backgrounds.
Appropriate research questions were formulated to guide the research process and care was taken to control for research bias3 The following research questions were developed from existing research on knowledge management and interpersonal relations:
* What are managers' perspectives of knowledge management in international companies?
* How does the relation between manager/s and employee/s shape the management of knowledge? How do managers deal with motivation, rewards and mistakes?
* What is the relation between the company (its culture, goals, etc.) and its human capital (managers, employees), as perceived by the managers?
Sample and Context
We concentrated on textual data which were collected through semi-structured interviews, observations, and company information. Initially, two companies were selected and studied. At the outset three managers from two international consulting companies were approached via telephone or personally to participate in the project (contributes to confirmability). The companies were selected on the basis of size, geography (4) and their core businesses. Particular attention was given to international companies with a foothold foot·hold
1. A place providing support for the foot in climbing or standing.
2. A firm or secure position that provides a base for further advancement.
1. in more than two technology markets, as their extended geographical reach suggested the implementation of certain procedures regarding knowledge management.
External validity was assessed by contrasting manager response from different company sectors. According to according to
1. As stated or indicated by; on the authority of: according to historians.
2. In keeping with: according to instructions.
3. the emerging theory, additional samples were selected (six managers in four companies) and studied in order to confirm or disconfirm aspects and conditions under which the model holds by making use of theoretical sampling, "which means that the investigator examines individuals who can contribute to the evolving theory" (Creswell 1997, p. 155). Subsequent interviews were therefore conducted with managers in similar companies (all consultancies) with complementing background. In order to strengthen credibility, we followed a theoretical sampling approach, and further companies were added to the interview list to probe for differences. One Italian manager from a non-technology based consultancy was interviewed because it was expected that his view on the relational aspect of knowledge management would differ. Overall, to report on dependability, nine interviews were conducted involving companies in three different countries, four Austrian, two Italian and three German companies.
To ensure functional and conceptual equivalence, we had to find out whether knowledge management served the same function in the companies. Therefore, information about the target companies (e.g., from their websites, international subsidiaries, media releases and presence at events on knowledge management, including their international subsidiaries) was collected and analysed regarding their understanding and application of knowledge management. This aspect was also considered in the data collection stage: the interview guideline began with a question on how knowledge management was seen in the company and what it involved. While all three managers from the same consultancy talked about information, the others used the term knowledge. The storage of information and knowledge enabled the support of employees and the creation of contacts among them. To sum up, the concept was understood and defined very similar, slight differences were due to the responsibilities of the respective managers and the overall area of business. When developing the measurement instrument, its validity, i.e. the usefulness of the instrument (Nunnally 1978) was a concern. Practically, before applying the interview guideline we tested it by interviewing managers in two countries (Austria and Italy) and established construct validity construct validity,
n the degree to which an experimentally-determined definition matches the theoretical definition. (credibility).
With respect to data collection we standardised the process in such a way that equivalence of research methods, units and administration was ensured. Cross-cultural issues were discussed in two extensive training meetings and it was felt that the interviewers were satisfactorily equipped with the knowledge needed. Interviewers were informed about the managers' background and position within the company (Welch et al. 2002) and in terms of lingual lingual /lin·gual/ (ling´gwal)
1. pertaining to or near the tongue.
2. in dental anatomy, facing the tongue or oral cavity.
1. aspects (Marschan-PiekkariAVelch/Welch 1999). A laddering-type interview process (Grunert/Grunert 1995) was encouraged to facilitate the clarification of issues, verification of interpretations of answers during the interview, and persistence in following up on emerging topics and themes arising during the interview (Arksey/Knight 1999, Kvale 1996, Lee 1999, Rubin 1995, Strauss/Corbin 1998).
Interviews took place from March 2003 to March 2004. Respondents were recruited from top and middle management and were responsible for knowledge management. With respect to the physical context, this was standardised to the managers' offices, and the interviews lasted between one and two hours each. English, German and Italian was used. In order to guarantee dependability (repeatability), a protocol was followed. Data were digitized, tape recorded and transcribed in their original language. Additionally, each interviewer provided a short summary of the interview in English as separate document (chain of evidence).
Specific Steps and Questions in Data Collection
Three proposed tactics were applied in order to guarantee construct validity (Lee 1999), namely (1) multiple sources of evidence, (2) chain of evidence, and (3) feedback to key informants (Yin 2003).
1) Multiple sources of evidence: Interviewees' comments, observations of the interview setting, and contextual factors (physical factors such as building, entrance, etc.) were noted. The infrastructure of the office was observed, taking note of the behaviour of employees within the building. Visual materials, such as advertisements, rules and regulations for employees on the respective company websites and so on were also included in the analysis. Using all these multiple sources of evidence increased the construct validity. In addition, researchers used memos to document the relevance of the collected information to the overall research question. Each researcher was instructed to rate the sources according to the concept being studied. Then the comments were discussed and a common rating of the used operational measures was established.
2) Establish chain of evidence: As suggested by (Yin 2003) and Lee (1999), a "chain of evidence" was applied to establish construct validity, i.e. assuring a logical, sequential process which can be reconstructed and anticipated by an external audit. (a) When selecting companies, researchers were advised to make field notes about the contact situation, e.g. how many times had he/she to call to talk to the manager, how were the atmosphere and the first impression, scheduling the interview. (b) Then interviews were conducted and transcripts prepared in the original languages (English, German, and Italian). The interviewers continued to write memos about the visits which later on were linked to the initial observations. (c) The observations of the researchers were an important part of the project, since they helped in developing an idea about the relationship between managers and employees even before the interviewees' answers were analysed. Hence, multiple elements of information converged and indicated high construct validity.
3) The third tactic in establishing a chain of evidence was to let key informants review preliminary reports and observations of the researchers. Researchers were guided through the analytical schemes by a protocol as suggested by Yin (2003) which increased the dependability of the study and facilitated repeatability of procedures. It was developed by the researcher team using N*Vivo's modelling and memo function (programming) memo function - (Or "memoised function") A function that remembers which arguments it has been called with and the result returned and, if called with the same arguments again, returns the result from its memory rather than recalculating it. and included study objectives, specific procedures and interview guidelines. Later, the memo was used as a rough guide for the documentation of researchers' experience in the field.
The data analysis processes involved formalized for·mal·ize
tr.v. for·mal·ized, for·mal·iz·ing, for·mal·iz·es
1. To give a definite form or shape to.
a. To make formal.
b. steps of (i) organising, (ii) coding (data reduction), (iii) searching, and (iv) modelling and interpretation.
(i) Organising steps. In N*vivo a new project was created, including rich textual material from the nine in-depth interviews in original language, written observations as recorded by the interviewers and company information. Visual material such as company pictures and ads--illustrative examples of company culture--were also included. Three researchers formed the core team of analysts, each one a native speaker in one of the used languages (English, German, and Italian). However, all of them were also knowledgeable about the other two languages which was important to develop a common coding scheme.
One additional interview with an Italian company was conducted to allow for intracountry comparisons regarding specific questions such as the relation between managers and their employees. This procedure also enabled validity checks and served as indicator of transferability. Section attributes were used within N*Vivo to organise company characteristics (see multiple sources of evidence in section 0 above). Hence, quantitative information was included on top of qualitative data, which provided overall insights into company background and organisational structure.
(ii) Coding (data reduction). Collected data was subsequently coded, which was probably the most crucial step in the analytical process. The coding process is an ongoing interpretation and examination of textual data from different perspectives. It is dependent on the number of researchers involved. Figure 1 illustrates the coding process for the multinational researchers involving English, German, and Italian language Italian language, member of the Romance group of the Italic subfamily of the Indo-European family of languages (see Romance languages). The official language of Italy and San Marino, and one of the official languages of Switzerland, Italian is spoken by about 58 .
Two coding strategies were used: (a) a-priori and (b) a-posteriori categorisation of data. We started out with a-priori categorisation which concerned the development of English categories prior to actual data collection, based on theory, literature and exploratory interviews. A-posteriori categorisation was involved subsequent to the data collection in Austria, Germany and Italy. Empirical indicators were developed based on the multilingual data and uses in subsequent analysis stages.
Interview languages were retained, as well as initial codes. As illustrated in Figure 1, the coding process started off with the team of three researchers, each of them being fluent in a different language (English, German, and Italian). However, the codes were later transformed and merged into English (see Figure 1), as the common analysis language. This facilitated further analysis and comparability. Also, this augmented reliability because categorisation decisions were discussed in English, a language that fit all researchers and participants in the project. The derived categorisation scheme was continually monitored and updated with the co-analysts. This derived "eric" approach safeguarded against the danger of a purely uniform coding scheme and facilitated the identification of country specificities and equivalence of data.
Decisions about the size of the node system required us to find a balance between breadth and depth. The node system is a function of the stage of the research process and evolves over time (Marshall 2002). Hence, each text-section was analysed with more scrutiny, following (a) open, (b) axial axial /ax·i·al/ (ak´se-al) of or pertaining to the axis of a structure or part.
1. Relating to or characterized by an axis; axile.
2. and (c) selective coding processes, as suggested in the literature (Miles/Huberman 1994). Open coding is usually used for the discovery of categories and the identification of new concepts. In this stage of the categorisation process, each researcher freely added categories which were discussed in a meeting afterwards. About 130 nodes were created initially by open coding. Axial coding Axial coding is the disaggregation of core themes during qualitative data analysis. References
Gatrell, A.C. (2002) Geographies of Health: an Introduction, Oxford: Blackwell. applies categories and concepts to empirical data. Here, categories are related to their subcategories and intersections of related categories are identified. The objective of axial coding is to add depth to categories. As a result, nodes which expressed the same concepts were merged and the number of main nodes and sub nodes was reduced to eight nodes. (5) Finally, (c) selective coding, the process where categories are integrated and refined in order to build a theory, was applied. Therein concepts were established and statements used to explain the phenomenon of interest. The textual-data was reduced and, as suggested by Lee (1999) or Strauss and Corbin (1998) a desirable level of abstraction The level of complexity by which a system is viewed. The higher the level, the less detail. The lower the level, the more detail. The highest level of abstraction is the single system itself. was reached for our research.
[FIGURE 1 OMITTED]
The next step was to theorise Verb 1. theorise - to believe especially on uncertain or tentative grounds; "Scientists supposed that large dinosaurs lived in swamps"
hypothesise, hypothesize, speculate, conjecture, theorize, hypothecate, suppose about the content by (iii) search processes. N*Vivo enables researchers to trigger virtually unlimited searches. The software responds immediately with those text sequences which are related to the keywords. Our study was geared towards the company manager and employee relation and aimed to examine managers' perceptions regarding knowledge management. Consequently, we used N*Vivo's search function to examine nodes such as "importance of employee", "communication", "utility of knowledge", etc. We also generated matrix intersections of different nodes and companies and displayed results as nodes.
Note: Codes for the rows are 1=E-Business, 2=Consulting, 3=Electronic Equipment, 4=Computer; first column displays the nodes ("building up networks", etc.). Numbers in the cells indicate number of node identified.
All documents were included into the analysis and the results were displayed as a node. Figure 2 shows the number of documents in which the nodes were found, separated into the four fields (1 = E-Business, 2 = Consulting, 3 = Electronic Equipment, 4 = Computer). In addition, the number of characters coded or coding references can be displayed. Areas with high frequencies are automatically highlighted. For companies specialising in E-Business, network-building was seen a crucial element for knowledge management. Consulting companies stressed the importance of harvesting employees' knowledge and diffusing it within the organisation.
N*Vivo search results were also used to export frequency and response tables into SPSS, thus enabling simple descriptive analysis and further formalising structural results from the data. Searches and matrix intersections were also used to explore cross-country differences. Results revealed that only for one Italian consultant the issues 'knowledge management' and 'team orientation' were linked together. His response highlighted issues such as his company being a 'people's company', a 'spirit of togetherness' within the company and the notion that 'closer alignment with the international goals' might threaten to make the workplace 'less enjoyable'. In all the other statements, knowledge management was closely linked to issues of organisational structure, 'flat hierarchy' and the conflict between 'technicians and management'. It appeared that these perspectives, although probably limited in their generality gen·er·al·i·ty
n. pl. gen·er·al·i·ties
1. The state or quality of being general.
2. An observation or principle having general application; a generalization.
3. , pointed out differences pertaining per·tain
intr.v. per·tained, per·tain·ing, per·tains
1. To have reference; relate: evidence that pertains to the accident.
2. to the different national contexts involved in the study.
[FIGURE 2 OMITTED]
The final step in the N*Vivo analysis helped in the interpretation and building of models (iv) using documents, nodes, attributes and memos (see Figure 3). This helped the generation of nodes and facilitated the visual construction of a nodal system. Furthermore it assisted in the development of a categorisation scheme which could be used in the subsequent coding process. Modelling was also instrumental for the conceptualisation (artificial intelligence) conceptualisation - The collection of objects, concepts and other entities that are assumed to exist in some area of interest and the relationships that hold among them. of ideas that arose during the ongoing coding and search process. Modelling helped to design the project and helped in graphical exploration of the research process. Finally, visual representation helped to overcome codification The collection and systematic arrangement, usually by subject, of the laws of a state or country, or the statutory provisions, rules, and regulations that govern a specific area or subject of law or practice. or language problems within the researcher team. Models in N*Vivo were "living organisms", i.e. evolving, continually changing, refined by the researcher and updated according to the research progress.
Note: Bullet points refer to the nodes of the node system. Lines between the nodes indicate relations which were drawn by the research team after discussing the node system. Numbers in brackets refer to the organisation of the node in the node system
In finishing the six-step qualitative research process (see Table 1) we conclude that researchers' interpretation of the interpersonal relationships between managers and employees confirms existing knowledge. Knowledge sharing is part of the management of knowledge in international companies. Most managers see knowledge management as a means of 'storing information'. Although this perspective was confirmed in our study, the analysis also points to the overarching o·ver·arch·ing
1. Forming an arch overhead or above: overarching branches.
2. Extending over or throughout: "I am not sure whether the missing ingredient . . . importance of the relational dimension.
[FIGURE 3 OMITTED]
Relationship dynamics between managers and subordinates determines the amount and level of knowledge "sharing". Technical awareness is considered a pre-requisite to make useful contributions to knowledge management systems. However, given that, relationships between employees can be facilitated, the development of informal networks between colleagues assisted and communication enhanced. In consultancies, some managers view employees as "group of actors" who have to be controlled and should come together to solve problems. Conversely con·verse 1
intr.v. con·versed, con·vers·ing, con·vers·es
1. To engage in a spoken exchange of thoughts, ideas, or feelings; talk. See Synonyms at speak.
2. , managers in electronic equipment/computer companies wanted their employees to be supported by the knowledge-management system.
Overall, no best way of dealing with knowledge and its' management could be identified. The management of knowledge depends strongly on the culture of the company (MNC MNC
See: Multinational corporation ), the cultures within which the individuals lead their lives and the way people in a company interact with each other. To account for these issues, cultural differences and similarities were integrated in the research process. Practically this was relevant in the way managers were approached and how they reacted to the questions. The study also revealed that Austrian and Italian managers tend to think more in terms of flat organisations and not so much about controlling employees by means of knowledge management. In their view, workplace should be enjoyable and knowledge management could support that.
The grounded theory-driven approach and the use of computer software helped in three ways: (a) To convert tacit/implicit knowledge of researchers undertaking the interviews into explicit knowledge Explicit knowledge is knowledge that has been or can be articulated, codified, and stored in certain media. It can be readily transmitted to others. The most common forms of explicit knowledge are manuals, documents and procedures. Knowledge also can be audio-visual. , which could be recorded, transcribed and analysed, (b) to convert explicit knowledge such as hierarchical dimensions in organisations and sector-differences (known from the outset of interviews) into implicit knowledge, exploited within the dynamic interview situation. Finally, (c) the continuous and updated dialogue between researchers, their analysis and their data (Strauss/Corbin 1994) helped to solidify so·lid·i·fy
v. so·lid·i·fied, so·lid·i·fy·ing, so·lid·i·fies
1. To make solid, compact, or hard.
2. To make strong or united.
v.intr. qualitative procedures and improve their overall trustworthiness and quality.
Conclusions and Future Outlook
Qualitative International Business research deals with interactions of geographically dispersed dis·perse
v. dis·persed, dis·pers·ing, dis·pers·es
a. To drive off or scatter in different directions: The police dispersed the crowd.
b. organisations and consumers. The age of globalisation and the advent of technological innovation implicate im·pli·cate
tr.v. im·pli·cat·ed, im·pli·cat·ing, im·pli·cates
1. To involve or connect intimately or incriminatingly: evidence that implicates others in the plot.
2. tremendous challenges for researchers and practitioners. Given fundamentally different methodological and conceptual paradigms for International Business compared to "domestic" management studies, it is not surprising that established and structured methodologies and practices have not always been applied successfully (McDonald 1985). To this end, quality concerns regarding high levels of subjectivity and low reliability are understandable and have contributed to a somewhat sluggish adoption of qualitative methodologies in the field. However, the criticism is mostly due to "good housekeeping Good Housekeeping is a women's magazine owned by the Hearst Corporation, featuring articles about women's interests, product testing by The Good Housekeeping Institute, recipes, diet, health as well as literary articles. " (Marshall 2001) which we believe can easily be overcome.
In this paper we proposed a framework of quality standards, which should be addressed during the qualitative research process, particularly during the analysis process of textual data. If properly adhering to concerns of credibility/validity, dependability/reliability, transferability/generalisability and confirmability/objectivity during the six-stage qualitative research process, analysts' inherent analytic logic will become transparent and their research reports will gain substance in quality and trustworthiness. To this end, by following formalised procedures of organising textual analysis, addressing specific challenges of IB research such as biases and equivalence, it is possible to overcome criticism against qualitative research and in fact promote more qualitative research in International Business.
The use of software programmes (e.g. N*Vivo) which is considered by some researchers to inhibit creativity and colonize col·o·nize
v. col·o·nized, col·o·niz·ing, col·o·niz·es
1. To form or establish a colony or colonies in.
2. To migrate to and settle in; occupy as a colony.
3. qualitative research with rigorous criteria of quantitative research (Hesse-Biber 1996), is not seen as a danger. Contrastingly, we argue that computer software helps and supports researchers in the analytical process of coding and analysing textual data, makes data easily accessible to collaborators and thus strengthens credibility, replicability and substance of research results. Lee (1999) and Yin (2003) both encourage the use of good protocols to substantiate qualitative research. The framework in this paper adds to their arguments and is specifically concerned with logic and transparent documentation of the research report (see Table 1).
The empirical context which is provided in the paper relates to an ongoing study on knowledge management. Given that the purpose of this paper was to have a discussion on a methodological level, the documentation of this particular project has been truncated truncated adjective Shortened and data analysis only provided to illustrate methodological considerations. Notwithstanding this limitation we promote the idea that formalised processes have the potential to make qualitative inquiry of textual data more logical, transparent and trustworthy.
In our example demonstrated that CAQDAS such as N*Vivo is able to store big amount of data and facilitates transparency of the research process. Interview-based texts and any other textual and non-textual material can be made available for a multi-lingual, multi-cultural research team. Existing material can be incorporated easily and provides a comprehensive basis for search queries. Aspects which might be not relevant at first glance are stored together with the raw data which increases comparability of data. From an international view N*Vivo helps to understand the research contexts from where the data originated, because both the original language but also the derived interpretation system are retained. The use of protocols and memos by researchers supports the process by facilitating constructive discussion and interpretation. N*Vivo offers options to organise textual data in a transparent way; it offers outline views and highlighting options. To this end, there is the potential for unexpected insights which may emerge from re-contextualising material and a live computer-facilitated dialogue with the node system, codes and search processes.
Future research and any attempts to push the frontiers of knowledge, largely depend on replications of research in other contexts under similar and/or different circumstances. We hope therefore that enhanced qualitative International Business research will encourage other researchers to build on existing qualitative research methodologies, extend original findings and finally bridge the traditional qualitative-quantitative divide.
Manuscript Received: June 2006 / Revised: July 2007 / Final revision received: June 2008
Armstrong, D. et al., The Place of Inter-Rater Reliability in Qualitative Research: An Empirical Study, Sociology, 31, 3, 1997, pp. 597-616.
Bennett, R./Gabriel, H., Organisational Factors and Knowledge Management within Large Marketing Departements: An Empirical Study, Journal of Knowledge Management, 3, 3, 1999, pp. 212-225.
Berry, J. W., Imposed Etics-Emics-Derived Etics: The Operationalization of a Compelling Idea, International Journal of Psychology, 24, 6, 1989, pp. 721-735.
Borman, K. M./LeCompte, M. D./Goetz, J. P., Ethnographic eth·nog·ra·phy
The branch of anthropology that deals with the scientific description of specific human cultures.
eth·nog and Qualitative Research Design and Why It Doesn't Work, American Behavioral Scientist, 30, 1, 1986, pp. 42-57.
Brislin, R. W./Lonner, W. J./Thorndike, R. H., Cross Cultural Research Methods, New York New York, state, United States
New York, Middle Atlantic state of the United States. It is bordered by Vermont, Massachusetts, Connecticut, and the Atlantic Ocean (E), New Jersey and Pennsylvania (S), Lakes Erie and Ontario and the Canadian province of : John Wiley John Wiley may refer to:
Buckley, P. J./Carter, MJ., Knowledge Management in Global Technology Markets: Applying Theory to Practice, Long Range Planning To comply with Wikipedia's , the introduction of this article needs a complete rewrite. , 33, 1, 2000, pp. 55-71.
Buckley, P. J./Carter, M. J., Process and Structure in Knowledge Management Practices of British and US Multinational Enterprises, Journal of International Management, 8, 1, 2002, pp. 29-48.
Buckley, P. J./Chapman, M., The Use of Native Categories in Management Research, British Journal of Management, 8, 4, 1997, pp. 283-299.
Chinese Culture Connection, Chinese Values and the Search for Culture-Free Dimensions of Culture, Journal of Cross-Cultural Psychology The references in this article would be clearer with a different and/or consistent style of citation, footnoting or external linking.
Cross-cultural psychology , 18, 2, 1987, pp. 149-164.
Churchill, G. A. Jr., Marketing Research: Methodological Foundations, 7th ed., Fort Worth: The Dryden Press 1995.
Corbin, J./Strauss, A., Grounded Theory Research: Procedures, Canons, and Evaluative Criteria, Qualitative Sociology Qualitative Sociology is an academic journal dealing with sociology. It publishes research papers on the qualitative interpretation of social life. This includes photographic studies, historical analysis, comparative analysis, and ethnography. , 13, 1, 1990, pp. 3-21.
Craig, C. S./Douglas, S. P., International Marketing Research, 3rd ed., Chichester: John Wiley & Sons 2005.
Crawford, H. K./Leybourne, M. L./Arnott, A., How We Ensured Rigour in a Multi-Site, Multi-Discipline, Multi-Researcher Study, Forum: Qualitative Social Research, 1, 1, 2000, http://www.qualitative-research.net/ fqs-texte/1-00/01-00crawfordetal-e.pdf.
Creswell, J. W., Qualitative Inquiry and Research Design: Choosing among Five Traditions, London: Sage Publications This article or section needs sources or references that appear in reliable, third-party publications. Alone, primary sources and sources affiliated with the subject of this article are not sufficient for an accurate encyclopedia article. 1997.
Davidson, A. R. et al., Cross-Cultural Model Testing: Toward a Solution of the Etic-Emic Dilemma, International Journal of Psychology, 11, 1, 1976, pp. 1-13.
Denzin, N. K./Lincoln, Y. S. (eds.), Handbook of Qualitative Research, Thousand Oaks Thousand Oaks, residential city (1990 pop. 104,352), Ventura co., S Calif., in a farm area; inc. 1964. Avocados, citrus, vegetables, strawberries, and nursery products are grown. : Sage Publications 1994.
DuBois, F. L./Reeb, D., Ranking the International Business Journals, Journal of International Business Studies, 31, 4, 2000, pp. 689-704.
Earley, P. C./Singh, H., International and Intercultural Management Research: What's Next?, Academy of Management Journal, 38, 2, 1995, pp. 327-340.
Easterby-Smith, M./Thorpe, R./Lowe, A., Management Research: An Introduction, Sage Series in Management Research, 2nd ed., London: Sage Publications 2002.
Foss, N. J./Pedersen, T., Transferring Knowledge in MNCs: The Role of Sources of Subsidiary Knowledge and Organizational Context, Journal of International Management, 8, 1, 2002, pp. 49-47.
Ghauri, P. N., Designing and Conducting Case Studies in International Business Research, in Marschan-Piekkari, R./Welch, C. (eds.), Handbook of Qualitative Research Methods for International Business, Cheltenham: Edward Elgar Sir Edward William Elgar, 1st Baronet, OM, GCVO (2 June 1857 – 23 February 1934) was an English Romantic composer. Several of his first major orchestral works, including the Enigma Variations and the Pomp and Circumstance Marches, were greeted with acclaim. 2004, pp. 109-124.
Ghauri, P. N./Gronhaug, K., Research Methods in Business Studies: A Practical Guide, 3rd ed., London: Financial Times Prentice Hall Prentice Hall is a leading educational publisher. It is an imprint of Pearson Education, Inc., based in Upper Saddle River, New Jersey, USA. Prentice Hall publishes print and digital content for the 6-12 and higher education market. History
In 1913, law professor Dr. 2005.
Grunert, K. G./Grunert, S. C., Measuring Subjective Meaning Structures by the Laddering Method: Theoretical Considerations and Methodological Problems, International Journal of Research in Marketing, 12, 3, 1995, pp. 209-225.
Guba, E. G./Lincoln, Y. S., Fourth Generation Evaluation, Newbury Park: Sage Publications 1989.
Harbison, F. H./Myers, C. A., Management in the Industrial World: An International Analysis, New York: McGraw Hill 1959.
Hesse-Biber, S., Unleashing Frankenstein's Monster?, in Burgess, R (ed.), Studies in Qualitative Methodology: Computing and Qualitative Research, Vol. 5, London: JAI JAI Java Advanced Imaging
JAI Justice et Affaires Interiéures (French: Justice and Home Affairs)
JAI Journal of ASTM International
JAI Just An Idea
JAI Jazz Alliance International
JAI Joint Africa Institute Press 1996, pp. 25-41.
Hislop, D., Linking Human Resource Management and Knowledge Management Via Commitment: A Review and Research Agenda, Employee Relations, 25, 1/2, 2003, pp. 182-202.
Hofstede, G./Bond, M. H., The Confucius Connection: From Cultural Roots to Economic Growth, Organizational Dynamics, 16, 4, 1988, pp. 4-21.
Hui, H. C./Triandis, H. C., Effects of Culture and Response Format on Extreme Response Style, Journal of Cross-Cultural Psychology, 20, 3, 1989, pp. 296-309.
Jack, G./Westwood, R., Postcolonialism and the Politics of Qualitative Research in International Business, Management International Review, 46, 4, 2006, pp. 481-500.
Jackson, M. S./Niblo, D. M., The Role of Qualitative Methodology in Cross-Cultural Research, Qualitative Research Journal, 3, 1, 2003, pp. 18-27.
Kelle, U., Theory Building in Qualitative Research and Computer Programs for the Management of Textual Data, Social Research Online, 2, 2, 1997, http://www.socresonline.org.uk/2/2/1.html.
Kiely, T., Wired Focus Groups, Harvard Business Review Harvard Business Review is a general management magazine published since 1922 by Harvard Business School Publishing, owned by the Harvard Business School. A monthly research-based magazine written for business practitioners, it claims a high ranking business readership and , 76, 1, 1998, pp. 12-16.
King, G./Keohane, R. O./Verba, S., Designing Social Inquiry. Scientific Inference in Qualitative Research, Princeton: Princeton University Princeton University, at Princeton, N.J.; coeducational; chartered 1746, opened 1747, rechartered 1748, called the College of New Jersey until 1896. Schools and Research Facilities
Kirk, L/Miller, M. L., Reliability and Validity in Qualitative Research, Sage University Paper Series on Quantitative Applications in the Social Sciences, No. 01, Newbury Park: Sage Publications 1986.
Kvale, S., Interviews: An Introduction to Qualitative Research Interviewing, Thousand Oaks: Sage Publications 1996.
LeCompte, M. D./Goetz, J. P., Problems of Reliability and Validity in Ethnographic Research, Review of Educational Research, 52, 1, 1982, pp. 31-60.
Lee, T. W., Using Qualitative Methods in Organizational Research, Organizational Research Methods Series, Thousand Oaks: Sage Publications 1999.
Lincoln, Y. S./Guba, E. G., Naturalistic nat·u·ral·is·tic
1. Imitating or producing the effect or appearance of nature.
2. Of or in accordance with the doctrines of naturalism. Inquiry, Beverly Hills Beverly Hills, city (1990 pop. 31,971), Los Angeles co., S Calif., completely surrounded by the city of Los Angeles; inc. 1914. The largely residential city is home to many motion-picture and television personalities. : Sage Publications 1984.
Lonner, W. J., Helfrich's 'Principle of Triarchic Resonance': A Commentary on yet Another Perspective on the Ongoing and Tenacious te·na·cious
1. Clinging to another object or surface; adhesive.
2. Holding together firmly; cohesive.
viscid; adhesive. Etic-Emic Debate, Culture & Psychology, 5, 2, 1999, pp. 173-181.
Mangabeira, W./Armstrong, D./Sprokkereef, A., The Data, the Team, and the Ethnograph, in Robert, B. (ed.), Studies in Qualitative Methodology: Computing and Qualitative Research, Vol. 5, London: JAI Press 1996, pp. 81-103.
Marschan-Piekkari, R./Welch, D./Welch, L., In the Shadow: The Impact of Language on Structure, Power and Communication in the Multinational, International Business Review, 8, 4, 1999, pp. 421-440.
Marshall, H., Rigour or Rigidity rigidity /ri·gid·i·ty/ (ri-jid´i-te) inflexibility or stiffness.
clasp-knife rigidity ? The Role of CAQDAS in Qualitative Research, Association for Qualitative Research (AQR AQR Association for Qualitative Research (UK)
AQR Airline Quality Rating
AQR Anàlisi Quantitativa Regional
AQR Assured Quality Routing (iBasis)
AQR Applied Quantitative Research ), Melbourne, Australia, http://www.latrobe.edu.au/aqr/offer/papers/HMarshal.htm. 2001, July 5-7
Marshall, H., What Do We Do When We Code Data?, Qualitative Research Journal, 2, 1, 2002, pp. 56-70.
Maxwell, J. A., Designing a Qualitative Study, in Bickman, L./Rog, D. J. (eds.), Handbook of Applied Social Research Methods, London: Sage Publications 1997, pp. 69-100.
McDonald, M. H. B., Methodological Problems Associated with Qualitative Research: Some Observations and a Case Analysis of International Marketing Planning, International Studies of Management & Organization, 15, 2, 1985, pp. 19-40.
Merton, R. K., Social Theory and Social Structure Social Theory and Social Structure (STSS) was a landmark publication in sociology by Robert K. Merton. It has been translated into close to 20 languages and is one of the most frequently cited texts in social sciences. , New York: Free Press 1949.
Miles, M. B., Qualitative Data as an Attractive Nuisance Noun 1. attractive nuisance - anything on your premises that might attract children into danger or harm; "their swimming pool is an attractive nuisance; they should fence it in" : The Problem of Analysis, Administrative Science Quarterly Administrative Science Quarterly, founded in 1956, is one of the most eminent academic journals in the field of organizational studies. It is published by Cornell University.
People claimed to have been involved as founders include James D. , 24, 4, 1979, pp. 590-601.
Miles, M. B./Huberman, A. M., Qualitative Data Analysis: An Expanded Sourcebook, Thousand Oaks: Sage Publications 1994.
Morey, N. C./Luthans, F., An Emic Perspective and Ethnoscience Methods for Organizational Research, Academy of Management Review, 9, 1, 1984, pp. 27-36.
Mudambi, R., Knowledge Management in Multinational Firms, Journal of International Management, 8, 1, 2002, pp. 1-9.
Nunnally, J. C., Psychometric psy·cho·met·rics
n. (used with a sing. verb)
The branch of psychology that deals with the design, administration, and interpretation of quantitative tests for the measurement of psychological variables such as intelligence, aptitude, and Theory, 2nd ed., New York: McGraw-Hill 1978.
Parkhe, A., 'Messy' Research, Methodological Predispositions, and Theory, Academy of Management Review, 18, 2, 1993, pp. 227-268.
Pauwels, P./Matthyssens, P., The Architecture of Multiple Case Study Research in International Business, in Marschan-Piekkari, R./Welch, C. (eds.), Handbook of Qualitative Research Methods for International Business, Cheltertham: Edward Elgar 2004, pp. 125-143.
Peterson, R. B., Empirical Research in International Management: A Critique and Future Agenda, in Marschan-Piekkari, R./Welch, C. (eds.), Handbook of Qualitative Research Methods for International Business, Cheltenham: Edward Elgar 2004, pp. 25-55.
Piekkari, R./Welch, C., Language Dynamics in Cross-Cultural Qualitative Interviewing, Nordic Workshop in International Business, INSEAD INSEAD Institut Européen d'Administration des Affaires (European Institute for Business Administration; now know simply as INSEAD)
INSEAD I Never Stop Eating And Drinking , Fontainebleau 2004, May 26-28
Pike, K. L., Language in Relation to a Unified Theory of the Structure of Human Behavior, The Hague: Mouton mouton
lamb pelt made to resemble seal or beaver. 1966.
Poortinga, Y. H., Equivalence of Cross-Cultural Data: An Overview of Basic Issues, International Journal of Psychology, 24, 6, 1989, pp. 737-756.
Potter, W. J., An Analysis of Thinking and Research About Qualitative Methods, Lea's Communication Series, Mahwah: Lawrence Erlbaum Associates 1996.
Richards, L., Using NVivo in Qualitative Research, 2nd ed., Bundoora: QSR International QSR International
QSR International develops Qualitative Data Analysis (QDA) software products designed to help qualitative researchers organize and analyze non-numerical or unstructured data. Pry 2000.
Richards, T. J./Richards, L., Using Computers in Qualitative Research, in Denzin, N. K./Lincoln, Y. S. (eds.), Handbook of Qualitative Research, Thousand Oaks: Sage Publications 1994, pp. 445-462.
Salzberger, T./Sinkovies, R. R./Schlegelmilch, B. B., Data Equivalence in Cross-Cultural Research: A Comparison of Classical Test Theory and Latent Trait Theory Trait theory is an approach to personality theory in psychology.
The emotions, thoughts and behavior patterns that a person has are typically referred to as a personality (Kassin, 2003) and can vary immensely between individuals. Based Approaches, Australasian Marketing Journal, 7, 2, 1999, pp. 23-38.
Silverman, D, Qualitative Methodology and Sociology: Describing the Social World, Aldershot: Gower Publication Co. 1985.
Sinkovics, R. R./Penz, E./Ghauri, P. N., Analysing Textual Data in International Marketing Research, Qualitative Market Research: An International Journal, 8, 1, 2005, pp. 9-38.
Strauss, A./Corbin, J., Grounded Theory Methodology: An Overview, in Denzin, N. K./Lincoln, Y. S. (eds.), Handbook of Qualitative Research, Thousand Oaks: Sage Publications 1994, pp. 273-285.
Strauss, A. L./Corbin, J. M., Basics of Qualitative Research: Grounded Theory Procedures and Techniques, Thousand Oaks: Sage Publications 1998.
Suddaby, R., From the Editors: What Grounded Theory Is Not, Academy of Management Journal, 49, 4, 2006, pp. 633-642.
Sykes, W., Validity and Reliability in Qualitative Market Research: A Review of the Literature, Journal of the Market Research Society, 32, 3, 1990, pp. 289-338.
Van de Vijver, F./Poortinga, Y. H., Towards an Integrated Analysis of Bias in Cross-Cultural Assessment, European Journal of Psychological Assessment, 13, 1, 1997, pp. 21-29.
Welch, C. et al., Corporate Elites as Informants in Qualitative International Business Research, International Business Review, 11, 5, 2002, pp. 611-628.
Welch, C./Piekkari, R., Crossing Language Boundaries: Qualitative Interviewing in International Business, Management International Review, 46, 4, 2006, pp. 417-437.
Yang, Z./Wang, X./Su, C., A Review of Research Methodologies in International Business, International Business Review, 15, 6, 2006, pp. 601-617.
Yin, R. K., Case Study Research: Design and Methods, Applied Social Research Methods Series, 3rd ed., Thousand Oaks: Sage Publications 2003.
Zuell, C./Landmann, J./Geis, A., Textpack Pc,2002, http://www.gesis.org/software/textpack/index.htm.
(1) We concur CONCUR - ["CONCUR, A Language for Continuous Concurrent Processes", R.M. Salter et al, Comp Langs 5(3):163-189 (1981)]. with Earley and Singh (1995) that the empirical literature in cross-cultural research is plagued with "confusion concerning the role of culture and national context" (Earley/Singh 1995, p. 337). (Yin2003)
(2) Also referred to as 'differential item functioning' (DIF (1) (Data Interchange Format) A standard file format for spreadsheet and other data structured in row and column form. Originally developed for VisiCalc, DIF is now under Lotus' jurisdiction. ). For our context of qualitative research this will be more appropriately labelled 'stimulus' bias.
(3) Different response patterns and physical conditions in qualitative interview settings were taken into consideration to establish equivalence of research. While, for example, German managers invited the interviewees into their offices, Austrians usually used more informal settings, such as the cantina can·ti·na
n. Southwestern U.S.
A bar that serves liquor.
[Spanish, canteen, from Italian, wine cellar.] or informal meeting spots. Italian managers wanted to meet outside the company premises such as coffee shops.
(4) Countries: Austria, Germany and Italy. The rationale for this was to learn about management idiosyncrasies in geographically close yet psychographically heterogeneous environments.
(5) These big nodes included: "companies' goals", "role of management", "company culture", "concept of knowledge management", "origin of the knowledge management system", "implementation of the knowledge management system", "measures of knowledge management", and "ideal knowledge management".
Reader Rudolf R. Sinkovics ([mail])
Department of International Business, Manchester Business School Manchester Business School (MBS) is the business and management school of the University of Manchester in England. The Independent wrote, in 2006, that MBS is "one of the grand old men of British business schools", , Manchester, United Kingdom.
Associate Professor Elfriede Penz
International Marketing and Management, Wirtschaflsuniversitat Wien, Wien, Austria.
Professor Pervez N. Ghauri
International Management, King's College, London, United Kingdom.
Table 1. Enhancing the Trustworthiness of Qualitative Research in International Bus Linking Standards and Stages How to enhance the quality of interview-based qualitative research?--Standards Construct Standards Credibility / Dependability Bias [right arrow] Validity /Reliability [down arrow] * Build on es- N/A Stages "Getting tablished theory Started" * Use of pre- * (see section 0) established dimensions * Theoretical (Potter Basis 1996 * Literature Review * Problem Definition Method Research * Build on es- N/A (only Bias Design tablished theory applicable (see section 0) after data * Build and extend collection) proven research design (Creswell 1997) Sample and Theoretical Evidence Context sampling of a commit- (see section 0) and testing of ted study external validity: (e.g. Creswell 1997, number of Salzberger/Sin- interviews) kovics/Schlegel- (Lee 1999, milch 1999) Sinkovics/ Penz/Ghauri * Confirmation 2005 and disconfirma- tion of responses and contexts Data collec- Construct * Description tion and Data validity: * Use proto- preparation * Use multiple col to ensure (see section 0) sources of evi- repeatability dence: interview- (Maxwell ees' comments, 1,997 researchers' (Yin 2003) observations, use of documents * Establish "chain of evidence": documentation, archival records, interviews, direct observations, par- ticipant-observa- tion, and physical artefacts (Yin 2003) Stimulus Data Analysis Internal validity: * Derivation Bias (see section 0) * Accuracy, of coding completeness scheme from data (groun- * Search for nega- ded approach) tive incidents * Application * Check for plau- of formali- sibility of rival sed steps of hypotheses organising, (Maxwell coding, 1997 searching and modelling (Strauss/Cor- bin 1994, Yin 2003 Discussion External validity, Research re- (see section 0) transferability, port is logic, applicability: transparent and consis- * How generali- tent--invites sable are findings replication to another setting (Lee of people, etc. 1999 * Establishing do- main to which the study's findings can be generalized (Lee 1999 Construct Standards Transferability / Confirmability / Bias [right arrow] Generalisability Objectivity [down arrow] * Functional and Alertness to and Stages "Getting conceptual coherence of Started" equivalence background assumptions * (see section 0) * Equivalence of research topic * theory, construct * Theoretical (e.g, pre-testing Basis definition * "leading" of concept) literature * Literature (Craig/Douglas Review 2005, Salzberger/ * problem Sinkovics/ over-represented * Problem Schlegelmilch Definition 1999, Sinkovics/ * definition Penz/Ghauri of behaviours 2005 (Potter 1996) Method Research N/A (only N/A (only Bias Design applicable applicable (see section 0) after data after data collection) collection) Sample and Analytic * Ethics: the way Context generalisability participants were (see section 0) (Ecological treated in general validity) (Kvale 1996, * Communication Lee 1999) with participants * Encounters with participants (Strauss/Corbin 1994, Strauss/ Corbin 1998) Data collec- Equivalence * Researcher tion and Data of participated but preparation * Methods is still detached (see section 0) (training of enough to make interview good observation situation * Data collection * Units and analysis (selection occur in alterna- of companies and ting sequences managers) (analysis drives collection) * Administration (Salzberger/ * Interpretation: Sinkovics/ what was said-- Schlegelmilch what was meant 1999), through (Strauss/Corbin training 1994, Strauss/ sessions (see Corbin 1998) Welch et al. 2002) Stimulus Data Analysis * Equivalence Confirmability: Bias (see section 0) of data by following * Objectivity a common coding through scheme external audit (Salzberger/ Sinkovics/ * Participant Schlegelmilch should react 1999 to data and interpretation * Description of researcher allows repli- cation (Lee * "Devil's 1999 advocate" (Maxwell 1997 Discussion Comparison with Truth: (see section 0) conflicting * Accuracy of and similar particular findings literature (Lee (Lee 1999 1999 Enhanced outcome --Logic and transparent analysis and report documentation! (Marshall 2001) Construct Standards Research Report Bias [right arrow] (see Lee 1999) [up arrow] Stages 1 Study derived from "Getting formal theory, semi-deve- Started" loped conceptual structure, or general topic * (see section 0) 2 Study served to generate * Theoretical new theory, extend or ela- Basis borate existing theory, or not generate a new theory * Literature Review 3 References: Key, "criti- cal", accurate * Problem Definition 4 Can contractions be explained Method Research 5 Study's problem is suffi- Bias Design ciently important (see section 0) 6 Hypotheses: appropriate level of analysis; falsifiab- le; central to theoretical, conceptual or applied basis; adequately operati- onalised; derives from key construct Sample and 7 Subject selection (pro- Context babilistic, convenience, (see section 0) theoretical sampling) 8 Information was given to subjects before, during, after study 9 Subjects social and emo- tional states before, during, after study 10 Researchers' rapport to subjects before, during, after study Data collec- 11 Data (kinds of data, tion and Data how much) preparation (see section 0) 12 Data recorded 13 Data transcription (lan- guage issue) 14 Specific steps in data collection 15 Specific questions 16 Interview agenda 17 Fit of collected data to researchers' general topic, theory 18 Rich descriptions of the phenomenon's context (value-free note-taking) Stimulus Data Analysis 19 Analysis involves Bias (see section 0) global interpretation or formalized analysis 20 How were categories defined 21 Howe were defined categories imposed on data 22 Fit of researchers' interpretation with what is already known Discussion 23 Results clearly and (see section 0) concisely summarized 24 Implications follow data 25 Limitations concisely stated 26 Contributions to the body of knowledge clearly and convincingly 27 Alternative explanation Note:Please note that we purposefully use both quantitative and qualitative terminology in the headings of the respective columns, in order to link quality criteria, which were originally suggested without reference to particular research methodologies (see Nunnally 1978). As for paralleling the quantitative and qualitative-quality criteria, please see our discussion in section 0 "Adopting Formal Criteria for Qualitative Research" and references to (Denzin/Lincoln 1994, Guba/Lincoln 1989, Kirk/Miller 1986, LeCompte/Goetz 1982).