Systematic review of prosocial behavior measures.
Within this context, it seems of special relevance the measurement of these prosocial behaviors, because it is reasonable to recognize that this type of behavior is ubiquitous in many social interactions, to a greater or lesser degree. Measuring prosocial behavior can provide very useful information, not only for psychology professionals who can extrapolate these behaviors to many aspects that make up the discipline, but also for professionals in the medical and sociological field, as well as in labor, political and criminal science. Leveraging these behaviors can contribute to many overall benefits.
The methodological and evaluative aspects have been fundamental to this field ever since psychology gained recognition as a science, because it measures what is being studied. They are generally intangible aspects, such as behaviors, measured from inferences, and necessarily require the accumulation of strong evidence of validity to support the interpretation of their scores and their use (Elosua, 2003). Without these sources of scientific support, the researcher or practitioner could not defend the usefulness and effectiveness of their measurements. All of this raises the following question: what is the status of measuring instruments for prosocial behavior? Although a recent review attempted to present the current state of the research on prosocial behavior (Aune, Blum, Abal, Lozzia & Attorresi, 2014), its development was based on a rational analysis of related concepts and instruments, rather than supported by empirical findings.
Until now, several types of instruments for prosocial behavior assessment have been developed. For purposes of this review, the authors created a logical-rational analysis of classification model. In this framework, these measures can be logically classified depending on the source from which information is gathered: 1) self-assessment or self-report instruments, in which the individual is the one that evaluates his/her own behaviors; 2) peer-assessment measures, in which equals are the ones that evaluate individuals' behaviors; and 3) other people-assessment instruments, which include evaluations from parents, teachers, etc.
Within these instruments, self-assessment measures are the most prominent, and a wide range of them can be found throughout the literature. The Teenage Inventory of Social Skills (TISS; Inderbitzen & Foster, 1992), for example, is a 40-item scale that evaluates both prosocial and antisocial behaviors. The Prosocial Behavior Scale (PB; Caprara & Pasteorelli, 1993) is a 15-item scale, assessing behaviors of altruism, trust and pleasantness. The Prosocial Tendencies Measure (PTM; Carlo & Randall, 2002) is a more extensive scale, with a total of 23 items, assessing multidimensionality of prosocial behaviors. It distinguishes six types of prosocial behaviors: public, anonymous, dire, emotional, compliant, and altruism. The Prosocialness Scale for Adults (PSA; Caprara, Steca, Zelli & Capanna, 2005) is composed of 17 items and classifies behaviors and feelings into four types: the action of assisting, helping, sharing of caring and empathy with others. The Prosocial Behavior Questionnaire (Sanchez-Queija, Oliva& Parra, 2006) intends to measure adolescents' behaviors performed in NGOs through 7 items. The Prosocial Skills Scale for Teenagers (Morales-Rodriguez & Suarez-Perez, 2011) is another scale designed for adolescents, assessing four factors with 20 items: perspective-taking, solidarity, aid response, and assistance altruism.
There are also measures referred to external evaluation, conducted either by peers or by other people who conform the subject's surrounding environment. Examples are the Child Behavior Scale (CBS; Ladd & Profilet, 1996) or the Prosocial Behavior Questionnaire (PBQ; Weir & Duveen, 1981). The CBS has 17 items that are related to aggressive and prosocial acts towards peers, which are answered by their teachers. The PBQ, in turn, consists of 20 items describing prosocial behaviors that need to be answered by teachers as well as by parents. It assesses, then, prosocial acts both in school and in the family context.
On the other hand, one can find intermediate instruments that can comprise both self-report and other-report evaluations answered by people in the surrounding environment of the subject, such as the Prosocial Behavior Questionnaire (PBQ; Martorell, Aloy, Gomez & Silva, 1993). This inventory consists of a self-evaluation, with a total of 55 items, in which the opinion of parents, teachers and other people in the surrounding environment is considered for the subject of assessment. This multi-informant procedure may be a recommended approach given the limitations that occur around measurement by a single instrument of behaviors in general and of prosocial behavior (Eisenberg, 1982).
As observed, there are certain assessment instruments available to those who wish to use them. However, given the wide range of them, it is of interest to get to know their current status, which ones are the most used, if they have been adapted to other cultures and languages, and if there are newer methods available. Taking the aforementioned points, the main aim of this study is to review the measurement instruments available to evaluate prosocial behaviors, the definition and types of prosocial behaviors that are included, and their recent revisions and adjustments.
To conduct a relevant and sufficient literature search, it is necessary to acquire theoretical fundamentals of the most highlighted aspects of the subject. In this sense, this study highlights the cognitive content of moral psychology, since moral issues which are faced daily are required to find a balance between rights and interests, in order to attain an appropriate behavior for each situation (Marti-Vilar, 2010). Among the positive prosocial behaviors, motivational and emotional aspects are studied, such as empathy and altruism (Marti-Vilar, 2010). These can act as mediators in a situation of conflict, together with cooperation and support, which can reflect, for example, cognitive maturity (Marti-Vilar, 2010). These aspects should also be subject to psychometric criteria, and therefore, be subject to the minimum required levels to obtain valid interpretations and reliable scores in the contexts designed for their use (American Educational Research Association, American Psychological Association & National Council on Measurement in Education, 2014; Vallejo-Medina, et al., 2017).
On the other hand, it highlights many variables that can modulate decision-making and conflict, and the arousal of prosocial behavior. This is essential to understand the causal interrelationship between them from a multivariate angle, which is typical of human behavior (Harlow, 2005; Hayes, 2009). Such variables are personality, locus of control, socioeconomic status, self-perception, levels of satisfaction and happiness or identification with a group or with the subject that the prosocial behavior is exercised towards, etc (Lousado & Marti-Vilar, 2010). In addition, and similarly, forming a part of moral psychology, the factors that come into play in thinking, reasoning and morality of the subject, are found. Given the quantity of factors that could have been measured, moral psychology related to this study will focus on prosocial behaviors. As defined above, these are considered as the positive social behaviors that are carried out to assist other people regardless of their motivation, whether it is altruistic or not.
The search is primarily focused on behavioral aspects, leaving out affective elements, such as empathy, cognition and motivations. Therefore, measuring instruments related to prosocial behavior, in any age, language and context are sought for. In order to try not to leave out any points worth reviewing, adjacent terms of the word prosocial, like "prosociality" and the Spanish "prosocialidad", were also used. However, given the diversity of terms that refer to the measure, not all could be selected. The following ones were used in the search: test, scale, questionnaire, instrument etc.
The nomenclature of the types of measures does not differ much from one language to another, and in practice they are interchangeable terms in a Spanish context. It was observed that "test", "instrument" and "questionnaire" were practically synonymous in meaning, since all of them refer to a list of questions destined to evaluate or measure knowledge or skills. The focus is often on measuring several related aspects. However, as for the term "scale", it is observed to be more reduced. Generally, it refers to a set of questions about a particular subject with different values on the same concept. It is less extensive than the previous terms, and more focused on the particular aspect being evaluated.
It was decided to conduct the search with the four mentioned words, "test", "questionnaire, "instrument" and "scale", which are the most used terms. Despite their similarity in terms of meaning, each author uses and considers them as the most appropriate for naming the measurement in the study. The search was divided into two different aspects. First, initial search. In this first search, it was attempted to refine the concepts that were to be used, the number of reviews or articles that could be found related to the topic, and the most appropriate databases. In order to conduct a search which would be as accurate as possible, the corresponding terms that appear in "Thesaurus" should be used. Thesaurus is a multilingual dictionary with free network access that lets us know exactly which terms are the correct ones to be used when conducting a literature search. It also contains other aspects that are related to what one is looking for, in case one needs further information. To achieve access to the maximum possible related publications, the search was conducted entirely in English. It was found that the most appropriate term to use in the search for prosocial behavior, was the English "prosocial behavior". In the same manner, the terms referring to the measurements were also translated into English, being as follows: "test", "questionnaire", "instrument" and "scale". These terms were combined with the term "prosocial behavior", in order not to lose any data.
Second, the systematic search stage: in the second type of search, the most appropriate database was selected, since the terms that were to be used had already been previously selected. In this last phase, the articles that will appear in the references of this study were obtained. Once the most correct search terms were decided on, the online scientific information service was selected from various databases. Because of its prestige and quantity of studies and articles it contains, the Web of Science (WOS) was selected as the main base in the search for data. The articles that provided the most results were those which referred to the word "test" or "questionnaire", while the result that provided the least articles was the term "instruments. The inclusion terms used were as follows: a) items belonging to the WOS-database, b) full texts offered by the VPN of the University, c) years of search: from 1900 to 2017, preferably from the last decade), d) keywords, e)search for related articles by title: (aspects related to prosocial behavior and its measurement), f) reading and searching in the abstract afterwards (to ensure that measuring instruments really appeared), g) complete reading of the article in case the used instrument was mentioned in the summary, or if there were clues that one could appear, and h) focus the search on the question posed at the beginning of this study.
On the other hand, the exclusion terms were as follows: a) articles related to prosocial behavior, but not to measuring instruments, and b) instruments related to moral psychology that refers to affective or motivational aspects, such as altruism and empathy. As reflected in Figure 1, the search that provided the most results after applying the criteria of inclusion and exclusion was the term "test prosocial behavior", with a total of twenty useful results for the study as far as instruments are concerned. In total, fifty-six results were selected from this term, in addition to related articles. In the manual search, which made up the last part of the study, the articles that were found in several searches were eliminated. That is, those which appeared to be with the four terms which were selected. In this manual search, we find one Peruvian study (Meyer et al., 2011); with the addition of this last result, this left the study with the final fifty-seven articles which were used in the review. Finally, to ensure that the instruments that had been found not to have any results did not have related articles in other databases, another manual search was conducted. The name of each instrument was searched for in Google Academy and Dialnet, but in the same way as with WOS, no results of reviews or updates were found.
To know the current state of the measurement instruments of prosocial behavior, the results of the search methodology were used, in an attempt to answer the question that was initially posed.
Child Behaviour Scale (CBS)'s Ladd and Profilet (1996) used in young people from ages fifteen to nineteen, and mentioned in the introduction of this work, was recently validated in 2013. In this case the implementation of the original six factors was valued in different contexts, for this oblique rotation as a psychometric test was used, which provided different results. In the analysis, samples of children from ages four to eleven, Americans and Italians, were compared, proving that the factors couldn't separate in the same way, depending on the population, which affects culture, social values, language, etc. The final result indicated that the test factors aren't the same in the American and Italian population; in the first case CBS is composed of 59 items of which only 35 constitute the six useful dimensions for test score.
The Italian version is structured according to the six original dimensions with a new dimension called Rules of Behavior, composed of a set of items not used in the original version; therefore, the items that aren't necessary in order to calculate a final total of 39 items were removed in this adaptation. The manual search also found a CBS validation study carried out in Peru on 256 children (between 2 and 6 years old) rated by 23 female teachers (Meyer et al., 2011). The analytical framework was the exploratory factor analysis, and several rules of factor extraction, oblique rotation (promax and oblimin) and orthogonal (varimax), and several models (between 4 and 6 factors) were used. The retained factor solution, and more theoretically consistent, was the four-factor model; one of them was the Prosocial Behavior factor (12 items, [alpha] = .85). The strength of their items showed a range of factor loads between .80 and .40 and were factorially simple. The prosocial dimension also exhibited moderate but similar negative correlations with externalizing and internalizing behavior. This study highlighted some characteristics of the instrument that can add method variance, such as the reduced number of options (3), and the grouping of dimensionally similar items.
Another of the instruments that appears in the literature search is the PTM, also mentioned previously, used mainly on adolescents, with a total of 23 items. Specifically, it talks about an interesting comparison of results amongst early adolescents who are between ten and fourteen years old, and late teenagers who are from fifteen to nineteen, comparing the answers to this scale.
After achieving the results, in the twenty-three items corresponding to the test, in its six different scales, it was noticed that in the group of the late teenagers the measuring was better, even better than in the group of early teenagers, but they concluded that more psychometric research is needed regarding this. This same instrument was recently adjusted to the Argentinian population, both in terms of content and language, to analyze the dimensions of prosocial behavior in children of this population, with very positive data with regard to reliability and validity in 2012.
Another data found recently that refers to the mentioned instruments was published last year in 2014 on the Teenagers Inventory of Social Skills (TISS) Inderdbitzen and Foster (1992) along with the Scale of Attributions (SAS). Checking the relationship between prosocial behavior and the results obtained by students in Maths and English Language subjects, the results indicate that the more prosocial students tend to have internal attributions concerning their own yield increase, and have a greater internal locus of control than those less prosocial students. These students, who generally got better academic results in these two subjects, were those who scored higher in the instrument of prosocial behavior in comparison to the others, who also attributed their low notes to external causes. The scores were significant in the Spanish population in which they were used, the reliability and validity data of TISS results were positive and showed results that related the prosocial behavior to the academic yield of these two subjects. It emphasizes the importance of prosocial behaviors in academic yield.
In the Prosocial Behaviour Questionnaire (PBQ; Gomez & Silva, 1993), the 55 items of the test were adapted for the teenage population between the ages of ten and seventeen years old on the Argentinian population, which obtained a Cronbach's alpha of [alpha] = .76; on the Spanish population, with a total in the same psychometric test of .84 and in Colombia with a total of .68 in which contents, for a better understanding of the items, were adapted according to the context. Recently, in 2011, a review was performed specifically on the Valencian population with 510 students between the ages of 10 and 17, with an [alpha] of .78 that shows good reliability.
In 2012, a validation of the psychometric properties of BAS-3 Silva and Martorell (1987) for teenagers was carried out in Argentina. The validation was made with a group of teenagers between 10 and 15, with their parents' consent; analyzing the 65 items making up the scale, discarding the 10 items of sincerity, using an exploratory, factorial analysis and a sedimentation graphic showing the best group for this population was focused on five factors: the scale of social shyness anxiety remained as the first factor, but unlike the Spanish version, it consisted of 17 items instead of 14; the second, which was called self-control in social relationships, which in this test included three additional items; the third factor was the scale of shyness, which remained like the original; the fourth, consideration for others; and finally, the fifth was leadership, which had four more items than the original. On the other hand, it obtained a Cronbach's [alpha] of .68 to .71, indicating good reliability for scores, although the total score of the battery wasn't established.
The Faculty of Psychology of the Michoacana University in San Nicolas Hidalgo (Mexico), validated in 2010 the Prosocial Skills Scale for Adolescents (EHP-A) by Morales-Rodriguez and Suarez-Perez (2011) in the Mexican population, with a group of 1172 adolescents within an age range of 11 to 25 years old, with a factorial analysis of the main test components. They grouped a total of 52 items which analyzed through the statistical program SPSS finally leaving a new version of 31 items distributed in 6 factors with [alpha] of .86, showing a good validity and internal consistency between .67 and .71. The terms were adapted in language meaning to improve the understanding of the items. In addition to the tests which have been discussed in the introduction of this work, documents detailing the use of other methods or scales that currently can be used to measure prosocial behaviors were selected.
One of the most interesting, referred to a revised questionnaire Prosocial Reasoning (PROM; Carlo, Eisenberg & Knight, 1992), deals with the building of a pictorial version of this test for children between seven and eight years of age. This specific instrument evaluates the reasoning that the subjects perform when facing a problem or situation where the answer implies a help in behavior. The results discriminate between different types of reasoning; the hedonistic, the need-oriented, the approval, the stereotyped and the internalized. Therefore, it evaluates fictitious situations and results which placed placed the subject within these moral arguments.
In this new version which is used or intended to be used, is the approach of PROM situations but using alternative response pictorial forms to improve the understanding of children and achieve very accurate results. The reliability and validity of this test is considered high although exact data of this pictorial version is not discussed. In the study, the results among children who respond to illustrations and those who don't were stated, improving the response rate of the first group and can be especially useful for children with problems in handwriting. According to one of the articles found, in 2002 the PROM was adapted and validated in the Spanish population with a score reliability ([alpha]) of .71 to .85 in all scales. Finally, other validations and adaptations of this test were made in 2012 for the Chinese population with 556 students, adapted to the level of language and content of the items.
Relating to prosocial behavior with emotional and behavioral aspects, validity evidences were recently performed with the Brief Scale of Prosocial Perception (BAPPS; Taylor & Wood (2014). It is useful in educational and sport contexts, and according to information given for young people between 11 and 16, with open questions about aspects of prosocial behavior, they obtained good score reliability ([alpha] = .78). Related to prosocial behavior, made valid in 2013 and used by teaching professionals, the Volunteer Scale (FSPV; Law, Shek & Ma, 2015) analyzes the influence of patterns, family and the school in volunteer behavior, with 27 items that analyze the importance of the social environment in the development of prosocial behavior of young people between 11 and 15 years of age.
In the context of sports behavior, prosocial behavior is linked to the development of the group for sports performance. The PABBS (Kavussanu et al., 2015) has been developed to assess prosocial and antisocial behavior through four subscales (aggressiveness and competitiveness, moral attitudes, goal orientation, and help behavior). The authors (Kavussanu et al., 2015) report good psychometric properties but without data that can be corroborated.
In the field of traffic safety, the University of Valencia together with the Institute of Traffic and Road Safety (Spain) designed and validated a scale. It refers to prosocial and antisocial behavior in this aspect called Inventory of prosocial-antisocial behaviour. Lopez de Cozar et al. (2008) builds the prosocial scale taking into account several sub-scales; altruism, assertiveness and empathy, developing an inventory representing each of these subscales, scoring all of them from 1 (never) to 4 (always). This forms a final questionnaire of 30 items together with the observation of participants who obtain an [alpha] of .81 and .75 showing the relationship between road and prosocial behavior.
An instrument repeatedly mentioned, associated with prosocial behavior, is the Scale of Difficulties and Strengths (SDQ; Goodman, 1994), which evaluates emotions and behaviors of children, exploring 25 attributes divided into six scales, of which one is prosocial behavior. This scale of prosocial behavior is used on the Chinese population (adapted in 2012) but is also used in cases of autism as shown in a study in 2010 where the difference between children trained in prosocial behaviors and those who do not receive guidance was found. The scale gets good data regarding score reliability ([alpha] = .78, China) and in the original test is .82. A measure of family support, the Family Helping Inventory (FHI; Midlarsky, Hannah & Corley, 1995), was the last to be revised. According to the results of the search, in 1995 this inventory is divided into two scales, and is used in teenagers between 12 to 23; the first scale refers to the relationship with siblings, and prosocial behaviors, and the second one is the relationship with parents and prosocial behaviors learned from their children and themselves. The last review was conducted with a total of 202 adolescents and their families, all residents in the United States, with a total of 78% white, 20% black and 4% Asian or other racial group. A good validity of .87 was observed. The ANOVA and MANOVA tests, emphasize sex significant differences, with better results for women. Its factor structure was adjusted to a model of oblique factors.
The study and research of prosocial behavior and evaluation methods is relatively new and it shows a growing progress over recent years; from 2002 to 2017 publications related to the term prosocial doubled. Psychology began to focus its attention on positive behaviors that are triggered almost naturally: as support behavior, either when faced by situations where assistance is requested or situations which arise spontaneously with no identifiable cause. These behaviors can be taught and empowered throughout the life cycle. Prosocial behaviors are those positive behaviors which developed despite feelings or motivations that would prompt one to avoid altruism and empathy. The first instruments dating back to 1981 (e.g., PBQ) generated for educational contexts, where based on answering the student's own teacher with items for information regarding prosocial behavior of children. The next measure published was BAS-3 in 1987, which extended the age range of the assessed teenagers up to 19 responding themselves to its 65 items. This test was validated last 2012 with teenagers between 10 and 15 years of age in Argentina, where it was necessary to change some of the wording, language items and factors in the Spanish version.
Later, in 1992, the TISS (40 items) was published, in order to measure antisocial and prosocial behavior in adolescents in relation to their peers. The most recent work (authors, 2014) related the scores of the TISS to the scale of attributes (SAS; AUTHORS, YEAR), in which positive correlations were found between prosocial behavior and academic yield in language and mathematics. It would appear that prosocial behavior converges with other aspects (e.g. study habits, academic self-efficiency, etc.) which promote good academic results. Tw o validation studies of two instruments, PB and CCP, were published in 1993. The PB has 15 items and is answered by children; and the CCP (55 items) is a measure with several versions (adolescents, parents and teachers). The latter was validated in the Valencian population in Spain (Martorell, Gonzalez, Ordonez & Gomez, 2011) and the Colombian population (Mesurado et al., 2014).
From a different perspective, the Inventory of family support for teenagers between 12 and 23 was published, in which prosocial behaviors are analyzed from two different points of view: the relationship with siblings and parents, observing an increased support between siblings rather than with parents. Three years later, focused on the behaviors of aggression, shyness and prosocial behavior of children, CBS was published and it was recently validated in 2013 in which the Italian and the American population was compared, forming a new structure of the items for each population, with new positive results in terms of their reliability and validity in spite of changing the structure of the questionnaire according to the population to which it was applied. Previously, similar modifications were made in other Latin-American studies (Peru). With the new century, starting from 2002 the publications were retaken starting with PTM, which consists of six scales and a total of 23 items for teenagers also. It was validated in the Argentinan population in 2012 and adapted for language and content level. In the same year of its publication a study was performed in which scores of early adolescents (10-14 years) and late adolescents (15-19 years) were compared, with better reliability in the first group. Three years later, in 2005, analyzing aid actions, and helping and sharing with others, PSA was published breaking the line of analysis of others; this instrument focuses on assessing adults. Barely a year later, in 2006, the NGO's appeared, an instrument generated in Spanish. This was a new instrument focusing on the importance of the influence of groups in the development of behaviors and related activities for teenagers. Subsequently, in 2011, the EHP-A adapted for the Mexican adolescent population was published, but expanded the age range from eleven to twenty-five years. Two important changes were item reduction (now, 31), and language adaptation
But recently it seems that the study of prosocial behavior begins to leave the school context and teenagers, covering more areas such as sports, road safety and even the relationships between prosocial behavior and volunteering. Also, changes were found in some of the classical instruments which we have commented on in this section and the new version of pictorial PROM to improve the response capacity of children between 7 and 8 years of age.
Numerous instruments which focus on the early stages of development, from childhood to late adolescence are being implemented, which is very interesting because knowing the current status of prosocial behaviors in this age can help to empower them. Including prosocial behaviors in the academic curriculum from early age helps to strengthen the development not only of better students but of better citizens as well. Therefore, instruments like BAPPS are having their use expanded from an educational context to a sports context for young people between 11 and 17 years of age, to analyze the behaviors that develop according to the type of sport practiced among young people, whether they practice sport professionally or not, if they practice sport in a group, etc. It lets us know the prosocial behaviors that are shown in other contexts by young people. Also related to the field of sport, in 2015 PABSS was being developed to evaluate both prosocial behaviors as competitive in this area which is attracting wide interest in recent years.
In the area of road safety, no classical instrument measuring prosocial behavior was at first found, but recently the University of Valencia along with Traffic have generated and validated the Inventory of prosocial-antisocial behavior. It uses items from classic scales to establish the inventory and analyze the influence of these behaviors on driving.
In spite of the extensive research that has already been developed, prosocial behaviors are a topic of constant interest. In the embodiment of the literature search, it was found that after 2002, publications related to the term prosocial behavior grew exponentially year after year and more and more areas were included. The explanation may be due to the new century, a change that was marked by the development of a new psychological trend: positive psychology that focused its efforts on promoting positive behaviors in prevention, leaving behind the focus of attention on pathology, negative behaviors and disease.
As we have commented, prosocial behavior focuses precisely on this positive trend. Although the origins of the studies tended to focus on the negative part of the conduct, now it has become more important because it has been found that promoting prosocial behaviors at all levels in children, youth and adults leads to better coexistence, school and personal development. But more research on this is needed. For example, the study of adulthood has few known instruments, although articles were found in which studies of prosocial behavior related to the world of work were mentioned. Some questions taken from instruments created for children have been used and adapted, but without enough foundation. The same happens in studies for older ages. It can be safely stated that projects and activities to promote prosocial communication and prosocial behavior in old age improve the quality of life of this group of the population but measuring instruments to evaluate and improve them are yet unknown.
Another range of the population about which we have no information yet is people with difficulties or disabilities. The only studies found dealt with autistic children in which the study of the factor of the intervention of the empowerment of prosocial behavior was taken from one of the scales making up the Strengths and Difficulties Questionnaire (SDQ). But it would be interesting to know if one can create, adapt or modify some instrument for those people with difficulties or disabilities in whom we can appreciate prosocial behaviors, but without being able to measure their progress. More psychometric research into these issues is most necessary.
About prisons, numerous programs are known whose aim is to promote prosocial behaviors in rehabilitating prisoners to avoid the problems that were generated during the years in prisons when there was no support for the improvement of people serving sentences. Although improvement programs are now in use, we have not found in this search any instrument for evaluating the implementation of these programs (Alvarez, 2014).
Finally, we have detected some characteristic issues in the analytical and psychometric approach used for the validation of the instruments; for example, there has been a heterogeneous to analyzing the data, but essentially based on the Classical Tests Theory, and on the exploratory framework of factorial analysis; the predominantly reported reliability factor was internal consistency, and there is a lack of direct cross-cultural comparisons. Also, it has not been frequent to investigate the equivalence of differential item functioning of the items between local or international groups, and therefore, the extent to which response bias is present is not known. Apparently, the application of advanced methods of psychometric analysis is still an emerging practice in the validity studies of the instruments of prosocial behavior. We need relevant guidelines to structure and improve the phases of adaptation of instruments of prosocial behavior (e.g., American Educational Research Association et al., 2014; Vallejo-Medina et al., 2017); also, more research and work with this type of behavior because, as already mentioned, it not only improves the relationship between students, staff and families, but also promotes positive prosocial behavior.
Regarding the limitations of the study, in the first place, we cannot be sure that the search obtained all the relevant sources, and therefore, our results may be an approximate identification of the studies on the measurement of prosocial behavior. At this point, it would be extremely unlikely that a systematic review would achieve a coverage of 100% effectiveness. On the other hand, our search did not include articles in press, whose content can provide information directly useful to identify other relevant instruments. Along with the natural delay of the revision process of this manuscript, other manuscripts may not be included in this moratorium. Finally, other aspects of the reviewed articles were not addressed in the present review, such as the sampling method, other finer analytical decisions (for example, the factor extraction method, the inter-item correlation matrix, etc.); but the sources identified in the present study will serve to easily track them and obtain other objective information.
The implications of our results are accommodated with the usual implications of other review studies; that is, that we provide information to make decisions to researchers and psychosocial intervention personnel, about the choice of relevant instruments, and their evaluation for specific objectives. This also suggests a partial information available on the state of the art in the development of measures of prosocial behavior, its processes of inter-cultural adaptation, and the effectiveness to represent the construct of interest. Our results also put the first steps to decide on advancing meta-analytical studies, such as the generalization of reliability. Although our study does not provide accurate information to obtain analyzable information for a meta-analysis, we do provide information on some methodological aspects that will serve to make preliminary decisions about the eligibility of these reviewed studies.
Alvarez, J. A. (2014). Desarrollo prosocial en el ambito penitenciario: bases teoricas del "Programa de Compromiso Social". Postconvencionales (7-8), 81-109.
American Educational Research Association, American Psychological Association& National Council on Measurement in Education Association. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research.
Anderson, C. A., Shibuya, A., Ihori, N., Swing, E. L., Bushman, B. J., Sakamoto, A., Rothstein, H. R. & Saleem, M. (2010). Violent video game effects on aggression, empathy, and prosocial behavior in eastern and western countries: a meta-analytic review. Psychological Bulletin, 136, 151-173. https://doi.org/10.1037/a0018251
Aune, S., Blum, G. D., Abal, F., Lozzia, G. & Attorresi, H. (2014). La conducta prosocial: estado actual de la investigacion. Perspectivas en Psicologia, 11(2), 21-33
Barry, C. T. & Kauten, R. (2014). Nonpathological and pathological narcissism: Which self-reported characteristics are most problematic in adolescents? Journal of Personality Assessment, 96, 212-219. https://doi.org/10.1080/00223891.2013.830264
Batson, C. D. (1991). The altruism question: Toward a social--psychological answer. Hillsdale, NJ: Erlbaum.
Bolino, M. C. & Grant, A. M. (2016). The bright side of being prosocial at work, and the dark side, too: A review and agenda for research on other-oriented motives, behavior, and impact in organizations. The Academy of Management Annals, 10, 599-670. https://doi.org/10.1080/19416520.2016.1153260
Bushman, B. J. & Anderson, C. A. (2009). Comfortably numb: Desensitizing effects of violent media on helping others. Psychological Science, 20, 273-277. https://doi.org/10.1111/j.1467-9280.2009.02287.x
Caprara, G. V. & Pastorelli, C. (1993). Early emotional instability, prosocial behavior, and aggression: some methodological aspects. European Journal of Personality, 7(1), 19-36. https://doi.org/10.1002/per.2410070103
Carlo, G. & Randall, B. A. (2002). The development of a measure of prosocial behaviors for late adolescents. Journal of Youth and Adolescence, 31(1), 31-44. https://doi.org/10.1023/A:1014033032440
Carlo, G., Knight, G. P., McGinley, M., Zamboanga, B. L. & Hernandez-Jarvis, L. (2010). The multidimensionality of prosocial behaviors and evidence of measurement equivalence in Mexican American and European American early adolescents. Journal of Research on Adolescence, 20, 334-358. https://doi.org/10.1111/j.1532-7795.2010.00637.x
Carlo, G., Eisenberg, N. & Knight, G. P. (1992). An objective measure of prosocial moral reasoning. Journal of Research on Adolescence, 2, 331-349. https://doi.org/10.1207/s15327795jra0204_3
Carlo, G., Hausmann, A., Christiansen, S. & Randall, B. (2003). Sociocognitive and Behavioral Correlates of a Measure of Prosocial Tendencies for Adolescents. The Journal of Early Adolescence, 23(1), pp.107-134. https://doi.org/10.1177/0272431602239132
Caprara, G. V., Steca, P., Zelli, A. & Capanna, C. (2005). A new scale for measuring adults' prosocialness. European Journal of Psychological Assessment, 21(2), 77-89. https://doi.org/10.1027/1015-57188.8.131.52
Caprara, G. V. & Pastorelli, C. (1993). Early emotional instability, prosocial behavior, and aggression: some methodological aspects. European Journal of Personality, 7(1), 19-36. https://doi.org/10.1002/per.2410070103
Carnagey, N. L., Anderson, C. A. & Bushman, B. J. (2007). The effect of video game violence on physiological desensitization to real-life violence. Journal of Experimental Social Psychology, 43, 489-496. https://doi.org/10.1016/j.jesp.2006.05.003
Dunn, J. (2006). Moral development in early childhood and social interaction in the family. In M. Killen & J. G. Smetana (Eds.), Handbook of moral development (pp. 331-350). Mahwah, NJ: Erlbaum.
Eisenberg, N., Fabes, R. A. & Spinrad, T. L. (2006). Prosocial behavior. In N. Eisenberg (Vol. Ed.) and W. Damon & R. M. Lerner (Series Eds.), Handbook of child psychology: Vol. 3. Social, emotional, and personality development (6th ed., pp. 646-718). New York: Wiley.
Eisenberg, N. (1982). Introduction. En N. Eisenberg (Ed.), The development of prosocial behavior (pp. 1-19). New York: Academic Press. https://doi.org/10.1016/B978-0-12-234980-5.50006-7
Elosua, P. (2003). Sobre la validez de los test. Psicothema, 15(2), 315-321.
Goodman, R. (1994). A modified version of the Rutter Parent Questionnaire including extra items on children's strengths: A research note. Journal of Child Psychology and Psychiatry, 35, 1483-1494. https://doi.org/10.1111/j.1469-7610.1994.tb01289.x
Hayes, A. (2009). Beyond Baron and Kenny: statistical mediation analysis in the new millennium. Communications Monographs, 76(4), 408-420. https://doi.org/10.1080/03637750903310360
Harlow, L. L. (2005). The Essence of Multivariate Thinking: Basic Themes and Methods. Mahwah, NJ: Lawrence Erlbaum Associates. https://doi.org/10.4324/9781410612687
Hinde, R. A. (2002). Why good is good: The sources of morality. London/New York: Wiley.
Hoffman, M. L. (2000). Empathy and moral development: Implications for caring and justice. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511805851
Inderbitzen, H. M. & Foster, S. L. (1992). The Teenage Inventory of Social Skills: Development, reliability, and validity. Psychological Assessment, 4, 451-459. https://doi.org/10.1037/1040-35184.108.40.2061
Kavussanu, M., Stanger, N. & Boardley, I. (2015) The Prosocial and Antisocial Behaviour in Sport Scale: Further evidence for construct validity and reliability. Journal of Sports Sciences, (31)11, 1208-1221. https://doi.org/10.1080/02640414.2013.775473
Ladd, G. W. & Profilet, S. M. (1996). The Child Behavior Scale: A teacher-report measure of young children's aggressive, withdrawn, and prosocial behaviors. Developmental Psychology, 32(6), 1008-1024. https://doi.org/10.1037/0012-16220.127.116.118
Lacunza, A., Caballero, S. & Contini, E. (2013). Adaptacion y evaluacion de las propiedades psicometricas de la BAS-3 para poblacion adolescente de Tucuman (Argentina). Diversitas, 9, 29. https://doi.org/10.15332/s1794-9998.2013.0001.02
Law, B., Shek, D. & Ma, C. (2015). Gender invariance of Family, School, and Peer Influence on Volunteerism Scale. Research on Social Work Practice, 25(1), 139-146. https://doi.org/10.1177/1049731513517556
Lai, F., Siu, A., Chan, C. & Shek, D. (2012). Measurement of Prosocial Reasoning among Chinese Adolescents. The Scientific World Journal, 1-8. https://doi.org/10.1100/2012/174845
Lemos, V.N. & Richaud, M.C. (2010). Construccion de un instrumento para evaluar el razonamiento prosocial en ninos de 7 y 8 anos: una version pictorica. Universitas Psychologica, 9(3), 879-891.
Lopez de Cozar, E., Alonso, F., Esteban, C., Calatayud, C. & Alamar, B. (2008). Diseno y validacion de una escala para la medicion de la conducta prosocial - antisocial en el ambito vital y en el trafico. Instituto Universitario de Trafco y Seguridad Vial. Universidad de Valencia.
Lousado, D. & Marti-Vilar, M. (2010). Los valores: fundamento de la psicoeducacion moral. In M. Marti-Vilar (Ed.), Razonamiento Moral y prosocialidad. Fundamentos (pp. 247-270). Madrid: CCS. https://10.13140/RG.2.1.3539.8883
Marcone, R. & Constanzo, A. (2013). Contribution to the validation of the Child Behavior Scale (CBS): A Questionnaire for teachersthat measures aggressive, antisocial, amd prosocial behavior in kindergarten and primary school children. Bolletino di Psicologia Aplicata, 267, 33-48.
Martorell, M. C., Aloy, M., Gomez, O. & Silva, F. (1993). Cuestionario de evaluacion del Autoconcepto. Madrid: TEA.
Martorell, C., Gonzalez, R., Ordonez, A. & Gomez, O. (2011). Estudio confirmatorio del Cuestionario de Conducta Prosocial (CCP) y su relacion con variables de personalidad y socializacion. Revista Iberoamericana de Evaluacion Psicologica, 32(2), 35-52
Marti-Vilar, M. (2010). Razonamiento moral y prosocialidad. Fundamentos. Madrid: CCS. https://doi.org/10.13140/RG.2.1.4906.5120
Merino-Soto, C. & Grimaldo-Muchotrigo, M. (2015). Validacion estructural de la Escala Basica de Empatia (Basic Empathy Scale) modificada en adolescentes: un estudio preliminar. Revista Colombiana de Psicologia, 24(2), 261-270. https://doi.org/10.15446/rcp.v24n2.42514
Mestre, M.V., Frias-Navarro, Samper, P. & Tur, A. (2002). Adaptacion y validacion en poblacion espanola del PROM: una medida objetiva del razonamiento moral prosocial. Accion Psicologica, 3, 221-232. https://doi.org/10.5944/ap.1.3.555
Mestre, M. V., Tur, A., Samper, P., Mesurado, B. & Richaud, M. C. (2014). Adaptacion y validacion en poblacion espanola de la Escala de Expectativa de los hijos adolescentes sobre la reaccion de sus padres frente al comportamiento prosocial y antisocial. Universitas Psychologica, 13(1). https://doi.org/10.11144/Javeriana-UPSY13-1.avpe
Mesurado, B., Richaud, M., Mestre, M.V., Samper-Gargia, P., Tur-Porcar, A., Morales Mesa, S.A. & Viveros, E. R. (2014). Parental expectations and prosocial behavior of adolescents from low-income. Backgrounds: A Cross-Cultural Comparison between three countries-Argentina, Colombia, and Spain. Journal of Cross-Cultural Psychology, 45(9), pp. 1471-1488. https://doi.org/10.1177/0022022114542284
Meyer, E. L., Schaefer, B. A., Merino, C., Simmos, C. S., Anguiano, R., Brett, J., Holman, A., Martin, J. F., Hata, H. K., Roberts, K. J., Mello, Z. R. & Worrell, F. C. (2011). Factor structure of Child Behavior Scale scores in Peruvian preschoolers. Psychology in Schools, 48(10), 931-942. https://doi.org/10.1002/pits.20596
Midlarsky, E., Hannah, M.E. & Corley, R. (1995). Assessing adolecents' prosocial behaviour: the Family Helping Inventory. Adolescence, 30, 141-155
Morales-Rodriguez, M. & Suarez-Perez, C. D. (2011, noviembre). Construccion y validacion de una escala para evaluar habilidades prosociales en adolescentes. Ponencia presentada en el XI Congreso Nacional de Investigacion Educativa, del Consejo Mexicano de Investigacion Educativa, del 7 al 11, Delegacion Coyoacan, Mexico, Distrito Federal.
Penner, L. A., Dovidio, J. F., Schroeder, D. A. & Piliavin, J. A. (2005). Prosocial behavior: Multilevel perspectives. Annual Review of Psychology, 56, 365-392. https://doi.org/10.1146/annurev.psych.56.091103.070141
Kauten, R. & Barry, C. T. (2014). Do you think I'm as kind as I do? The relation of adolescent narcissism with self- and peer- perceptions of prosocial and aggressive behavior. Personality and Individual Differences, 61, 69-73. https://doi.org/10.1016/j.paid.2014.01.014
Kauten, R. & Barry, C. T. (2016). Adolescent narcissism and its association with different indices of prosocial behavior. Journal of Research in Personality, 60, 36-45. https://doi.org/10.1016/j.jrp.2015.11.004
Redondo, J., Ingles, C. & Garcia-Fernandez, J. (2014). Conducta prosocial y autoatribuciones academicas en Educacion Secundaria Obligatoria. Anales de Psicologia, 30(2), 482-499. https://doi.org/10.6018/analesps.30.2.148331
Sanchez-Queija, I., Oliva, A. & Parra, A. (2006). Empatia y conducta prosocial durante la adolescencia. Revista de Psicologia Social, 21(3), 259-271. https://doi.org/10.1174/021347406778538230
Silva, F. & Martorell, M. C. (1987). BAS-3. Bateria de Socializacion. Madrid: TEA.
Tur-Porcar, A., Llorca, A., Malonda, E., Samper, P. & Mestre, M. (2016). Empatia en la adolescencia. Relaciones con razonamiento moral prosocial, conducta prosocial y agresividad. Accion Psicologica, 13(2), 3-4. https://doi.org/10.5944/ ap.13.2.17802
Taylor, P. J. & Wood, A. M. (2014). Psychometric properties and development of the Brief Adolescent Prosocial Perception Scale (BAPPS). Journal of Child and Family Studies, 23, 1417-1429. https://doi.org/10.1007/s10826-013-9798-y
Vallejo-Medina, P., Gomez-Lugo, M., Marchal-Bertrand, L., Saavedra-Roa, A., Soler, F. & Morales, A. (2017). Desarrollo de guias para adaptar cuestionarios dentro de una misma lengua en otra cultura. Terapia Psicologica, 35(2), 159-172. https://doi.org/10.4067/s0718-48082017000200159
Yoo, H., Feng, X. & Day, R. D. (2013). Adolescents' empathy and prosocial behavior in the family context: A Longitudinal study. Journal of Youth and Adolescence, 42, 1858-72. https://doi.org/10.1007/s10964-012-9900-6
Weir, K. & Duveen, G. (1981). Further development and validation of the prosocial behaviour questionnaire for use by teachers. Journal of Child Psychology and Psychiatry, 22(4), 357-374. https://doi.org/10.1111/j.1469-7610.1981.tb00561.x
Manuel Marti-Vilar (12), Lorena Corell-Garcia (3), Cesar Merino-Soto
Universitat de Valencia, Espana (1, 2), Universidad de San Martin de Porres, Peru (3)
(1) Doctor en Psicologia. Profesor titular de Universidad de Valencia. Unidad de Investigacion "Pensamiento e Interaccion Social". Direccion postal: Departamento de Psicologia Basica, Facultat de Psicologia de la Universitat de Valencia (Espana). Direccion postal: Avenida Blasco Ibanez, 21. CP: 46010-Valencia. Contacto: Manuel.Marti-Vilar@uv.es ORCID: https://orcid.org/0000-0002-3305-2996
(2) Magister en Psicologia. Unidad de Investigacion "Pensamiento e Interaccion Social". Direccion postal: Departamento de Psicologia Basica, Facultat de Psicologia de la Universitat de Valencia (Espana). Direccion postal: Avenida Blasco Ibanez, 21. CP: 46010-Valencia. Contacto: email@example.com ORCID: https://orcid.org/0000-0001-7980-7189
(3) Magister en Psicologia. Investigador del Instituto de Investigacion en Psicologia de la Universidad de San Martin de Porres. Becario en el Centro de Investigacion Transdisciplinar de Psicologia (Universidad Autonoma del Estado de Morelos, Mexico). Direccion postal: Calle Vieja 332, interior 116, Condominio Bugambilias 2, Cuernavaca, Morelos, CP 62157. Contacto: firstname.lastname@example.org. ORCID: http://orcid.org/0000-0002-1407-8306
Recibido: 26 de febrero, 2018
Revisado: 22 de octubre, 2018
Aceptado: 23 de octubre, 2018
Table 1 Instruments reviewed of the prosocial construct Test name Characteristics (PBQ) Prosocial behaviour 20 items applicable to the all questionnaire (Weir & Duveen, 1981) school stage responsive to parents and tutors. Likert 3 response scale. Family Helping Inventory 56 items. Consisting of 2 (Midlarsky Hannah & Corley 1985) scales: EAH helps siblings, helps parents EAPP (BAS-3) Battery socialization for 75 items. Two possible answers, adolescents (Silva & Martorell, 1987) dichotomous for children over 6 years old and adolescents among 11-19. (TISS)Teenagers Inventory Social 40 items. Consisting of 2 Skills (Inderbitzen & Foster, 1992) scales: prosocial and antisocial behavior, Likert 6 scale. Relationship with peers. Adolescents among 12-18. (PROM) Prosocial Moral Reasoning Moral dilemmas for all ages (Carlo, Einsenberg & Knight, 1992) (CCP) Cuestionario de conducta 55 items of self-evaluation and prosocial (Gomez & Silva, 1993) answered by parents or tutors. Likert 4. Adolescents among 10-17. (PB) Prosocial Behaviour scale 15 items evaluate behaviors such (Midlarsky, Hannah & Corley, 1995) as altruism, trust and likeability Likert 3. Children up to 12 years old. Family Helping Inventory 67 items. Two scales, one for (Midlarsky Hannah & Corley 1995) parents and one for behaviors with siblings. From 12 to 23. Likert 4 (CBS) Child Behavior Scale (Ladd 17 items & Profiler, 1996) (12 items in Peruvian study) (PTM) Escala para la evaluacion 23 items de practicas prosociales (Carlo & Randall, 2002) (PSA) Scale for measuring prosocial 17 items behavior in adults (Caprarra, Steca, Zelli & Capanna, 2006) Cuestionario de conductas Prosocial. 7 items (Sanchez Quejia, Oliva & Parra, 2006) (EHP-A) Escala de habilidades 20 items prosociales para adolescentes (Morales-Rodriguez & Suarez Perez, 2006) Prosocial-antisocial en el trafico. 30 items Lopez de Cozar, E. et al.(2005) (BAPPS) Escala breve de 24 items percepcion prosocial (Taylor & Wood, 2014) (PABSS) Prosocial antisocial 4 subscale for measuring the behaviors in sport (Kavussanu prosocial and antisocial et al., 2015) behavior Test name Languages Psychometric data (PBQ) Prosocial behaviour English & [alpha] = .93-.94 questionnaire (Weir & Duveen, 1981) Spanish Family Helping Inventory English [alpha] = .81 (Midlarsky Hannah & Corley 1985) r between scales: .75 (BAS-3) Battery socialization for Spanish [alpha] = .73-.92 adolescents (Silva & Martorell, 1987) (TISS)Teenagers Inventory Social English & [alpha] = .72 Skills (Inderbitzen & Foster, 1992) Spanish [r.sub.Test-retest] = .90 (PROM) Prosocial Moral Reasoning Spanish [alpha] = .85 (Carlo, Einsenberg & Knight, 1992) and English (CCP) Cuestionario de conducta Spanish [alpha] = .72 prosocial (Gomez & Silva, 1993) r. Pearson .82 (PB) Prosocial Behaviour scale English & [alpha] = .71 (Midlarsky, Hannah & Corley, 1995) Spanish Family Helping Inventory English [alpha] = .73-.80 (Midlarsky Hannah & Corley 1995) (CBS) Child Behavior Scale (Ladd Spanish, [alpha] = .93 & Profiler, 1996) Italian and [alpha] = .85 y .95 English (12 items in Peruvian study) (PTM) Escala para la evaluacion Spanish [alpha] = .74 to de practicas prosociales (Carlo & and .85 Randall, 2002) English (PSA) Scale for measuring prosocial Spanish [alpha] = .91 behavior in adults (Caprarra, Steca, and Zelli & Capanna, 2006) English Cuestionario de conductas Prosocial. Spanish [alpha] = .67 (Sanchez Quejia, Oliva & Parra, 2006) (EHP-A) Escala de habilidades English & [alpha] = .86 prosociales para adolescentes Spanish (Morales-Rodriguez & Suarez Perez, 2006) Prosocial-antisocial en el trafico. Spanish [alpha] = .81 Lopez de Cozar, E. et al.(2005) (BAPPS) Escala breve de English [alpha] = .78 percepcion prosocial (Taylor & Wood, 2014) (PABSS) Prosocial antisocial English - behaviors in sport (Kavussanu et al., 2015) Test name New reviews (PBQ) Prosocial behaviour - questionnaire (Weir & Duveen, 1981) Family Helping Inventory 1995. Review published by the (Midlarsky Hannah & Corley 1985) same creator; black, white and Asian population (referenda) (BAS-3) Battery socialization for 2013. Review and adaptation in adolescents (Silva & Martorell, 1987) Argentine population: Lacunza, Caballero & Contini (2013) (TISS)Teenagers Inventory Social 2014. Relationship of prosocial Skills (Inderbitzen & Foster, 1992) behavior and academic performance. Spanish adaptacion: Ingles et al. (2014) (PROM) Prosocial Moral Reasoning 2002: Spanish adaptation: (Carlo, Einsenberg & Knight, 1992) Mestre, Frias-Navarro, Samper & Tur (2002) 2012: Validation Chinese population: Lai, Siu, Chan, Shek. 2010: New pictorial version (Lemos & Richaud, 2010) (CCP) Cuestionario de conducta 2011. Spanish population prosocial (Gomez & Silva, 1993) revision 2014 Adaptation and comparison between Spain, Colombia and Argentina (Mesurado et al., 2014) (PB) Prosocial Behaviour scale - (Midlarsky, Hannah & Corley, 1995) Family Helping Inventory - (Midlarsky Hannah & Corley 1995) (CBS) Child Behavior Scale (Ladd 2013: Validation and comparison & Profiler, 1996) between American and Italian population, modification of the items (Marcone & Costanzo, 2013) 2011: Validation study carried out in Peru on 256 children (between 2 and 6 years old) rated by 23 female teachers (Meyer et al., 2011). (PTM) Escala para la evaluacion 2003: Adjustment Argentina de practicas prosociales (Carlo & population. Study on differences Randall, 2002) between early and late teens. By: Carlo, Hausmann,, Christiansen & Randall (PSA) Scale for measuring prosocial - behavior in adults (Caprarra, Steca, Zelli & Capanna, 2006) Cuestionario de conductas Prosocial. - (Sanchez Quejia, Oliva & Parra, 2006) (EHP-A) Escala de habilidades 2010: Review and adapt the prosociales para adolescentes instrument to the Mexico (Morales-Rodriguez & Suarez population. Morales-Rodriguez Perez, 2006) and Suarez-Perez Prosocial-antisocial en el trafico. - Lopez de Cozar, E. et al.(2005) (BAPPS) Escala breve de - percepcion prosocial (Taylor & Wood, 2014) (PABSS) Prosocial antisocial The Prosocial and Antisocial behaviors in sport (Kavussanu Behavior in Sport Scale: Further et al., 2015) evidence for construct validity and reliability
|Printer friendly Cite/link Email Feedback|
|Author:||Marti-Vilar, Manuel; Corell-Garcia, Lorena; Merino-Soto, Cesar|
|Date:||Jan 1, 2019|
|Previous Article:||Predictor variables for burnout among nursing professionals.|