Acessibilidade / Reportar erro

NEO-FFI: Psychometric properties of a short personality inventory in Portuguese context

NEO-FFI: Propriedades psicométricas de um inventário reduzido de personalidade no contexto português

Abstracts

The aim of this study was to assess the psychometric properties (validity and reliability) of the Portuguese adaptation of the NEO Five-Factor Inventory (NEO-FFI) and to compare the obtained structure to the original North American version. The methods of analysis used for cross-validation of the factorial structure were the Principal Axis Factoring (PAF) and the Confirmatory Factor Analysis (CFA). PAF reproduced the original structure of NEO-FFI and CFA revealed a satisfactory fit of single-factor models for the five dimensions. The reliability analysis showed high values of internal consistency which are congruent with previous international adaptations of the NEO-FFI. Multidimensional analysis showed significant main effects of gender and academic qualifications on personality using age as covariant. The findings suggest that the Portuguese version of the NEO-FFI is a reliable instrument to measure the five dimensions of personality.

NEO-FFI; personality; psychometrics; Portuguese context


O objetivo deste estudo foi avaliar as propriedades psicométricas (validade e fidelidade) da adaptação portuguesa do NEO-FFI e comparar a estrutura obtida com a versão original americana. Como métodos para a validação cruzada da estrutura fatorial foram usados a Análise Fatorial de Eixos Principais (PAF) e uma Análise Fatorial Confirmatória (CFA). A PAF reproduziu a estrutura original do NEO-FFI e a CFA revelou modelos uni-factoriais de ajustamento satisfatório para cada uma das cinco dimensões. A análise de fidelidade revelou elevados valores de consistência interna, congruentes com as adaptações prévias internacionais do NEO-FFI. A análise multidimensional revelou efeitos principais significativos do género e das qualificações académicas na personalidade, usando a idade como co-variante. Os resultados sugerem que a versão portuguesa do NEO-FFI é um instrumento fiável para medir as cinco dimensões da personalidade.

NEO-FFI; personalidade; psicometria; contexto português


The Five-Factor Model (FFM) organizes human personality traits across cultures under a comprehensive framework (Costa & McCrae, 1992Costa, P., & McCrae, R. (1992). The revised NEO PI / NEO-FFI professional manual. Odessa, FL: Psychological Assessment Resources. ; Muck, Hell, & Gosling, 2007Muck, P., Hell, B., & Gosling, S. (2007). Construct validation of a short five-factor model instrument. A self-peer study on the German adaptation of the Ten-Item Personality Inventory (TIPI-G). European Journal of Psychological Assessment, 23(3), 166-175. doi:10.1027/1015-5759.23.3.166
https://doi.org/10.1027/1015-5759.23.3.1...
) of five dimensions - Neuroticism, Extraversion, Openness to Experience, Agreeableness and Conscientiousness. The dimensions are empirical generalizations that reflect enduring differences in behavioural, emotional and cognitive patterns between individuals (Costa & McCrae, 1992Costa, P., & McCrae, R. (1992). The revised NEO PI / NEO-FFI professional manual. Odessa, FL: Psychological Assessment Resources. ; Rolland, Parker, & Stumpf, 1998Rolland, J., Parker, W., & Stumpf, H. (1998). A psychometric examination of the French translations of the NEO-PI-R and NEO-FFI. Journal of Personality Assessment, 71(2), 269-291. doi:10.1207/s15327752jpa7102_13
https://doi.org/10.1207/s15327752jpa7102...
). The Revised NEO Personality Inventory (NEO-PI-R; Costa & McCrae, 1992Costa, P., & McCrae, R. (1992). The revised NEO PI / NEO-FFI professional manual. Odessa, FL: Psychological Assessment Resources. ) is a measure of the five dimensions of personality and of the six facets that underlie each dimension. The original NEO-PI-R has high internal consistency levels, good test-retest reliabilities as well as convergent and discriminant validity and the translations available in several idioms are also psychometrically sound (e.g., McCrae et al., 1999McCrae, R., Costa, P., Lima, M. P., Simões, A., Ostendorf, F., Angleitner, A., ...Piedmont, R. (1999). Age differences in personality across the adult life span: Parallels in five cultures. Developmental Psychology, 35(2), 466-477.; McCrae, Terracciano, & Personality Profiles of Cultures Project, 2005McCrae, R., Terracciano, A. , & Personality Profiles of Cultures Project. (2005). Universal features of personality traits from the observer's perspective: Data from 50 cultures. Journal of Personality and Social Psychology, 88, 547-561.).

The NEO-PI-R is a 240-item measure of the FFM's and takes about 45 minutes to complete. The NEO-Five Factor Inventory (NEO-FFI), with 60 items is a shortened version of the NEO-PI-R with equivalent comprehensiveness, but amenable to be applied in research projects that require the administration of a brief instrument to measure the FFM (e.g., Aluja, Garcia, Rossier, & Garcia, 2005Aluja, A., Garcia, O., Rossier, J., & Garcia, L. (2005). Comparison of the NEO-FFI, NEO-FFI-R and an alternative short version of the NEO-PI-R (NEO-60) in Swiss and Spanish samples. Personality and individual Differences, 38(1), 591-604. doi:10.1016/j.paid.2004.05.014
https://doi.org/10.1016/j.paid.2004.05.0...
; Lucas & Donnellan, 2009Lucas, R., & Donnellan, M. (2009). Age differences in personality: Evidence from a nationally representative Australian sample. Developmental Psychology, 45(5), 1353-1363. doi:10.1037/a0013914
https://doi.org/10.1037/a0013914...
). The original NEO-FFI's reliability has been demonstrated in the North American context (Costa & McCrae, 1989Costa, P., & McCrae, R. (1989). The NEO PI manual supplement. Odessa, FL: Psychological Assessment Resources.), with values of internal consistency ranging from .68 to .86, and the same is true for adaptations developed for other cultures (e.g., Aluja et al., 2005Aluja, A., Garcia, O., Rossier, J., & Garcia, L. (2005). Comparison of the NEO-FFI, NEO-FFI-R and an alternative short version of the NEO-PI-R (NEO-60) in Swiss and Spanish samples. Personality and individual Differences, 38(1), 591-604. doi:10.1016/j.paid.2004.05.014
https://doi.org/10.1016/j.paid.2004.05.0...
found values ranging between .70 and .87; Egan, Deary, & Austin, 2000Egan, V., Deary, I., & Austin, E. (2000). The NEO-FFI: Emerging British norms and an item-level analysis sugest N, A, and C are more reliable than O and E. Personality and Individual Differences, 29, 907-920. doi:10.1016/S0191-8869(99)00242-1
https://doi.org/10.1016/S0191-8869(99)00...
, found values ranging between .72 and .87). Alike the NEO-PI-R, the NEO-FFI is cross-culturally stable (Aluja et al., 2005Aluja, A., Garcia, O., Rossier, J., & Garcia, L. (2005). Comparison of the NEO-FFI, NEO-FFI-R and an alternative short version of the NEO-PI-R (NEO-60) in Swiss and Spanish samples. Personality and individual Differences, 38(1), 591-604. doi:10.1016/j.paid.2004.05.014
https://doi.org/10.1016/j.paid.2004.05.0...
; Lucas & Donnellan, 2009Lucas, R., & Donnellan, M. (2009). Age differences in personality: Evidence from a nationally representative Australian sample. Developmental Psychology, 45(5), 1353-1363. doi:10.1037/a0013914
https://doi.org/10.1037/a0013914...
) although there are some exceptions related to failures in the reproduction of structure (e.g., Aluja et al., 2005Aluja, A., Garcia, O., Rossier, J., & Garcia, L. (2005). Comparison of the NEO-FFI, NEO-FFI-R and an alternative short version of the NEO-PI-R (NEO-60) in Swiss and Spanish samples. Personality and individual Differences, 38(1), 591-604. doi:10.1016/j.paid.2004.05.014
https://doi.org/10.1016/j.paid.2004.05.0...
; Furham, 1997Furham, A. F. (1997). Knowing and faking one's five-factor personality score. Journal of Personality Assessment, 69(1), 229-243. ; Korner et al., 2008Korner, A., Geyer, M., Roth, M., Drapeau, M., Schmutzer, G., Albani, C., ...Brahler, E. (2008). Personality assessment with the NEO-Five-Factor Inventory: The 30-Item-Short-Version (NEO-FFI-30). Psychotherapie Psychosomatik Medizinische Psychologie, 58(6), 238-245.). The following strategies have addressed reliability and validity issues with initial versions of the NEO-FFI (McCrae & Costa, 2004McCrae, R., & Costa, P. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences, 36(3), 587-596. doi:10.1016/S0191-8869(03)00118-1
https://doi.org/10.1016/S0191-8869(03)00...
): (a) minimization the effects of acquiescence; (b) increase the correlations with NEO-PI-R factor scores; (c) diversification of the item content by selecting items from underrepresented facets, and increase the intelligibility of the items. Validity and reliability (Cronbach alpha range from .75 to .82) of the new version has been demonstrated (McCrae & Costa, 2004McCrae, R., & Costa, P. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences, 36(3), 587-596. doi:10.1016/S0191-8869(03)00118-1
https://doi.org/10.1016/S0191-8869(03)00...
).

A Portuguese adaptation of NEO-PI-R is available with good psychometric properties (Lima, 1997 Lima, M. P. (1997). NEO-PI-R contextos teóricos e psicométricos. "OCEAN" ou "iceberg"? (Unpublished doctoral dissertation). Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal. ). The factor structure of the Portuguese NEO-PI-R corresponded to the Five-Factor Model, as revealed by varimax-rotated principal components analysis. The factors explained 21% of the variance. This is similar to the North American context, in which the five factors could explain 23% of the variance (Costa, McCrae, & Dye, 1991Costa, P., McCrae, R., & Dye, D. (1991). Facet scales for agreeableness and conscientiousness: A revision of the NEO Personality Inventory. Personality and Individual Differences, 12, 887-898. doi:10.1016/0191-8869(91)90177-D
https://doi.org/10.1016/0191-8869(91)901...
). When the 30 facets were factored, five components could account for 55% of the variance as compared to 58% reported by Costa et al. (1991)Costa, P., & McCrae, R. (1989). The NEO PI manual supplement. Odessa, FL: Psychological Assessment Resources.. Procrustes rotation showed that all factors and all variables had statistically significant patterns of loadings. Overall structures of the Portuguese and the North American were similar. The process of translation complied with international guidelines (e.g., Van de Vijver & Hambleton, 1996Van de Vijver, F. J. R., & Hambleton, R. K. (1996). Translating tests: Some practical guidelines. European Psychologist, 1, 89-99. doi:10.1027/1016-9040.1.2.89
https://doi.org/10.1027/1016-9040.1.2.89...
):

  1. Translation by four Portuguese university faculty fluent in English with various backgrounds on social sciences;

  2. Pilot testing with a small group of 20 subjects and subsequent item editing and reviewing to improve clarity and comprehension by the reader;

  3. Determination of the judgmental evidence using a back-translation of the final version by an English native fluent in Portuguese and

  4. Approval by the authors of the original instrument after minor modifications (Lima, 1997 Lima, M. P. (1997). NEO-PI-R contextos teóricos e psicométricos. "OCEAN" ou "iceberg"? (Unpublished doctoral dissertation). Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal. ). The application of the NEO-PI-R adapted to Portuguese, replicated the FFM, and variations in personality related to age, occupation, education and gender equivalent to many countries: (a) Women were associated with higher scores for Neuroticism and Agreeableness and lower for Extraversion; (b) Older subjects were less neurotic, extravert and open to experience; (c) As compared to non-students, students were more extraverts, neurotic and open to experience and less agreeable and conscientious (Lima, 1997 Lima, M. P. (1997). NEO-PI-R contextos teóricos e psicométricos. "OCEAN" ou "iceberg"? (Unpublished doctoral dissertation). Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal. ; McCrae, Costa, Del Pilar, Rolland, & Parker, 1998McCrae, R., Costa, P., Del Pilar, G., Rolland, J., & Parker, W. (1998). Cross-cultural assessment of the Five-Factor Model: The Revised NEO Personality Inventory. Journal of Cross-Cultural Psychology, 29, 171-188. doi:10.1177/0022022198291009
    https://doi.org/10.1177/0022022198291009...
    ).

The present study reports the development of the Portuguese NEO-FFI to meet research demands in Portugal. Like the original version, the Portuguese NEO-FFI was created with the 12 items of NEO-PI-R from each dimension with the highest correlations with validimax factor scores (McCrae & Costa, 2004McCrae, R., & Costa, P. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences, 36(3), 587-596. doi:10.1016/S0191-8869(03)00118-1
https://doi.org/10.1016/S0191-8869(03)00...
). The primary research objectives of this study were: (a) to assess the psychometric properties of the Portuguese NEO-FFI, (b) to analyze the structure of the Portuguese NEO-FFI relatively to the original North American version.

Materials and Method

Sample

Thousand two hundred and ninety participants answered the Portuguese NEO-FFI. The study excluded subjects with missing values from the analysis (absence of data for more than 30 items of the scale, N=53) and for participants with lower than 30 missings (n=9) a regression imputation (according to each of the personality's dimensions) was performed. The absolute values of skewness and kurtosis for all items were within the acceptable range of the normal distribution (lower than 3.0 and 8.0, respectively; Kline, 2005Kline, R. (2005). Principles and practice of structural equations modelling (2nd ed.). London: Guilford Press.).

The sample included 1237 subjects, 843 were females (68.4%) and 390 males (31.6%), with ages within the range of 18-92 years old (M=42.95; SD=22.77). Participants' educational levels (according to International Standard Classification of Education) included Primary/Level 1 (27.2%), Lower Secondary/Level 2 (9.3%), Secondary/Level 3 (42.9%) and Tertiary Education/Level 5 and 6 (16.7%). The sample and the Portuguese population have similar distributions for further academic qualifications and age groups as reported by Institute of National Statistics (2010Institute of National Statistics. (2010). Indicators on education, training and learning by gender and age. Retrieved from http://www.ine.pt/xportal/xmain?xpid=INE&xpgid=ine_main
http://www.ine.pt/xportal/xmain?xpid=INE...
; the entity responsible for ensuring the production and dissemination of official statistical information), apart from slightly over-representations of Secondary Education (+27%), of age group of 18-24 years old (+25.6%) and females (+16.3%).

Measure

The Portuguese NEO-FFI includes 60 items and can be completed in approximately 15 minutes. The answer format is a 5-point likert scale ranging from 0 (strongly disagree), 1 (disagree), 2 (neutral), 3 (agree) to 4 (strongly agree).

Procedures

Participants answered voluntarily and individually (926 answered on paper and 311 online in a secured computer facility) and confidentiality was guaranteed. In Portugal, the law on experiments on humans does not require ethics approval for studies developed outside biomedical or health sciences which involve human persons the goal of developing knowledge. College age participants were recruited in university contexts and responses from older subjects were collected with snowball sampling started by students in the context of a course assignment. Confidentiality was guaranteed. Data were analysed with PASW Statistics 18 (Predictive Analytics Software) and AMOS 18 (Arbuckle, 2009Arbuckle, J. L. (2009). Amos 18 user's guide. Chicago, IL: Amos Development Corporation.). The factorial structure of NEO-FFI was tested with a holdout method for cross-validation randomizing the full sample into two sub-samples of 619 participants (A) and 618 (B). A Principal Axis Factoring (PAF) was applied to extract the personality dimensions in Sub-sample A. In sub-sample B, cross-validated factor models of Confirmatory Factor Analysis (CFA) were applied (Sample 1=309; Sample 2=309) with Maximum Likelihood estimation method for each dimension (as Gignac, Bates, & Jang, 2007Gignac, G., Bates, T., & Jang, K. (2007). Implications relevant to CFA model misfit, reliability, and five-factor model as measured by the NEO-FFI. Personality and Individual Differences, 43, 1051-1062. doi:10.1016/j.paid.2007.02.024
https://doi.org/10.1016/j.paid.2007.02.0...
) and for all five factors. The reliability of the five dimensions was tested with Cronbach's alpha and with estimates of an equally weighted composite (as Gignac et al., 2007Gignac, G., Bates, T., & Jang, K. (2007). Implications relevant to CFA model misfit, reliability, and five-factor model as measured by the NEO-FFI. Personality and Individual Differences, 43, 1051-1062. doi:10.1016/j.paid.2007.02.024
https://doi.org/10.1016/j.paid.2007.02.0...
). Additionally, as personality factors structure can be different considering education level, a PAF was performed with whole sample (N=1237) divided into two groups of education: Level 1 and 2 vs Level 3, 4 and 5.

Results

Principal Axis Factoring (PAF)

The underlying assumptions for PAF (with direct oblimin rotation) fixed for five factors were guaranteed: KMO=.85 and Bartlett's Test of Sphericity significant (p<.001). The structure reproduced the five dimensions of personality (Table 1). There were 10 items either with the highest loadings on unintended factors (i.e., items 164, 87, 19, 162, 104 and 67) or on the intended factor but with loadings less than .30 (i.e., items 1, 45, 93 and 109; grey highlights on Table 1). The total explained variance before oblimin rotation was 35.2%.

Table 1
Principal Axis Factoring with Direct Oblimin Rotation Solutions of NEO-FFI Items

PAF analysis considering the educational background produced two different structures and guaranteed underlying assumptions - significant Bartlett's Tests of Sphericity (p<.001) and adequate KMO (KMO=.86 and .84, respectively for "secondary and tertiary education" and "primary and lower secondary education"). The "secondary and tertiary education" group revealed a five factor structure with 11 items with incongruent loadings and an explained variance of 35.39%. For the "primary and lower secondary education" group, the number of items with incongruent loadings was higher (18 items) and the explained variance was similar (34.48%; Tables 8-9 Appendix Appendix Table 1 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Neuroticism Note. All factor loadings were statistically signifi cant (p<.001); χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum;Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 2 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Extraversion Note. All factor loadings were statistically signifi cant (p<.001); χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 3 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Openness to Experience Note. All factor loadings were statistically signifi cant (p<.001);χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 4 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Agreeableness Note. All factor loadings were statistically signifi cant (p<.001);χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 5 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Conscientiousness Note. All factor loadings were statistically signifi cant (p<.001);χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 6 Completely Standardized MLE Residual Correlations for Satisfactory Fitting Single-Factor Models: Openness, Extraversion and Conscientiousness Note. Σ= Sum; |dif| = difference between 1 and 2. Table 7 Completely Standardized MLE Residual Correlations for Satisfactory Fitting Single-Factor Models: Neuroticism, Agreeableness Note. Σ= Sum; |dif| = difference between 1 and 2. Table 8 Principal Axis Factors with Direct Oblimin Rotation Solutions of NEO-FFI Items for Secondary and Tertiary Education Note. Larger loadings are in bold for each component. Grey highlights the expected factor of each item. Table 9 Principal Axis Factors with Direct Oblimin Rotation Solutions of NEO-FFI Items for Primary and Lower Secondary Education Note. Larger loadings are in bold for each component. Grey highlights the expected factor of each item. ).

Confirmatory Factor Analysis (CFA)

In order to guarantee the adequacy of exploratory and confirmatory factor analysis statistical procedures a regression imputation was performed (according to each of the personality's dimensions) in nine participants (.7% of the total sample). The analysis revealed that such participants answered more than 30 items of the scale and their missing answers were not in a specific personality trait. Since the initial 1237 participants were divided into three subsamples (EFA, n=619; CFA subsample 1, n=309; CFA subsample 2, n=309) we have explored for possible univariate (through z-scores > |3.3|, p=.001 criteria) or multivariate (through Mahalanobis distance, p=.001 criteria) outliers. The proportion of participants that were not considered to be uni or multivariate outliers was substantially high (90.3% for EFA sample, 87.4% for CFA subsample 1 and 90.0% for CFA subsample 2) and the proportions of participants that were simultaneously uni or multivariate outliers was in fact very small (3.6% for EFA sample, 4.5% for CFA subsample 1 and 3.2% for CFA subsample 2).

The skewness and kurtosis values were within the acceptable range of the normal distribution (lower than 3.0 and 8.0, respectively; Kline, 2005Kline, R. (2005). Principles and practice of structural equations modelling (2nd ed.). London: Guilford Press.). Furthermore, for the EFA sample skewness values varied between -1.207 (minimum) and .565 (maximum) and kurtosis values varied between -1.094 and 2.779. Similar results were obtained for the two CFA sub samples (skewness: CFA subsample 1, between -1.376 and .670; CFA subsample 2, between -1.361 and .545; kurtosis: CFA subsample 1, between -1.135 and 3.207; CFA subsample 2, between -1.116 and 3.649). Multicolinearity diagnosis was also performed based on tolerance scores. The minimum values obtained were .362 for EFA sample, .320 for CFA subsample 1 and .353 for CFA subsample 2, meaning that there was no multicolinearity problems. Based on these results we have decided to maintain all the participants and it gave us some guarantees to proceed with the subsequent analysis.

The fit statistics/indexes obtained with CFA for each personality dimension are summarized on Table 2. Single-models with "no correlated errors" ("Poor") showed poor fit indexes considering the Comparative Fit Index (CFI) and Root Mean Square Error of Aproximation (RMSEA; Hu & Bentler, 1999Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modelling, 6(1), 1-55. doi:10.1080/10705519909540118
https://doi.org/10.1080/1070551990954011...
; Schermelleh-Engel, Moosbrugger, & Muller, 2003Schermelleh-Engel, K., Moosbrugger, H., & Muller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23-74.). Second single-models were tested to improve these indexes including correlated errors for the items that belong to the same facet and for other items based on Modifications Indices ("Satisfactory"). The model with five dimensions showed poor fit indexes with and without correlated errors (Table 2).

Table 2
Summary of Maximum Likelihood Model Fit Statistics/Indexes

Reliability

Cronbach's Alpha values were: Conscientiousness =.81, Neuroticism = .81, Extraversion = .75, Agreeableness = .72 and Openness = .71, which are similar to the ones reported for the original NEO-FFI in the USA (McCrae & Costa, 2004McCrae, R., & Costa, P. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences, 36(3), 587-596. doi:10.1016/S0191-8869(03)00118-1
https://doi.org/10.1016/S0191-8869(03)00...
).

The alternative estimates of internal consistency by standardized factor loadings (corresponding to χ) and standardized errors variances (corresponding to δ) are presented in Tables 1-5 in Appendix Appendix Table 1 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Neuroticism Note. All factor loadings were statistically signifi cant (p<.001); χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum;Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 2 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Extraversion Note. All factor loadings were statistically signifi cant (p<.001); χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 3 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Openness to Experience Note. All factor loadings were statistically signifi cant (p<.001);χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 4 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Agreeableness Note. All factor loadings were statistically signifi cant (p<.001);χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 5 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Conscientiousness Note. All factor loadings were statistically signifi cant (p<.001);χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 6 Completely Standardized MLE Residual Correlations for Satisfactory Fitting Single-Factor Models: Openness, Extraversion and Conscientiousness Note. Σ= Sum; |dif| = difference between 1 and 2. Table 7 Completely Standardized MLE Residual Correlations for Satisfactory Fitting Single-Factor Models: Neuroticism, Agreeableness Note. Σ= Sum; |dif| = difference between 1 and 2. Table 8 Principal Axis Factors with Direct Oblimin Rotation Solutions of NEO-FFI Items for Secondary and Tertiary Education Note. Larger loadings are in bold for each component. Grey highlights the expected factor of each item. Table 9 Principal Axis Factors with Direct Oblimin Rotation Solutions of NEO-FFI Items for Primary and Lower Secondary Education Note. Larger loadings are in bold for each component. Grey highlights the expected factor of each item. . The standardized correlated errors are presented in Tables 6-7 in Appendix Appendix Table 1 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Neuroticism Note. All factor loadings were statistically signifi cant (p<.001); χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum;Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 2 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Extraversion Note. All factor loadings were statistically signifi cant (p<.001); χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 3 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Openness to Experience Note. All factor loadings were statistically signifi cant (p<.001);χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 4 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Agreeableness Note. All factor loadings were statistically signifi cant (p<.001);χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; Σ2= Sum Square; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 5 Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Conscientiousness Note. All factor loadings were statistically signifi cant (p<.001);χ = standardized factor loadings; δ = standardized errors variances; Σ= Sum; ωA = reliability estimates for poor model; ωB = reliability estimates for satisfactory model. Table 6 Completely Standardized MLE Residual Correlations for Satisfactory Fitting Single-Factor Models: Openness, Extraversion and Conscientiousness Note. Σ= Sum; |dif| = difference between 1 and 2. Table 7 Completely Standardized MLE Residual Correlations for Satisfactory Fitting Single-Factor Models: Neuroticism, Agreeableness Note. Σ= Sum; |dif| = difference between 1 and 2. Table 8 Principal Axis Factors with Direct Oblimin Rotation Solutions of NEO-FFI Items for Secondary and Tertiary Education Note. Larger loadings are in bold for each component. Grey highlights the expected factor of each item. Table 9 Principal Axis Factors with Direct Oblimin Rotation Solutions of NEO-FFI Items for Primary and Lower Secondary Education Note. Larger loadings are in bold for each component. Grey highlights the expected factor of each item. . The summary of reliability estimates is presented in Table 3.

Table 3
Summary of Reliability Estimates for Samples 1 and 2

Factors Inter-Correlation

Table 4 reports the inter-correlations between the five factors produced by PAF. Low, significant and positive correlations were found between: (a) Extraversion and Openness or Conscientiousness; (b) Conscientiousness and Agreeableness. Neuroticism and Extraversion, Openness or Conscientiousness showed negative correlations. Correlations ranged from -.01 to .24.

Table 4
Intercorrelations Matrix

Multivariate Analysis

The academic qualifications diverged related to age [t (1173) = 32.26, p<.001]: subjects with "Primary/Lower Secondary Education" (M=61.4) were significantly older than those with "Secondary/Tertiary Education" (M=30). To control the effect of age on academic qualifications, a MANCOVA was performed after assuring assumptions of homogeneity of Covariance Matrices and Multicollinearity and Singularity.

Significant main effects of gender and academic qualifications on personality dimensions were found, using age as a covariant. Results indicated that females scored significantly higher on Neuroticism [F(1,1174)=54.12, p<.001; χ2 p = .044, 95% CI (2.67, 5.01)], Conscientiousness [F(1,1174)=5.00, p<.05; χ2 p = .004, 95% CI (.26, 2.27)] and Agreeableness [F(1,1174)=14.40, p<.001; χ2 p = .012, 95% CI (.81, 2.60)]. Participants with "Primary Education/Lower Education" scored significantly lower on Openness [F(1,1174)=46.56, p<.001; χ2 p = .038, 95% CI (-4.42, -1.87)] than those with "Secondary/Tertiary Education". In a bivariate analysis, significant, moderate and negative correlations were found between age and Extraversion (r =-.276, p <.001) and Openness (r =-.450, p <.001). Low but significant and positive correlation was found between age and Conscientiousness (r=.091, p<.01).

Discussion

The NEO- FFI is used across cultures to measure the five dimensions of personality. The present work assessed the psychometric properties of the Portuguese NEO-FFI, an instrument developed with items taken from the NEO-PI-R to meet the need for a shortened measure of personality in Portugal. The results obtained with Principal Axis Factoring and Confirmatory Factor Analysis showed that the Portuguese NEO-FFI is largely equivalent to the original version (McCrae & Costa, 2004McCrae, R., & Costa, P. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences, 36(3), 587-596. doi:10.1016/S0191-8869(03)00118-1
https://doi.org/10.1016/S0191-8869(03)00...
) and further confirms that the five dimensions of personality are present in the Portuguese population.

Research that involves the adaptations of psychometric instruments must deal with difficulties arising from cultural and linguistic differences between the source and target languages, and with higher item factor loadings in alternative dimensions. There were six such items in the present study, probably due to the following dissimilar interpretations: (a) "I usually prefer to do things alone" (item 67) is regarded a sign of individualism associated with arrogance/ overconfidence/ pride (connected to the absence of Agreeableness instead of Extroversion); (b) "Most people I know like me" (item 164) is commonly seen as conceit (connected to Extroversion instead of Agreeableness); (c) "I'm not a cheerful optimist" (item 87, which is originally from Extroversion) and "I would rather cooperate with others than compete with them" (item 19, which is originally from Agreeableness) can be seen as a sign of distress or neuroticism (connected to Neuroticism); (d) "I would rather go my own way than be a leader of others" (item 162) can be perceived as self-centeredness with a neurotic flavor (connected to Neuroticism instead of Extroversion); (e) "I generally try to be thoughtful and considerate" (item 104) can be viewed as an indicator or self-discipline (which relates to conscientiousness (.35) instead of Agreeableness (.33). We maintain that the Portuguese NEO-FFI should not be revised strictly according to the empirical factor loadings, since the dimensions measured are broad and the losses in internal consistency do not harm the reliability of any dimension. Within the context of the original and adaptations of NEO-FFI, previous circumstances of mismatches of item loadings, the primacy was conferred to theoretical / conceptual aspects over empirical loadings (McCrae & Costa, 2004McCrae, R., & Costa, P. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences, 36(3), 587-596. doi:10.1016/S0191-8869(03)00118-1
https://doi.org/10.1016/S0191-8869(03)00...
).

Given the reported concerns on the robustness of NEO-FFI, we triangulated methods - cross-validation, reliability and inter-correlations - to study the Portuguese adaptation. We essentially found coherency between the results arising from the different methods. The values for the dimensional internal consistencies were congruent with values reported previously for other countries (McCrae & Costa, 2004McCrae, R., & Costa, P. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences, 36(3), 587-596. doi:10.1016/S0191-8869(03)00118-1
https://doi.org/10.1016/S0191-8869(03)00...
), at the acceptable (for Openness, Extraversion and Agreeableness) and robust (for Neuroticism and Conscientiousness) levels. The intercorrelations revealed by PAF between personality factors were significant and could reflect a general factor of personality as suggested by other authors (Bäckstrom, Bjorklund, & Larsson, 2009Bäckstrom, M., Bjorklund, F., & Larsson, M. (2009). Five-factor inventories have a major general factor related to social desirability which can be reduced by framing items neutrally. Journal of Research in Personality, 43, 335-344. doi:10.1016/j.jrp.2008.12.013
https://doi.org/10.1016/j.jrp.2008.12.01...
). The construct validity of the Portuguese NEO-FFI was assessed with PAF and CFA single models that originated fit indexes above the consensus cutoff points for such circumstances (Hu & Bentler, 1999Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modelling, 6(1), 1-55. doi:10.1080/10705519909540118
https://doi.org/10.1080/1070551990954011...
; Schermelleh-Engel et al., 2003Schermelleh-Engel, K., Moosbrugger, H., & Muller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23-74.). The international literature on validation of NEOFFI adaptations presents different approaches of CFA (Egan et al., 2000Egan, V., Deary, I., & Austin, E. (2000). The NEO-FFI: Emerging British norms and an item-level analysis sugest N, A, and C are more reliable than O and E. Personality and Individual Differences, 29, 907-920. doi:10.1016/S0191-8869(99)00242-1
https://doi.org/10.1016/S0191-8869(99)00...
; Gignac et al., 2007Gignac, G., Bates, T., & Jang, K. (2007). Implications relevant to CFA model misfit, reliability, and five-factor model as measured by the NEO-FFI. Personality and Individual Differences, 43, 1051-1062. doi:10.1016/j.paid.2007.02.024
https://doi.org/10.1016/j.paid.2007.02.0...
). In the present study, CFA was performed based on current evidence that suggest an alternative factorial method for testing personality structure. Based on the relative interdependence of the five personality dimensions, the recommendation is that CFA is applied to each dimension individually instead of considering the 5 dimensions of personality as a single model (Gignac et al., 2007). In fact, the application of a CFA global model failed to originate fit indexes adjusted to data above the same cutoff points. A biasing effect on the reliability by the misfit CFA model was found in our data, as reported previously by Gignac and colleagues (2007).

The validity of the Portuguese NEOFFI is corroborated by congruencies of the Portuguese NEO-FFI and NEO-PI-R (Lima, 1997 Lima, M. P. (1997). NEO-PI-R contextos teóricos e psicométricos. "OCEAN" ou "iceberg"? (Unpublished doctoral dissertation). Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal. ) and by with international studies (McCrae & Costa, 2004McCrae, R., & Costa, P. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences, 36(3), 587-596. doi:10.1016/S0191-8869(03)00118-1
https://doi.org/10.1016/S0191-8869(03)00...
). Firstly, the study found a main effect of gender and academic qualifications on personality using age as covariate. Secondly, the study replicated the "crucial practical importance" (Hojat & Hu, 2004, p. 243Hojat, M., & Xu, G. (2004). A visitor's guide to effect sizes: Statistical significance versus practical (clinical) importance of research findings. Advances in Health Sciences Education: Theory and Practice, 9(3), 241-249.) of the association between academic qualifications and personality, as higher education had a positive effect on personality scores (perhaps reflecting college students' relatively stronger will for stimulating experiences and for pursuing knowledge). Thirdly, there was a female gender effect on Neuroticism, Conscientiousness and Agreeableness - in this case with small effect size estimates (Colliver, 2007Colliver, J. (2007). Effect-size measures and research in developmental and behavioral pediatrics. Journal of Developmental & Behavioral Pediatrics, 28(2), 145-150. doi:101097/DBP.0b013e318045beee
https://doi.org/10.1097/DBP.0b013e318045...
; Lecroy & Krysik, 2007Lecroy, C., & Krysik, J. (2007). Understanding and interpreting effect size measures. Social Work Research, 31(4), 243-248. ). This result is theoretically plausible as the literature suggests that there are some psychosocial gender specificities, specifically, the more investment of women in nurturing than men (reflecting more agreeableness), the tendency to feel depressed or anxious more prevalent in women (higher neurotic scores), and the emphasis on social expectations of an appropriate behavior that is more prominent for females than males (Aluja et al., 2005Aluja, A., Garcia, O., Rossier, J., & Garcia, L. (2005). Comparison of the NEO-FFI, NEO-FFI-R and an alternative short version of the NEO-PI-R (NEO-60) in Swiss and Spanish samples. Personality and individual Differences, 38(1), 591-604. doi:10.1016/j.paid.2004.05.014
https://doi.org/10.1016/j.paid.2004.05.0...
; Costa, Terracciano, & McCrae, 2001Costa, P., Terracciano, A., & McCrae, R. (2001). Gender differences in personality traits across cultures: Robust and surprising findings. Journal of Personality and Social Psychology, 81, 322-331.). Finally, the age correlated with three personality dimensions (Lima, 1997 Lima, M. P. (1997). NEO-PI-R contextos teóricos e psicométricos. "OCEAN" ou "iceberg"? (Unpublished doctoral dissertation). Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal. ; McCrae et al., 1999McCrae, R., Costa, P., Lima, M. P., Simões, A., Ostendorf, F., Angleitner, A., ...Piedmont, R. (1999). Age differences in personality across the adult life span: Parallels in five cultures. Developmental Psychology, 35(2), 466-477.), negatively for Extraversion and Openness, and higher on Conscientiousness, a recurrent finding related to the "psychosocial maturity" of the participants (McCrae et al., 1999McCrae, R., Costa, P., Lima, M. P., Simões, A., Ostendorf, F., Angleitner, A., ...Piedmont, R. (1999). Age differences in personality across the adult life span: Parallels in five cultures. Developmental Psychology, 35(2), 466-477.).

In summary, the Portuguese NEO-FFI is a reliable personality measurement tool, more convenient than the NEO-PI-R. As in the original version, gains in convenience are met at the expense of loss of information concerning NEO-PI-R facets. The study's main limitation was the use of samples of convenience mostly college age, which might condition the generalizability of the results to the Portuguese population. Nevertheless, the NEO-FFI revealed the primary dimensions of personality proposed in the Five Factor Model in Portuguese subjects. This study's demonstration of the validity and reliability of the Portuguese Neo-FFI contributes to international research on personality and paves the way for future comparative and collaborative research on the FFM incorporating Portuguese participants.

References

  • Aluja, A., Garcia, O., Rossier, J., & Garcia, L. (2005). Comparison of the NEO-FFI, NEO-FFI-R and an alternative short version of the NEO-PI-R (NEO-60) in Swiss and Spanish samples. Personality and individual Differences, 38(1), 591-604. doi:10.1016/j.paid.2004.05.014
    » https://doi.org/10.1016/j.paid.2004.05.014
  • Arbuckle, J. L. (2009). Amos 18 user's guide. Chicago, IL: Amos Development Corporation.
  • Bäckstrom, M., Bjorklund, F., & Larsson, M. (2009). Five-factor inventories have a major general factor related to social desirability which can be reduced by framing items neutrally. Journal of Research in Personality, 43, 335-344. doi:10.1016/j.jrp.2008.12.013
    » https://doi.org/10.1016/j.jrp.2008.12.013
  • Colliver, J. (2007). Effect-size measures and research in developmental and behavioral pediatrics. Journal of Developmental & Behavioral Pediatrics, 28(2), 145-150. doi:101097/DBP.0b013e318045beee
    » https://doi.org/10.1097/DBP.0b013e318045beee
  • Costa, P., & McCrae, R. (1989). The NEO PI manual supplement. Odessa, FL: Psychological Assessment Resources.
  • Costa, P., & McCrae, R. (1992). The revised NEO PI / NEO-FFI professional manual. Odessa, FL: Psychological Assessment Resources.
  • Costa, P., McCrae, R., & Dye, D. (1991). Facet scales for agreeableness and conscientiousness: A revision of the NEO Personality Inventory. Personality and Individual Differences, 12, 887-898. doi:10.1016/0191-8869(91)90177-D
    » https://doi.org/10.1016/0191-8869(91)90177-D
  • Costa, P., Terracciano, A., & McCrae, R. (2001). Gender differences in personality traits across cultures: Robust and surprising findings. Journal of Personality and Social Psychology, 81, 322-331.
  • Egan, V., Deary, I., & Austin, E. (2000). The NEO-FFI: Emerging British norms and an item-level analysis sugest N, A, and C are more reliable than O and E. Personality and Individual Differences, 29, 907-920. doi:10.1016/S0191-8869(99)00242-1
    » https://doi.org/10.1016/S0191-8869(99)00242-1
  • Furham, A. F. (1997). Knowing and faking one's five-factor personality score. Journal of Personality Assessment, 69(1), 229-243.
  • Gignac, G., Bates, T., & Jang, K. (2007). Implications relevant to CFA model misfit, reliability, and five-factor model as measured by the NEO-FFI. Personality and Individual Differences, 43, 1051-1062. doi:10.1016/j.paid.2007.02.024
    » https://doi.org/10.1016/j.paid.2007.02.024
  • Hojat, M., & Xu, G. (2004). A visitor's guide to effect sizes: Statistical significance versus practical (clinical) importance of research findings. Advances in Health Sciences Education: Theory and Practice, 9(3), 241-249.
  • Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modelling, 6(1), 1-55. doi:10.1080/10705519909540118
    » https://doi.org/10.1080/10705519909540118
  • Institute of National Statistics. (2010). Indicators on education, training and learning by gender and age. Retrieved from http://www.ine.pt/xportal/xmain?xpid=INE&xpgid=ine_main
    » http://www.ine.pt/xportal/xmain?xpid=INE&xpgid=ine_main
  • Kline, R. (2005). Principles and practice of structural equations modelling (2nd ed.). London: Guilford Press.
  • Korner, A., Geyer, M., Roth, M., Drapeau, M., Schmutzer, G., Albani, C., ...Brahler, E. (2008). Personality assessment with the NEO-Five-Factor Inventory: The 30-Item-Short-Version (NEO-FFI-30). Psychotherapie Psychosomatik Medizinische Psychologie, 58(6), 238-245.
  • Lecroy, C., & Krysik, J. (2007). Understanding and interpreting effect size measures. Social Work Research, 31(4), 243-248.
  • Lima, M. P. (1997). NEO-PI-R contextos teóricos e psicométricos. "OCEAN" ou "iceberg"? (Unpublished doctoral dissertation). Faculty of Psychology and Educational Sciences, University of Coimbra, Portugal.
  • Lucas, R., & Donnellan, M. (2009). Age differences in personality: Evidence from a nationally representative Australian sample. Developmental Psychology, 45(5), 1353-1363. doi:10.1037/a0013914
    » https://doi.org/10.1037/a0013914
  • McCrae, R., & Costa, P. (2004). A contemplated revision of the NEO Five-Factor Inventory. Personality and Individual Differences, 36(3), 587-596. doi:10.1016/S0191-8869(03)00118-1
    » https://doi.org/10.1016/S0191-8869(03)00118-1
  • McCrae, R., Costa, P., Del Pilar, G., Rolland, J., & Parker, W. (1998). Cross-cultural assessment of the Five-Factor Model: The Revised NEO Personality Inventory. Journal of Cross-Cultural Psychology, 29, 171-188. doi:10.1177/0022022198291009
    » https://doi.org/10.1177/0022022198291009
  • McCrae, R., Costa, P., Lima, M. P., Simões, A., Ostendorf, F., Angleitner, A., ...Piedmont, R. (1999). Age differences in personality across the adult life span: Parallels in five cultures. Developmental Psychology, 35(2), 466-477.
  • McCrae, R., Terracciano, A. , & Personality Profiles of Cultures Project. (2005). Universal features of personality traits from the observer's perspective: Data from 50 cultures. Journal of Personality and Social Psychology, 88, 547-561.
  • Muck, P., Hell, B., & Gosling, S. (2007). Construct validation of a short five-factor model instrument. A self-peer study on the German adaptation of the Ten-Item Personality Inventory (TIPI-G). European Journal of Psychological Assessment, 23(3), 166-175. doi:10.1027/1015-5759.23.3.166
    » https://doi.org/10.1027/1015-5759.23.3.166
  • Rolland, J., Parker, W., & Stumpf, H. (1998). A psychometric examination of the French translations of the NEO-PI-R and NEO-FFI. Journal of Personality Assessment, 71(2), 269-291. doi:10.1207/s15327752jpa7102_13
    » https://doi.org/10.1207/s15327752jpa7102_13
  • Schermelleh-Engel, K., Moosbrugger, H., & Muller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8(2), 23-74.
  • Van de Vijver, F. J. R., & Hambleton, R. K. (1996). Translating tests: Some practical guidelines. European Psychologist, 1, 89-99. doi:10.1027/1016-9040.1.2.89
    » https://doi.org/10.1027/1016-9040.1.2.89

Appendix

Table 1
Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Neuroticism
Table 2
Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Extraversion
Table 3
Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Openness to Experience
Table 4
Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Agreeableness
Table 5
Completely Standardized MLE Parameter Estimates for Poor and Satisfactory Fitting Single-Factor Models: Conscientiousness
Table 6
Completely Standardized MLE Residual Correlations for Satisfactory Fitting Single-Factor Models: Openness, Extraversion and Conscientiousness
Table 7
Completely Standardized MLE Residual Correlations for Satisfactory Fitting Single-Factor Models: Neuroticism, Agreeableness
Table 8
Principal Axis Factors with Direct Oblimin Rotation Solutions of NEO-FFI Items for Secondary and Tertiary Education
Table 9
Principal Axis Factors with Direct Oblimin Rotation Solutions of NEO-FFI Items for Primary and Lower Secondary Education

Publication Dates

  • Publication in this collection
    Oct-Dec 2014

History

  • Received
    16 Nov 2012
  • Reviewed
    25 June 2013
  • Accepted
    19 July 2013
Curso de Pós-Graduação em Psicologia da Universidade Federal do Rio Grande do Sul Rua Ramiro Barcelos, 2600 - sala 110, 90035-003 Porto Alegre RS - Brazil, Tel.: +55 51 3308-5691 - Porto Alegre - RS - Brazil
E-mail: prc@springeropen.com