Pedro Henrique Berbert de Carvalho1, Maria Aparecida Conti2, Clara Mockdece Neves3, Juliana Fernandes Filgueiras Meireles3, Fernanda Costa Oliveira3, Maria Elisa Caputo Ferreira3
1 Universidade Federal de Juiz de Fora (UFJF) – Campus Governador Valadares.
2 Universidade Cruzeiro do Sul.
3 UFJF – Campus Juiz de Fora.
Received: 2/10/2015 – Accepted: 7/28/2015
Address correspondence to: Pedro Henrique Berbert de Carvalho. Universidade Federal de Juiz de Fora – Campus Governador Valadares. Departamento de Educação Física. Rua José Lourenço Kelmer, s/n, Campus Universitário – 36036-900 – Juiz de Fora, MG, Brazil. Phones: +55 (33) 9114-3073/+55 (32) 9906-4455/+55 (33) 3022-0827. E-mail: [email protected]
Background: The study of male body image has increased substantially, but there are few assessment tools available for this population. The Male Body Dissatisfaction Scale (MBDS) has been widely used among students to research body image disturbances and eating disorders. However, the psychometric properties of this instrument have not been tested in the Brazilian context. Objectives: To explore the psychometric properties (convergent validity, internal consistency, test-retest reliability and factor structure) of the Brazilian version of the MBDS. Methods: Two-hundred sixty-four undergraduate students were evaluated. Pearson’s correlation was used to test the convergent validity of the MBDS and the Drive for Muscularity Scale, the Swansea Muscularity Attitudes Questionnaire, the Rosenberg Self-Esteem Scale, the Beck Depression Inventory, the Eating Attitudes Test-26, and the Commitment to Exercise Scale. Test-retest reliability was evaluated using t-tests for repeated measures and by calculating the coefficient of intraclass correlation. Exploratory factor analysis was conducted, and Cronbach’s α coefficients were determined. A significance level of 5% was adopted. Results: The MBDS had an adequate factor structure, with two factors explaining 52.67% of the total variance. It showed excellent internal consistency (Cronbach’s α between 0.90 and 0.92), a high intraclass correlation coefficient (0.81), and convergent validity with the drive for muscularity, the psychological commitment to exercise, low self-esteem, and eating disorder risk behaviour measures. Discussion: The MBDS appears to be a valid and reliable tool for evaluating Brazilian male body image dissatisfaction.
Carvalho PHB et al. / Arch Clin Psychiatry. 2015;42(4):90-4
Keywords: Body image, men’s health, psychometrics, validation, factor analysis.
Body image dissatisfaction, a negative feeling about one’s appearance1 that has been previously associated with women2, is currently being investigated in males in many countries3-5. In both women and men, body dissatisfaction is associated with low self-esteem, depressive symptoms and risk behaviours associated with eating disorders6.
The concern with physical appearance and body image is a reality in many developed and developing countries and is closely related to health and illness7. In Brazil, the body is a social status symbol, and physical appearance is an essential element in the construction of a national Brazilian identity8. The country was ranked first worldwide in the total number of plastic surgery procedures9, and it stands out for the number of surgical liposuction, blepharoplasty and rhinoplasty procedures performed, demonstrating the importance of physical appearance for Brazilians.
A population-based study conducted in Brazil5 found a 60.5% prevalence rate for body dissatisfaction among men. The study pointed to an association between weight dissatisfaction and physical inactivity, alcohol abuse, obesity and old age. The authors also found an association between dissatisfaction with muscularity and low body mass index and common mental disorders. Santos Silva et al.5 highlighted the need to assess body image dissatisfaction because of its influence on the individual’s health and quality of life.
There are some concerns specific to the assessment of male body dissatisfaction. Cafri and Thompson10 highlighted the need to: a) assess satisfaction with muscularity, b) identify behaviours associated with body dissatisfaction, and c) evaluate satisfaction with specific body parts/regions, such as the shoulders, chest and arms. The authors10 emphasised that a concern with muscularity is the central aspect of male body image. It should also be noted that dissatisfaction with muscularity is a concern among individuals with muscle dysmorphia, a very specific type of body dysmorphic disorder characterised by a fear of being too small and by perceiving oneself as small and weak even when one is actually large and muscular3,6.
Several authors2,10-12 who were aware of these methodological concerns have contributed to psychometric assessment and/or discussions in the field of male body image assessment. Tod et al.12 highlighted four instruments with good psychometric properties: the Drive for Muscularity Scale13, the Drive for Muscularity Attitudes Questionnaire14, Yelland and Tiggemann’s15 Drive for Muscularity Scale, and the Swansea Muscularity Attitudes Questionnaire16.
Two of these instruments have been analysed psychometrically for use with Brazilian males: the Drive for Muscularity Scale and the Swansea Muscularity Attitudes Questionnaire17. However, it should be noted that both instruments were developed to assess the drive for muscularity, which is related to dissatisfaction with body muscularity but is a different construct. In a systematic review, Carvalho and Ferreira2 pointed to the growth in the number of adapted and/or validated instruments for young Brazilian adults. However, despite the growing number of scales and questionnaires for evaluating male body image, none of these instruments allows the respondent to evaluate the relative importance of each item, which can contribute to overestimating or underestimating the value of an item in the total score.
Based on this premise and given the lack of instruments that specifically evaluate the construct of dissatisfaction with body muscularity, Ochner et al.18 developed the Male Body Dissatisfaction Scale (MBDS). Initial evidence of the validity of the MBDS18 included its good psychometric properties, with excellent internal consistency (Cronbach’s α = 0.93) and its convergent validity with self-esteem (Rosenberg Self-Esteem Scale; r = -0.33, p < 0.05), body self-esteem (Shape and Weight-Based Self-Esteem Scale; r = 0.53,
p < 0.01; and Body Esteem Scale; r = -0.29, p < 0.05); and self-reported body satisfaction measures (0 to 100 points, r = -0.52, p < 0.01). In addition, the scale showed good temporal stability (test-retest) of 0.95 (p < 0.0005). Through exploratory factor analysis, Ochner et al.18 proposed a factorial structure with three factors: (1) musculature (items 4, 6, 7, 9, 12, 13, 16 and 24), (2) definition (items 1, 3, 10, 15, 17, 18, 20, 22 and 25) and (3) relative standing/external evaluation (items 2, 5, 8, 11, 14, 19, 21 and 23).
The MBDS was previously evaluated for use with young Brazilian adults (18-30 years old) through an analysis of its conceptual, semantic and instrumental equivalence and an analysis of its internal consistency19. Translation, back-translation, translation synthesis, expert committee evaluation, pre-test, and internal consistency analysis were performed. The MBDS was translated into and adapted to the Portuguese language while maintaining its 25 original items and was shown to be easily understandable with adequate internal consistency (α = 0.92)19.
Although the instrument showed good initial validity, other indicators must also be evaluated. Therefore, the purpose of this study was to explore the psychometric properties (convergent validity, internal consistency, test-retest reliability, and factor structure) of the Brazilian version of the MBDS19. It is believed that such an instrument may be useful as an evaluation tool for clinical and epidemiological research.
Participants and procedures
The sample was composed of 264 Brazilian men with a mean age of 20.13 years (standard deviation [SD] = 1.71 years; range 18-30 years) and a mean body mass index (BMI) of 23.12 kg/m² (SD = 3.07 kg/m²; range 16.78-41.22 kg/m²). BMI was calculated using self-reported weight and height. The participants were from diverse academic departments (Computer Science, Law, Civil Engineering, Electrical Engineering, Philosophy, Physiotherapy, Mathematics, Medicine and Psychology) at the Federal University of Juiz de Fora, Minas Gerais, Brazil and were selected by convenience based on their presence in the classroom and willingness to complete the questionnaires.
After the researchers contacted the course coordinators and teachers, the subjects were addressed in groups during class. They received information about the research objectives and the procedures to be followed, and the anonymity of each participant was ensured. All of the participants signed a written informed consent form authorising their voluntary participation. Then, the participants answered the questionnaires individually. The study was approved by the Research Ethical Board of Clinical Hospital, Medical School, University of São Paulo (protocol number – 0586/08).
The Brazilian version of the MBDS19 contains 25 items rated on a 5-point scale ranging from 1 (always/strongly agree) to 5 (never/strongly disagree); 13 items were reverse-scored (items 4, 5, 6, 7, 9, 10, 12, 13, 16, 17, 22, 24 and 25). In addition to the evaluation along the 5-point Likert scale, the participants rated the importance of each item to them on a scale of 1 to 10. To calculate the total score, the value of each item (degree of importance) was divided by 10 and then multiplied by the Likert scale response to the item (1 to 5). The total MBDS score can range from 2.5 to 125, with higher scores indicating greater body dissatisfaction18.
The Drive for Muscularity Scale (DMS)13 was used to assess the drive for muscularity. The DMS is a self-report scale consisting of 15 items answered using a 6-point Likert-type response format (1 = always to 6 = never). Total scores range from 15 to 90 points. Higher scores represent more troubling attitudes and behaviours toward muscularity. The scale was translated and adapted for young Brazilian adults and had good psychometric properties17. The DMS was used to test the convergent validity of the MBDS.
The Swansea Muscularity Attitudes Questionnaire (SMAQ)16,17, another measure that assesses the drive for muscularity, was used to test the convergent validity of the MBDS. The SMAQ17 consists of 20 items answered using a 7-point Likert-type response format (definitely, strongly agree, agree, neutral, disagree, strongly disagree and definitely not). The total score ranges from 20 to 140 points. Higher scores indicate a higher drive for muscularity.
The Rosenberg Self-Esteem Scale (RSS)20,21 is a widely used measure with strong reliability and validity21. The RSS consists of 10 items rated on a 4-point scale ranging from 1 (strongly agree) to 4 (strongly disagree), with a total score ranging from 10 to 40 points. Higher scores indicate a more positive sense of self. We used the RSS21 to test the convergent validity of the MBDS.
To evaluate depressive symptoms, we used the Beck Depression Inventory (BDI)22. The instrument consists of 21 items rated on a 4-point scale ranging from 0 to 3. The total score can range from 0 to 63 points, with higher scores indicating greater degrees of depression. We used the Brazilian version of the BDI23 to test the convergent validity of the MBDS.
The Eating Attitudes Test (EAT-26)24 is a widely used measure of symptoms and troubling characteristics of eating disorders that displays good psychometric properties. The EAT-26 is a self-report instrument comprising 26 items rated with a 3-point Likert scale format (0 = never, rarely and very rarely, 1 = often, 2 = very often; 3 = always). Item 25 is reverse-scored. According to Nunes et al.25, the EAT-26 has good psychometric properties and satisfactory internal consistency. The EAT-26 was used to assess the convergent validity of the MBDS.
Males with high body dissatisfaction generally engage in regular physical exercise (i.e., weightlifting)6. To assess this characteristic, we used the Commitment to Exercise Scale (CES)26 as a measure of convergent validity. The CES is a visual analogue scale consisting of 8 questions that refer to an individual’s commitment to and behaviours and attitudes towards physical exercise. Each question presents a 155-mm line with two response options, one at the beginning and one at the end of the line. The distance between the beginning of the line and the point the respondent marks is the score for each item. Scores range from 0 to 1,240 points, and the higher the score, the higher the respondent’s degree of psychological commitment to physical exercise26.
Descriptive analyses (mean, standard deviation, minimum and maximum value) were performed for the scores obtained from the MBDS, DMS, SMAQ, RSS, BDI, EAT-26 and CES. To assess the reliability of the applied instruments, Cronbach’s α was estimated for each scale; the results are reported in table 1. Cronbach’s α higher than 0.70 were considered adequate27.
The Kolmogorov-Smirnov test was used to determine normality in the data distribution. Evidence of convergent validity was evaluated with parametric statistical analyses using Pearson’s test of association between the scores of the instruments (DMS, SMAQ, RSS, BDI, EAT-26 and CES) and the MBDS. Correlations of 0.20, 0.40, and 0.60 were considered small, moderate, and strong, respectively28.
To determine the test-retest reliability of the MBDS, a subset of the sample was randomly selected to re-take the test after two weeks29. Fifty-three subjects participated in this phase of the study. They had a mean age of 19.89 years (SD = 1.76 years) and a mean BMI of 22.81 kg/m² (SD = 2.94 kg/m²). The MBDS test-retest reliability was evaluated by comparing the scores obtained (Student’s t test for paired measures) between the two points in time and calculating the intraclass correlation coefficient (ICC). In addition, the internal consistency was verified by calculating Cronbach’s α-coefficient for the two time points29.
The MBDS met the standard criteria for multivariate normality with a Mardia coefficient near zero29. An exploratory factor analysis (EFA) of the MBDS was then conducted. For the initial MBDS validity analysis, Ochner et al.18 included a small sample (fewer than 100 individuals), which some authors29,30 consider the minimum sample size for the EFA. A ratio of 5 to 20 individuals for each item of the instrument, with 10 subjects per item considered an appropriate value29,30, is indicated for validity analyses. The MBDS consists of 25 items, which requires a minimum of 250 subjects for the factor analysis. For this reason, the factor structure used in the original study of the MBDS18 was not considered as a basis for the EFA of the Brazilian version.
Therefore, an EFA was conducted using principal components analysis, followed by Varimax orthogonal rotation and the use of Kaiser criterion (minimal eigenvalue = 1) for the factor extraction29. The data’s suitability for this analysis was assessed using the Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy and Bartlett’s test of sphericity. The factor loading matrix was analysed to identify the items and their correspondence with the factors. A cut-off point of 0.40 was used for the item loading values30. Cronbach’s α was evaluated for each identified factor to determine the internal consistency.
SPSS v.17.0 software was used for all of the analyses, and a significance level of 5% was adopted.
Descriptive analysis and convergent validity
The scores obtained and the correlations between the instruments are summarised in table 1. It is noteworthy that the instruments showed a significant variation in the scores obtained that comprised almost all possible scoring variations for each instrument (minimum score to maximum score). It can also be noted that all of the instruments had adequate internal consistency27.
As expected, the MBDS was associated with almost all of the instruments, indicating convergent validity with various measures (Table 1). Following the cut-offs indicated by Tabachnick and Fidell28, the MBDS showed a direct and strong association with the drive for muscularity measures, the DMS and the SMAQ, and the psychological commitment to exercise. A moderate association was also found between the MBDS and eating disorder risk behaviours, and a small and inverse association was found with self-esteem. Only depressive symptoms (BDI) were not associated with the MBDS.
The MBDS demonstrated very good two-week test-retest reliability. There were no differences (p = 0.13) between the scores obtained at the first and second moment. The intraclass correlation coefficient (0.81) and Cronbach’s α (moment 1 = 0.90 and moment 2 = 0.92) also indicated good test-retest reliability.
Exploratory factor analysis
The Kaiser-Meyer-Olkin measure of sampling (0.89) and Bartlett’s test of sphericity (χ2 (300) = 4367.835; p < 0.001) revealed that the data were suitable for factor analysis. In determining how many factors to retain, a scree plot was also examined, and an item analysis was conducted for various factor solutions. The scree plot suggested four possible factor solutions (Figure 1). The 2-factor model was retained because this model provided the clearest and parsimonious item loadings. In particular, based on examination of the 3- and 4-factor solutions, it was apparent that many of the significant items loaded on several factors, or a single item was saturated by a single factor.
The model obtained in the EFA consisted of two factors: Factor 1 (“Dissatisfaction with body muscularity”; eigenvalue = 9.38) and Factor 2 (“Positive muscle attributes”; eigenvalue = 3.78). Together, these factors explained 52.67% of total variance. The internal consistency of these two factors was considered adequate (Table 2).
The interest in the study of body image in Brazil has been increasing. However, few tools are available for assessing male body image2, and none of the available instruments allows the individual to evaluate the degree of importance of the items. The MBDS places special emphasis on addressing the potential shortcoming of other rating scales and allows each item to be weighted according to individual relevance. For these reasons, the purpose of this study was to examine the convergent validity, internal consistency, test-retest reliability and factor structure of the MBDS19 in Brazilian men.
Regarding convergent validity, the MBDS had direct and strong associations with several measures. As an example, we can mention its relationship with drive for muscularity (DMS and SMAQ) and psychological commitment to exercise (CES). These results support the findings of Murray et al.6, which indicated that body dissatisfaction was strongly related to the drive for muscularity and exercise addiction/dependence.
The MBDS was also negatively associated with self-esteem (RSS) and directly associated with eating disorder risk behaviours (EAT-26). These results were also observed in Murray et al.’s study6. Both, Ochner et al.18 and Rousseau et al.31 found a negative association between the MBDS and self-esteem and body self-esteem. However, Ochner et al.18 identified a marginal association (p = 0.07) between the MBDS and eating disorder risk behaviours (EAT-26; r = 0.32).
The results indicated that the Brazilian version of the MBDS has good temporal stability with a high intraclass correlation coefficient and adequate Cronbach’s α. The principles of validity and reliability are fundamental cornerstones of the scientific method and are essential to the correct assessment of male body image and to strategies for clinical and epidemiological assessment. Similarly, the MBDS’s assessment of each item’s degree of importance in addition to the Likert scale responses increases the scale’s reliability and avoids over- or underestimating an item’s contribution to the total score.
With respect to the EFA, Bartlett’s test of sphericity was significant, and the KMO measure was appropriate. The analysis indicated the presence of two factors named according to the items that comprised them. As previously noted, Ochner et al.18 used a reduced sample for the factor analysis; for that reason, a new EFA was performed for the Brazilian version of the MBDS. Rousseau et al.31 evaluated the factor structure of the MBDS for French adults through exploratory and confirmatory factor analysis. In the French study31, the EFA revealed two factors, “Dissatisfaction with body muscularity” (eight items: 4, 6, 9, 10, 12, 13, 16 and 22) and “General body appearance dissatisfaction” (10 items: 1, 2, 3, 5, 7, 8, 15, 17, 19 and 23), which explained 42.7% of the total variance of the MBDS. Seven items were excluded because they systematically glutted on several factors (4) and because they were identified before the breaking point of 0.40 (3)31.
Although some items from the French version loaded to factors similar to those on the Brazilian version of the MBDS, our study’s solution (two factors) fit the data better than the alternative solutions (3-4 factors). Therefore, the naming of the factors that Rousseau et al.31 suggested was not considered appropriate. In addition, the factor structure identified in the present study kept the scale’s original 25 items, which is important because it allows comparisons between groups from different countries, cultures and languages. Therefore, when possible, it is desirable to maintain compatibility between the original instrument and the version adapted for other cultures.
There are limitations to this study that are important to acknowledge. First, a convenience sample was used, a fact that compromises the generalisability of the results and does not represent cultural diversity. Second, the EAT-26 was used as a proxy for eating disorder risk behaviours to test convergent validity. Although the instrument has demonstrated good psychometric properties, it has high sensitivity and low specificity25. Future studies should try to assess the discriminant validity of the MBDS by comparing a group with eating disorders (correctly identified via clinical interview) with a group without it. Third, a doubly indirect method (BMI) was used to estimate nutritional status in undergraduate students; therefore, the results are subject to measurement errors. Lastly, we note the need to conduct a confirmatory factor analysis; however, doing so would require a sample of approximately 250 individuals29,30. A confirmatory factor analysis with a large sample is planned, and further testing with a heterogeneous sample is required to determine the applicability of the MBDS to more diverse populations. In this sense, a diverse sample including men from different university courses and a variety of other socio-demographic characteristics (race, relationship and socio-economic status) should be taken into account.
Despite these limitations, this study presents empirical results that demonstrate the good validity and reliability of the MBDS19 for evaluating male body dissatisfaction in young Brazilians, thus providing an important tool for clinical and epidemiological research.
We gratefully acknowledge the instrumental support of the Laboratório de Estudos do Corpo (LABESC). We thank the study participants and the Federal University of Juiz de Fora (UFJF) for the partnership in this study.
- Cash TF, Smolak L. Body image: a handbook of science, practice, and prevention. 2nd ed. New York: Guilford Press; 2011.
- Carvalho PHB, Ferreira MEC. Imagem corporal em homens: instumentos avaliativos. Psic Teor Pesq. 2014;30(3):277-85.
- Bradley LA, Rudd N, Reilly A, Freson T. A review of men’s body image literature: what we know, and need to know. Int J Costume Fashion. 2014;14(1):29-45.
- Forbes GB, Jung J, Vaamonde JD, Omar A, Paris L, Formiga NS. Body dissatisfaction and disordered eating in three cultures: Argentina, Brazil, and the U.S. Sex Roles. 2012;66(9-10):677-94.
- Santos Silva DA, Nahas MV, de Sousa TF, Del Duca GF, Peres KG. Prevalence and associated factors with body image dissatisfaction among adults in southern Brazil: a population-based study. Body Image. 2011;8(4):427-31.
- Murray SB, Rieger E, Hildebrandt T, Karlov L, Russell J, Boon E, et al. A comparison of eating, exercise, shape, and weight related symptomatology in males with muscle dysmorphia and anorexia nervosa. Body Image. 2012;9(2):193-200.
- Helman CG. Culture, health and illness: an introduction for health professionals. Oxford: Butterworth-Heinemann; 2014.
- Goldenberg M. The body as capital: understanding Brazilian culture. Vibrant. 2010;7(1):220-38.
- American Society of Plastic Surgery [internet homepage]. 2013 Plastic Surgery Statistics Report. Available from: http://www.plasticsurgery.org/. Accessed on: Nov 10, 2014.
- Cafri G, Thompson JK. Measuring male body image: a review of the current methodology. Psychol Men Mascul. 2004;5(1):18-29.
- Dakanalis A, Timko A, Madeddu F, Volpato C, Clerici M, Riva G, et al. Are the Male Body Dissatisfaction and Drive for Muscularity Scales reliable and valid instruments? J Health Psychol. 2015;20(1):48-59.
- Tod D, Morrison TG, Edwards C. Evaluating validity and test-retest reliability in four drive for muscularity questionnaires. Body Image. 2012;9(3):425-8.
- McCreary DR, Sasse DK. An exploration of the drive for muscularity in adolescent boys and girls. J Am Coll Health. 2000;48(6):297-304.
- Morrison TG, Morrison MA, Hopkins C, Rowan ET. Muscle mania: development of a new scale examining the drive for muscularity in Canadian men. Psychol Men Mascul. 2004;5(1):30-9.
- Yelland C, Tiggemann M. Muscularity and the gay ideal: body dissatisfaction and disordered eating in homosexual men. Eat Behav. 2003;4(2):107-16.
- Edwards S, Launder C. Investigating muscularity concerns in male body image: development of the Swansea Muscularity Attitudes Questionnaire. Int J Eat Disord. 2000;28(1):120-4.
- Campana ANNB, Tavares MCGCF, Swami V, Silva D. An examination of the psychometric properties of Brazilian Portuguese translations of the Drive for Muscularity Scale, the Swansea Muscularity Attitudes Questionnaire, and the Masculine Body Ideal Distress Scale. Psychol Men Mascul. 2013;14(4):376-88.
- Ochner CN, Gray JA, Brickner K. The development and initial validation of a new measure of male body dissatisfaction. Eat Behav. 2009;10(4):197-201.
- Carvalho PHB, Ferreira MEC, Kotait M, Teixeira PC, Hearst N, Cordás TA, et al. Equivalências conceitual, semântica e instrumental: análises preliminares da versão em português (Brasil) da Male Body Dissatisfaction Scale (MBDS). Cad Saude Publica. 2013;29(2):403-09.
- Rosenberg M. Society and the adolescent self-image. Princeton, NJ: Princeton University Press; 1965.
- Hutz CS, Zanon C. Revisão da adaptação, validação e normatização da escala de autoestima de Rosenberg. Aval Psicol. 2010;10(1):41-9.
- Beck AT, Ward CH, Mendelson M, Mock J, Erbaugh J. An inventory for measuring depression. Arch Gen Psychiatry. 1961;4:561-71.
- Gorestein C, Andrade L. Inventário de Depressão de Beck: propriedades psicométricas da versão em português. Rev Psiquiatr Clin. 1998;25(5):245-50.
- Garner DM, Olmsted MP, Bohr Y, Garfinkel PE. The eating attitudes test: psychometric features and clinical correlates. Psychol Med. 1982;12(4):871-8.
- Nunes MA, Camey S, Olinto MTA, Mari JJ. The validity and 4-year test-retest reliability of the Brazilian version of the Eating Attitudes Test-26. Braz J Med Biol Res. 2005;38(11):1655-62.
- Teixeira PC, Hearst N, Matsudo SMM, Cordás TA, Conti MA. Adaptação transcultural: tradução e validação de conteúdo da versão brasileira do Commitment Exercise Scale. Rev Psiquiatr Clin. 2011;38(1):24-8.
- Streiner DL. Starting at the beginning: an introduction to coefficient alpha and internal consistency. J Pers Assess. 2003;80(1):99-103.
- Tabachnick BG, Fidell LS. Using multivariate statistics. 6th ed. Boston, MA: Pearson Education; 2012.
- Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Análise multivariada de dados. 6ª ed. Porto Alegre: Bookman; 2009.
- Kahn JH. Factor analysis in counseling psychology research, training, and practice: principles, advances, and applications. Couns Psychol. 2006;34(5):684-718.
- Rousseau A, Denieul M, Lentillon V, Valls M. French validation of the Male Body Dissatisfaction Scale in a sample of young men. J Ther Comportementale Cogn. 2014;24(3):122-9.