Next Article in Journal
A Longitudinal Study of the Relation between Childhood Activities and Psychosocial Adjustment in Early Adolescence
Next Article in Special Issue
Emotional Regulation and Academic Performance in the Academic Context: The Mediating Role of Self-Efficacy in Secondary Education Students
Previous Article in Journal
Dating Violence: Idealization of Love and Romantic Myths in Spanish Adolescents
Previous Article in Special Issue
Predictors of Adolescent Depressive Symptoms
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Measurement Invariance in the Center for Epidemiologic Studies-Depression (CES-D) Scale among English-Speaking Whites and Asians

Department of Social Psychology, Toyo University, 5-28-20 Hakusan, Bunkyo-ku, Tokyo 112-8606, Japan
Int. J. Environ. Res. Public Health 2021, 18(10), 5298; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18105298
Submission received: 7 March 2021 / Revised: 11 May 2021 / Accepted: 14 May 2021 / Published: 16 May 2021
(This article belongs to the Special Issue Community Public Mental Health Care)

Abstract

:
The Center for Epidemiologic Studies Depression (CES-D) Scale has been widely used to measure depressive symptoms. This study compared the measurement invariances for one-, two-, three-, and four-factor models of the CES-D across English-speaking Whites and Asians: White Americans, White Australians, Indians, Filipinos, and Singaporeans. White Americans and Australians, Indians, Filipinos, and Singaporeans English speakers (782 men and 824 women) whose ages ranged from 20 to 79 years, completed the CES-D. They were recruited from the data pool of the 2013 and 2014 Coping and Health Survey. Confirmatory factor analyses indicated that the original four-factor model showed the best fit, compared to the other models. Mean and covariance structure analyses showed that the factor means of the CES-D subscales among Whites were significantly lower than were those among Asians; the score gap was particularly high between Whites and Indians. Additionally, Indians scored the highest on all subscales of the CES-D compared to all other countries. Overall, CES-D scores among Whites were lower than those among Asians.

1. Introduction

According to a face-to face household survey of community adults [1], the 12-month prevalence of mood disorders in Asia and America ranges from 1.7% to 3.1% and 4.8% to 9.6%, respectively; depression is a leading cause of disability worldwide. The Center for Epidemiologic Studies Depression (CES-D) Scale [2] is a 20-item self-reported questionnaire designed to measure depressive symptoms among general populations. It has been widely used in many countries with many racial/ethnic groups [3]; indeed, in a list of the 100 most-cited papers of all time by Nature in 2014 [4], the article [2] reporting on the development of the CES-D was 51st (N = 17,055 citations).
Researchers must address measurement invariance when examining cross-cultural differences in CES-D scores because, without measurement equivalence across ethnic or cultural groups, it is difficult to interpret the differences in observed mean scores meaningfully [5]. Radloff [2] originally proposed a four-factor model for the CES-D, comprising depressed affect, somatic complaints, interpersonal problems, and positive affect. This four-factor structure has been extensively replicated, particularly among Whites [3,6], including Australians [7,8,9]. For example, the National Longitudinal Study of Adolescent Health in the U.S. showed that the original four-factor structure was a better fit compared to the one- and three-factor models [10]. Moreover, the original four-factor structure has been identified in other racial/ethnic groups [11,12], including Asians [13,14,15]. A study [13] using a sample of 1200 for each of five Asian countries—Indonesia, Korea, Myanmar, Sri Lanka, and Thailand—showed that the original four-factor structure was replicated for all countries.
However, many studies have revealed other factor structures for the CES-D in multiple cultural groups, specifically in Asian populations [16,17,18,19,20]. For example, a meta-analysis replicated [3] across African Americans, American Indians, Asians, Whites, and Hispanics, using confirmatory factor analysis (CFA), demonstrated that the original four-factor structure was acceptable across all ethnic groups except for the Asian group (N = 65,554, k = 16). Two- and three-factor structures have also been cited as other possible factor structures for the CES-D; the two-factor structure comprises negative affect (depressed affect, somatic complaints, and interpersonal problems) and positive affect, whereas the three-factor structure comprises depressed affect and somatic complaints, interpersonal problems, and positive affect.
In addition to measurement invariance, researchers must address complications regarding translation equivalence when examining cross-cultural differences [21]. Indeed, CES-D scores and factor structures were found to be strongly influenced by participants’ language [22]. Therefore, to facilitate accurate comparison, we selected India, the Philippines, and Singapore as English-speaking Asian countries.
People in Asian cultures reported higher scores on the CES-D than those in Western cultures [13,14], particularly for somatic complaints, positive affect, and interpersonal problems. Although somatic symptoms are a common feature of depression in many countries [23], non-Westerners, particularly Asians, tend to show stronger somatic symptoms than Westerners [24,25]. Several explanations for this tendency among Asians have been proposed, one of which concerns how cultural differences in symptom presentation are derived from variations in processing or expressing affect [25]. For example, although Asians tend to pay more attention to somatic symptoms than Westerners, their somatization tends to exhibit lower levels of interoceptive accuracy [25], which is one’s ability to accurately conjecture the magnitude of his or her bodily changes. Regarding positive affect, individuals in Asian cultures tend to avoid or inhibit expressing positive emotions because they are less likely to desire maximization of such emotions and minimization of negative emotions. Instead, they tend to promote a more balanced perspective on positive emotions, in contrast to Westerners, who tend to consider positive emotions to be functional and desirable [24]. Concerning interpersonal problems, research on cross-cultural differences in interpersonal relationships has shown that Asians tend to emphasize respecting and living in harmony with others (collectivism), compared to Westerners [26]. Shared emotions in collectivists, including Asians, involve ensuring that others share the concern and behave accordingly, whereas individualist cultures, including Americans and Australian, involve sharing of information. As such, Asians are more likely than Westerners to regard interpersonal problems as important and tend to report more interpersonal problems. Lastly, concerning depressed affect, some researchers [27] suggest that Asians tend to exhibit somatic symptoms rather than psychological symptoms, including depressed affect. However, the emphasis on somatic symptoms is not a minimization or denial of depressed affect, and that cultural differences in depressed affect between Westerners and non-Westerners are attributable to variations in constituent symptoms rather than the actual level of depressed affect [28]. Specifically, Chinese psychiatric outpatients reported less hopelessness among psychological symptoms according to a clinical interview than Euro-Canadian psychiatric outpatients but reported greater suppressed emotions and depressed mood [28]. Indeed, Asians report higher levels of depressed affect than do Westerners [13,14].
The present study compared the measurement invariances for one-, two-, three-, and four-factor models and scores of the CES-D between Asians and Westerns. Few studies have examined cross-cultural differences in CES-D scores between Whites and Indians, Filipinos, or Singaporeans, particularly using the same language. Nevertheless, given these previous theoretical studies on cross-cultural differences in self-reported depressive symptoms, we hypothesized that Whites would report lower CES-D scores than Asian groups.

2. Methods

2.1. Participants and Procedures

Two surveys, the 2013 and 2014 Coping and Health Survey [29,30,31] were conducted using web-based panels of the polling organization, Rakuten Research. They comprised more than 40.12, 8.26, 9.44, 1.60, and 3.92 hundred-thousand members in the U.S., Australia, India, the Philippines, and Singapore, respectively, who had registered and received one ID per person. Participants in the U.S. and Australia and those in India, Philippines, and Singaporean were selected from the data pools of the 2013 [29,30] and 2014 Coping and Health Survey [31], respectively. The data pools of the former and latter projects were 500 Americans Australians each, and 300 Indians, Filipinos, and Singaporeans each, respectively. The details of the survey were sent to potential participants, who were English speakers and ranged in age from 20 to 79 years, through an e-mail. The data in these surveys were collected so that the sample was almost evenly divided by gender and age in each country in each survey.
Participants (782 men and 824 women) in the present study included White Americans and Australians, Indians, Filipinos, and Singaporeans. The demographic characteristics of each sample are shown in Table 1. Although Singapore has three main ethnic groups―Chinese, Malay, and Indian―only Chinese and Malay were selected for this study to avoid overlap with the Indian sample. There were three Indiana participants.

2.2. Measures

In addition to the American population [2], the reliability and validity of CES-D scores have been established in Australian [7,8,9], Indian [17], Filipino [18,19,32], and Singaporean [33,34] populations. Additionally, the reliability and validity of CES-D scores obtained through Internet surveys have been supported [33,35,36]. Participants in this study rated each of the 20 CES-D items according to their experiences within the past week on a 4-point Likert scale ranging from 0 (rarely or none of the time, less than 1 day) to 3 (most or all the time, 5–7 days).

2.3. Data Analyses

First, we performed separate CFAs using the maximum likelihood method to test the fitness of the one-, two-, three-, and four-factor models. Second, the measurement invariances of the four models across the five samples were tested using CFA, which comprises the assessment of configural invariance—equivalence of factor structure across groups—metric invariance—equivalence of factor loadings across groups—and scalar invariance—equivalence of intercepts across groups. The configural invariance served as a baseline model. The standardized root-mean-square residual (SRMR; the most sensitive to mis-specified factor covariances), the comparative fit index (CFI; the most sensitive to mis-specified factor loadings), and the root-mean-square error of approximation (RMSEA; a measure of lack of fit per degree of freedom) were used as fit indices. According to the criterion proposed by Tanaka [37], CFI values of 0.95 or greater are considered good fits, whereas CFI values greater than 0.90 are acceptable. RMSEA values of 0.06 or lower are optimal while a SRMR value of 0.08 or lower is acceptable. The expected cross-validation index is used to compare the fit of different models; the model with the smallest positive values is preferred. As chi-square statistics are known to be sensitive to sample size, the ratio of changes in chi-square and degrees of freedom (Δχ2df) and changes in CFI (ΔCFI) and SRMR (ΔSRMR) were used to compare the models. Models with a ΔCFI of 0.01—supplemented by 0.030 or lower in ΔSRMR or 0.015 or lower in ΔRMSEA [38]—and a Δχ2df of less than or equal to five [39] would have a good fit to the data when CFA was conducted with a sample size of 1606. Additionally, cross-cultural differences in CES-D scores were compared using factor means between countries. Data were analyzed using SPSS version 22 (IBM, Armonk, NY, USA) and AMOS 22.0 (IBM, Armonk, NY, USA).

3. Results

The mean item and total scores of the CES-D by sample are shown in Table 2. Total CES-D scores were ranked in descending order as follows: Indians, Singaporeans, Filipinos, and White Americans and Australians. The fit indices in CFAs of all models by sample are shown in Table 3. In White American and Australian samples, all other models excluding the one-factor model satisfied the acceptable cutoff criteria (CFI ≥ 0.90 with SRMR ≤ 0.080 and RMSEA ≤ 0.080). Among Indians, Filipino, and Singaporeans, only the four-factor model met the acceptable cutoff criteria. The one-factor model showed a poor fit to the data for all samples. The results on the CFAs indicated that only the four-factor model was acceptable across all samples.
CFAs were used to test the measurement invariances of the four-factor model across all samples (Table 4). The results of all models excluding the four-factor model are shown in S1 and S2 (Supplementary materials). The respective fit values in metric invariance were acceptable in the four-factor model based on the cutoff criteria (Δχ2/Δdf ≤ 5.0 and ΔCFI ≤ 0.01 with ΔSRMR ≤ 0.030 or ΔRMSEA ≤ 0.015). However, ΔCFIs in scalar invariance were unsatisfied; although, the other fit values in scalar invariance were satisfied in the four-factor model. Therefore, to establish partial scalar invariance in the four-factor model, the constraints on loadings and intercepts of items 4, 7, 10, 11, 16, 17, 18, 19, and 20 were released based on Steenkamp and Baumgartner’s [40] recommendation—ideally, more than half items on a factor should be invariant. The results showed that fit indices for the partial scalar invariance in the four-factor model were adequate.
Finally, factor means, which were corrected for noninvariant items, in the four-factor model were compared between samples. Factor means for somatic complaints showed that White Australians (M = 0.35 and SE = 0.06, z = 5.53, p < 0.001) and Americans (M = 0.40 and SE = 0.06, z = 6.38, p < 0.001) reported lower scores compared to Indians. Regarding depressed affect, the factor mean among White Australians was lower as compared to that among Singaporeans (M = 0.16 and SE = 0.06, z = 2.97, p = 0.003), Filipinos (M = 0.22 and SE = 0.05, z = 4.10, p < 0.001), and Indians (M = 0.37 and SE = 0.06, z = 6.12, p < 0.001), and the factor mean among White Americans was lower than that for Indians (M = 0.24 and SE = 0.06, z = 3.65, p < 0.001). Factor means for (low) positive affect showed that White Australians (M = 0.21 and SE = 0.05, z = 4.12, p < 0.001) and Americans (M = 0.20 and SE = 0.05, z = 3.94, p < 0.001) reported lower scores than Singaporeans. Regarding interpersonal problems, the factor mean among White Australians was lower than that among Singaporeans (M = 0.20 and SE = 0.05, z = 4.06, p < 0.001), Filipinos (M = 0.20 and SE = 0.05, z = 3.96, p < 0.001), and Indians (M = 0.37 and SE = 0.06, z = 6.24, p < 0.001), and the factor mean of White Americans was lower than that of Indians (M = 0.25 and SE = 0.06, z = 4.06, p < 0.001).

4. Discussion

The four-factor CES-D has been well validated [5,6,11,12], which has also been replicated by our findings. Previous studies validating the four-factor structure of the CES-D in Asian countries largely used Chinese samples [14,15], with a non-English-language version of the CES-D. However, this study used Indian, Filipino, and Singaporean samples with an English-language version of the CES-D. Therefore, our findings that the four-factor structure of the CES-D was established in Asian populations may contribute to future research on the CES-D with Asians. However, our findings cannot exclude the possibility of other-factor structures of the CES-D, which have been proposed in Asian cultures [16,17,18,19,20].
Although our findings replicated the four-factor structure of the CES-D, we did not examine its clinical validity or usefulness. In Asian cultures, positive items in self-report questionnaires on depression may not be useful as markers of depression [24]. For example, European and Asian Americans born in the U.S. reported that the intensity of positive emotions was negatively associated with depressive symptoms; however, this was not the case with Asians who had immigrated into the U.S. [41]. Moreover, for Asians, some studies [15] about the CES-D have also questioned the clinical usefulness of the positive affect subscale. For example, in a study of Chinese patients [15], excluding the positive affect items provided a better screening tool for depression as compared to the original CES-D.
Before we compared CES-D scores among the samples, CFAs conducted to test the measurement invariance across the five samples, revealed that the goodness-of-fit statistics of the four-factor model were acceptable. This result indicated that the mean CES-D subscale scores of the four-factor model were comparable across the five samples. We hypothesized that CES-D scores among Whites would be higher than those among Asians. Total CES-D scores were ranked in descending order as follows: Indians, Singaporeans, Filipinos, White Americans and Australians. Factor means for somatic complaints were lower among White Americans and White Australians than those among Indians. Furthermore, factor means for depressed affect were lower among White Americans than those among Indians, whereas White Australians showed lower scores than all Asian samples. Factor means for low positive affect among White Americans and Australians were significantly lower than were those among Singaporeans. Factor means for interpersonal problems were lower among White Americans than among Indians, whereas White Australians showed lower scores than all the Asian samples. In sum, overall, the CES-D subscales scores among Whites were lower than those among Asians, with the gap being greater for Whites and Indians. Additionally, overall, factor means of all subscales among Indians were highest among all Asians; although, we did not hypothesize about differences in CES-D scores in this study. These findings are addressed in the following paragraphs.
First, this study showed that overall, Indians reported the highest CES-D scores when compared to other samples, particularly concerning somatic complaints. Somatic symptoms are core diagnostic symptoms of depression for Indians and are the presenting complaints for 97% of Indian primary care patients [42]. One possible reason for this is that yoga plays a central and definitive role in many Indians’ lives. Yoga is a spiritual and physical discipline in Hinduism, which is the main religion of India; although a more spiritual meditation than physical exercise, it helps Indians focus on bodily changes in the moment. Therefore, Indian people may have greater somatic awareness and show stronger somatic symptoms than people in other countries.
Second, although India, the Philippines, and Singapore had been colonized by countries in Europe and America, the colonial periods in the Philippines and Singapore were longer than India; thus, Filipino and Singaporean cultures have been more heavily influenced by Western culture than the Indian culture. Such cultural differences might influence the differences in CES-D scores in our findings. Some studies found no significant differences between Filipinos and Whites concerning CES-D scores; although, to our knowledge, no study had examined differences in CES-D scores between them. A previous study [32] conducted on college students in Hawaii showed no significant differences in CES-D total scores between European Americans and Filipinos; although, Filipinos’ scores (M = 16.51, SD = 10.96) were somewhat higher than were European Americans’ scores (M = 15.09, SD = 9.70). Additionally, a previous study [34] suggested that CES-D total score among Indians was higher than that among Singaporeans; although, to our knowledge, the current study was the first to examine differences in CES-D scores between Filipino, Singaporean, and Indian populations.

Limitations

Some limitations must be considered when interpreting our findings. First, the generalization or representativeness of the current findings to other samples may be low. Of many Asian countries, we selected only three to address the translation equivalence of the CES-D. Furthermore, we did not obtain data from White Europeans or Canadians. In other words, our samples are not entirely representative of Asian or White samples. Additionally, the Asian samples in this study may not have been representative of Indians, Filipinos, or Singaporeans, as we used only English-speaking participants. Moreover, the CES-D scores were obtained through a web-based survey; the data may differ if collected via other methods, such as by telephone, interviews, or paper-based self-report. A previous study [35] conducted in the Netherlands found that the mean CES-D total score among adolescents recruited through the Internet (M = 15.4, SD = 11.8) was significantly higher than that of adolescents recruited through schools (M = 9.7, SD = 8.4). Further, scores of depressive symptoms obtained through the Internet were greater than those obtained by paper-based self-report [43].
Second, although the results in this study suggested that the four-factor was an acceptable structure for the CES-D, this does not suggest that the four-factor structure is more useful for clinical or diagnostic research on depression than are the other-factor structures. Additionally, in other ethnic groups, the one-, two-, three-, or other-factor models may be a better structure for the CES-D.
Third, the findings on the differences in CES-D scores need to be interpreted with caution. Partial scalar invariance in the four-factor model was acceptable in our samples, but not scalar invariance. Standards for partial invariance are inconsistent [44]; however, partial invariance has been reported for approximately one-third of tests [44]. The findings on the differences in CES-D scores contribute to research on the CES-D.
Finally, although our results showed that Asians reported higher CES-D scores than Whites, the prevalence of depression in Asians is not necessarily higher than that among Westerners when diagnosed via an interview with a psychiatrist. The World Health Organization [45] reported the prevalence of current depression, according to Composite International Diagnostic Interviews, was 9.1% in India, 4.0% in China, 6.3% in the U.S., and 4.7–16.9% among Western Europeans. This contradiction may suggest that cross-cultural differences in CES-D scores do not necessarily correspond to those in the prevalence of depression as diagnosed by a psychiatrist.

5. Conclusions

The CES-D has been widely and frequently used to measure depressive symptoms in the general population. Although an appropriate structure of the CES-D was different in different cultures, the four-factor model was most adequate across all cultures. Despite some limitations, our findings among English-speaking Whites and Asians indicate that the mean CES-D scores in Whites were lower than those in Asians; the gap was particularly high among Indians.

Declarations

All participants were selected from the data pools of the 2013 [29,30] and 2014 Coping and Health Survey [31], as described in the Methods section. The Coping and Health Survey was administered for several purposes. The present study used the CES-D, which was a part of the data obtained by the 2013 and 2014 Coping and Health Surveys. The mean CES-D scores in the U.S., Australian, and Chinese samples were reported by Kato [29] using the data from the 2013 Coping and Health Surveys. The mean CES-D scores in the Indian, Filipino, and Singaporean samples were reported by Kato [31] using the data from the 2014 Coping and Health Survey. Based on PLoS ONE editorial policies regarding the sharing of materials and data, the raw data obtained from the 2013 Coping and Health Survey were made freely available (Supporting Information: Dataset S1).

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/article/10.3390/ijerph18105298/s1, Table S1: Mean and covariance structure analysis for other models excluding four-factor model of the CES-D, Table S2: Differences in factor means between samples for the four-factor model.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. WHO World Mental Health Survey Consortium. Prevalence, severity, and unmet need for treatment of mental disorders in the World Health Organization World Mental Health Surveys. JAMA 2004, 291, 2581–2590. [Google Scholar] [CrossRef] [PubMed]
  2. Radloff, L.S. The CES-D Scale: A self-report depression scale for research in the general population. Appl. Psychol. Meas. 1977, 1, 385–401. [Google Scholar] [CrossRef]
  3. Kim, G.; DeCoster, J.; Huang, C.; Chiriboga, D.A. Race/ethnicity and the factor structure of the Center for Epidemiologic Studies Depression Scale: A meta-analysis. Cult. Divers. Ethnic Minor. Psychol. 2011, 17, 381–396. [Google Scholar] [CrossRef] [PubMed]
  4. van Noorden, R.; Maher, B.; Nuzzo, R. The top 100 papers: Nature explores the most-cited research of all time. Nature 2014, 514, 550–553. [Google Scholar] [CrossRef] [Green Version]
  5. Little, T.D. Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivar. Behav. Res. 1997, 32, 53–76. [Google Scholar] [CrossRef]
  6. Edwards, M.C.; Cheavens, J.S.; Heiy, J.E.; Cukrowicz, K.C. A reexamination of the factor structure of the Center for Epidemiologic Studies Depression Scale: Is a one-factor model plausible? Psychol. Assess. 2010, 22, 711–715. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Alexandrowicz, R.W.; Jahn, R.; Wancata, J. Assessing the dimensionality of the CES-D using multi-dimensional multi-level Rasch models. PLoS ONE 2018, 13, e0197908. [Google Scholar] [CrossRef]
  8. Gomez, R.; McLaren, S. The Center for Epidemiological Studies Depression Scale: Measurement and structural invariance across ratings of older adult men and women. Pers. Individ. Dif. 2015, 75, 130–134. [Google Scholar] [CrossRef]
  9. Gomez, R.; McLaren, S. The Center for Epidemiologic Studies Depression Scale: Invariance across heterosexual men, heterosexual women, gay men, and lesbians. Psychol. Assess. 2017, 29, 361–371. [Google Scholar] [CrossRef]
  10. Perreira, K.M.; Deeeb-Sossa, N.; Harris, K.M.; Bokeen, K. What are we measuring? An evaluation of the CES-D across race/ethnicity and immigrant generation. Soc. Forces 2005, 83, 1567–1602. [Google Scholar] [CrossRef]
  11. Armenta, B.E.; Hartshorn, K.J.S.; Whitbeck, L.B.; Crawford, D.M.; Hoyt, D.R. A longitudinal examination of the measurement properties and predictive utility of the Center for Epidemiologic Studies Depression Scale among North American Indigenous adolescents. Psychol. Assess. 2014, 26, 1347–1355. [Google Scholar] [CrossRef] [Green Version]
  12. Nguyen, H.T.; Kitner-Triolo, M.; Evans, M.K.; Zonderman, A.B. Factorial invariance of the CES-D in low socioeconomic status African Americans compared with a nationally representative sample. Psychiatry Res. 2004, 126, 177–187. [Google Scholar] [CrossRef]
  13. Mackinnon, A.; McCallum, J.; Andrews, G.; Anderson, I. The Center for Epidemiological Studies Depression Scale in older community samples in Indonesia, North Korea, Myanmar, Sri Lanka, and Thailand. J. Gerontol. Psychol. Sci. 1998, 53, 343–352. [Google Scholar] [CrossRef] [Green Version]
  14. Zhang, B.; Fokkema, M.; Cuijpers, P.; Juan, L.; Smits, N.; Beekman, A. Measurement invariance of the Center for Epidemiological Studies Depression scale (CES-D) among Chinese and Dutch elderly. BMC Med. Res. Methodol. 2011, 11, 74–83. [Google Scholar] [CrossRef] [Green Version]
  15. Zhang, Y.Y.; Ting, R.Z.W.; Lam, M.H.B.; Lam, S.; Yeung, R.; Nan, H.; Ozaki, R.; Luk, A.O.Y.; Kong, A.P.S.; Wing, Y.; et al. Measuring depression with CES-D in Chinese patients with type 2 diabetes: The validity and its comparison to PHQ-9. BMC Psychiatry 2015, 15, 198. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Chin, W.Y.; Choi, E.P.H.; Chan, K.T.Y.; Wong, C.K.H. The psychometric properties of the Center for Epidemiologic Studies Depression Scale in Chinese primary care patients: Factor structure, construct validity, reliability, sensitivity and responsiveness. PLoS ONE 2015, 10, e0135131. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Chokkanathan, S.; Mohanty, J. Factor structure of the CES-D scale among older adults in Chennai, India. Aging Ment. Health 2013, 17, 517–525. [Google Scholar] [CrossRef]
  18. Edman, J.L.; Danko, G.P.; Andrade, N.; McArdle, J.J.; Foster, J.; Glipa, J. Factor structure of the CES-D (Center for Epidemiologic Studies Depression Scale) among Filipino-American adolescents. Soc. Psychiatry Psychiatr. Epidemiol. 1999, 34, 211–215. [Google Scholar] [CrossRef]
  19. Russell, S.T.; Crockett, L.J.; Shen, Y.; Lee, S. Cross-ethnic invariance of self-esteem and depression measures for Chinese, Filipino, and European American adolescents. J. Youth Adolesc. 2008, 37, 50–61. [Google Scholar] [CrossRef]
  20. Yang, W.; Garrido, L.E.; Meng-Cheng, W.; Xiong, G.; Zhang, J.X.; Wang, C. Factor structure and criterion validity across the full scale and ten short forms of the CES-D among Chinese adolescents. Psychol. Assess. 2018, 30, 1186–1198. [Google Scholar] [CrossRef] [PubMed]
  21. Ji, L.; Nisbett, R.E.; Zhang, Z. Is it culture or is it language? Examination of language effects in cross-cultural research on categorization. J. Pers. Soc. Psychol. 2004, 87, 57–65. [Google Scholar] [CrossRef] [Green Version]
  22. Guarnaccia, P.J.; Angel, R.; Worobey, J.L. The factor structure of the CES-D in the Hispanic health and nutrition examination survey: The influences of ethnicity, gender and language. Soc. Sci. Med. 1989, 29, 85–94. [Google Scholar] [CrossRef]
  23. Simon, G.E.; VonKorff, M.; Piccinelli, M.; Fullerton, C.; Ormel, J. An international study of the relation between somatic symptoms and depression. N. Engl. J. Med. 1999, 341, 1329–1335. [Google Scholar] [CrossRef] [PubMed]
  24. Chentsova-Dutton, Y.E.; Ryder, A.G.; Tsai, J. Understanding depression across cultural contexts. In Handbook of Depression, 3rd ed.; Gotlib, H., Hammen, C., Eds.; Guilford Press: New York, NY, USA, 2014; pp. 337–354. [Google Scholar]
  25. Ma-Kellams, C. Cross-cultural differences in somatic awareness and interoceptive accuracy: A review of the literature and directions for future research. Front. Psychol. 2014, 5, 1379. [Google Scholar] [CrossRef] [Green Version]
  26. Triandis, H.C. Individualism and Collectivism; Westview Press: Boulder, CO, USA, 1995. [Google Scholar]
  27. Ryder, A.G.; Yang, J.; Zhu, X.; Yao, S.; Yi, J.; Heine, S.J.; Bagby, R.M. The cultural shaping of depression: Somatic symptoms in China, psychological symptoms in North America? J. Abnorm. Psychol. 2008, 117, 300–313. [Google Scholar] [CrossRef] [PubMed]
  28. Dere, J.; Sun, S.; Zhao, Y.; Persson, T.J.; Zhu, X.; Yao, S.; Bagby, M.R.; Ryder, A.G. Beyond “somatization” and “psychologization”: Symptom-level variation in depressed Han Chinese and Euro-Canadian outpatients. Front. Psychol. 2013, 4, 377. [Google Scholar] [CrossRef] [Green Version]
  29. Kato, T. Relationship between coping with interpersonal stressors and depressive symptoms in the United States, Australia, and China: A focus on reassessing coping. PLoS ONE 2014, 9, e109644. [Google Scholar] [CrossRef] [Green Version]
  30. Kato, T. Testing of the coping flexibility hypothesis based on the dual-process theory: Relationships between coping flexibility and depressive symptoms. Psychiatry Res. 2015, 230, 137–142. [Google Scholar] [CrossRef]
  31. Kato, T. Psychological inflexibility and depressive symptoms among Asian English speakers: A study on Indian, Philippine, and Singaporean samples. Psychiatry Res. 2016, 238, 1–7. [Google Scholar] [CrossRef]
  32. Herman, S.; Archambeau, O.G.; Deliramich, A.N.; Kim, B.S.K.; Chiu, P.H.; Frueh, B.C. Depressive symptoms and mental health treatment in an ethnoracially diverse college student sample. J. Am. Coll. Health 2011, 59, 715–720. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Chong, S.A.; Subramaniam, M.; Chan, Y.H.; Chua, H.C.; Liow, P.H.; Pek, E.; Stahl, D.; Verma, S.; Sum, C.F. Depressive symptoms and diabetes mellitus in an Asian multiracial population. Asian J. Psychiatr. 2009, 2, 66–70. [Google Scholar] [CrossRef] [PubMed]
  34. Stahl, D.; Sum, C.F.; Lum, S.S.; Liow, P.H.; Chan, Y.H.; Verma, S.; Chua, H.C.; Chong, S.A. Screening for depressive symptoms: Validation of the center for epidemiologic studies depression scale (CES-D) in a multiethnic group of patients with diabetes in Singapore. Diabetes Care 2008, 31, 1118–1119. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Cuijpers, P.; Bolujit, P.; van Straten, A. Screening of depression in adolescents through the Internet: Sensitivity and specificity of two screening questionnaires. Eur. Child Adolesc. Psychiatry 2008, 17, 32–38. [Google Scholar] [CrossRef] [PubMed]
  36. Leykin, Y.; Torres, L.D.; Aguilera, A.; Muñoz, R.F. Factor structure of the CES-D in a sample of Spanish- and English-speaking smokers on the internet. Psychiatry Res. 2011, 185, 269–274. [Google Scholar] [CrossRef] [Green Version]
  37. Tanaka, J.S. Multifaceted conceptions of fit in structural equation models. In Testing Structural Equation Models; Bollen, K.A., Long, J.S., Eds.; Sage: Newbury Park, CA, USA, 1993; pp. 10–39. [Google Scholar]
  38. Chen, F.F. Sensitivity of goodness of fit indices to lack of measurement invariance. Struct. Equ. Model. 2007, 14, 464–504. [Google Scholar] [CrossRef]
  39. Rosay, A.B.; Gottfredson, D.C.; Armstrong, T.A.; Harmon, M.A. Invariance of measures of prevention program effectiveness: A replication. J. Quant. Criminol. 2000, 16, 341–367. [Google Scholar] [CrossRef]
  40. Steenkamp, J.E.M.; Baumgartner, H. Assessing measurement invariance in cross-national consumer research. J. Consum. Res. 1998, 25, 78–90. [Google Scholar] [CrossRef] [Green Version]
  41. Leu, J.; Wang, J.; Koo, K. Are positive emotions just as “positive” across cultures? Emotion 2011, 11, 994–999. [Google Scholar] [CrossRef]
  42. Patel, V.; Pereira, J.; Mann, A.H. Somatic and psychological models of common mental disorder in primary care in India. Psychol. Med. 1998, 28, 135–143. [Google Scholar] [CrossRef]
  43. Kongsved, S.M.; Basnov, M.; Holm-Christensen, K.; Hjollund, N.H. Response rate and completeness of questionnaires: A randomized study of Internet versus paper- and-pencil versions. J. Med. Internet Res. 2007, 9, e25. [Google Scholar] [CrossRef]
  44. Putnick, D.L.; Bornstein, M.H. Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Dev. Rev. 2016, 41, 71–90. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. World Health Organization. The World Health Report 2001: Mental Health: New Understanding, New Hope; World Health Organization: Geneva, Switzerland, 2001. [Google Scholar]
Table 1. Demographic characteristics of each sample.
Table 1. Demographic characteristics of each sample.
CharacteristicAmericanAustralianIndianFilipinoSingaporean
N393425223286279
Mean age47.247.439.436.036.1
SD15.314.411.111.510.5
Women (%)51.153.950.250.349.5
Married (%)54.553.970.446.245.5
Never married (%)26.530.628.450.752.3
Divorced/separated/widowed (%)19.115.51.33.12.2
Ethnic group (%)White (100)White (100)Punjabi (17.0)
Tamil (14.8)
Gujarati (14.3)
Bengali (13.5)
Marathi (13.5)
Telugu (12.6)
Kannada (8.5)
Malayali (5.8)
Filipino (98.3)
Half Filipino (1.7)
Chinese (95.0)
Malay (5.0)
Table 2. Item scores and alphas of the CES-D and the mean CES-D total scores by sample.
Table 2. Item scores and alphas of the CES-D and the mean CES-D total scores by sample.
ItemAmericanAustralianIndianFilipinoSingaporean
n393425223286279
Somatic Complaints
1Bothered0.640.630.980.75 0.71
2Appetite0.580.500.910.51 0.57
5Mind0.810.741.080.94 0.79
7Effort0.910.841.321.34 1.20
11Sleep1.021.101.010.82 0.86
13Talk0.760.751.230.98 0.89
20Get going0.750.790.910.64 0.76
Total5.475.347.445.985.79
SD4.524.504.694.324.58
α0.830.840.810.810.85
Depressed Affect
3Blues0.780.661.020.76 0.73
6Depressed0.830.681.030.85 0.80
9Failure0.660.480.930.70 0.78
10Fearful0.650.431.000.80 0.75
14Lonely0.790.641.030.88 0.87
17Cry0.470.350.840.63 0.53
18Sad0.780.610.960.92 0.77
Total4.973.866.805.535.25
SD5.284.705.245.025.17
α0.910.900.880.920.91
(Low) Positive Affect
4Good1.281.301.501.65 1.68
8Hopeful1.411.481.261.12 1.65
12Happy1.221.181.161.09 1.47
16Enjoy1.221.181.160.95 1.56
Total5.135.155.084.826.37
SD3.603.633.052.863.21
α0.830.850.700.680.80
Interpersonal Problems
15Unfriendly0.570.370.890.590.66
19Dislike0.580.490.830.720.67
Total1.150.861.721.311.33
SD1.521.291.731.591.53
α0.710.630.720.760.77
CES-D Total Score
Mean16.7215.2021.0417.6518.73
SD12.5511.7211.0810.7811.40
α0.930.920.880.900.91
Table 3. Confirmatory factor analysis for the five models of the CES-D by sample.
Table 3. Confirmatory factor analysis for the five models of the CES-D by sample.
Modelχ2dfECVI90% CICFISRMRRMSEA
White American (n = 394)
One-factor894.041702.592.36–2.840.830.0790.104
Two-factor497.761691.481.32–1.660.920.0510.070
Three-factor474.021671.431.27–1.600.930.0490.068
Four-factor414.151641.391.25–1.560.940.0430.062
White Australian (n = 425)
One-factor1031.891702.722.49–2.960.810.0820.109
Two-factor485.441691.341.19–1.500.930.0450.066
Three-factor470.881671.311.17–1.480.930.0440.066
Four-factor416.791641.291.16–1.450.940.0420.060
Indian (n = 223)
One-factor571.291703.112.80–3.460.800.0920.103
Two-factor394.811692.151.90–2.430.890.0790.078
Three-factor393.341672.161.92–2.440.890.0790.078
Four-factor379.631642.312.07–2.580.900.0770.077
Filipino (n = 286)
One-factor701.001702.882.61–3.180.810.0830.105
Two-factor505.691692.201.98–2.450.880.0800.084
Three-factor483.591672.141.92–2.380.890.0800.082
Four-factor456.621642.071.86–2.300.900.0780.079
Singaporean (n = 279)
One-factor833.551703.433.12–3.770.790.1020.118
Two-factor498.011692.232.00–2.490.900.0710.084
Three-factor475.271672.161.94–2.410.900.0690.080
Four-factor465.901642.151.93–2.400.910.0680.080
Note. ECVI, CFI, SRMR, and RMSEA are expected cross-validation index, comparative fit index standardized root-mean-square residual, and root-mean-square error of approximation, respectively.
Table 4. Mean and covariance structure analysis for the four-factor model.
Table 4. Mean and covariance structure analysis for the four-factor model.
Modelχ2dfCFISRMRRMSEAΔχ2ΔdfΔχ2dfΔCFIΔSRMRΔRMSEA
Configural invariance2133.458200.9200.0390.032
Metric invariance2350.568840.9110.0460.032217.10643.390.0090.0070.001
Scalar invariance2851.049640.8850.0460.035717.591444.980.0350.0070.003
Partial scalar invariance2405.998960.9100.0480.032272.54763.590.0100.0090.001
Note. CFI, SRMR, and RMSEA are comparative fit index, standardized root-mean-square residual, and root-mean-square error of approximation, respectively.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Kato, T. Measurement Invariance in the Center for Epidemiologic Studies-Depression (CES-D) Scale among English-Speaking Whites and Asians. Int. J. Environ. Res. Public Health 2021, 18, 5298. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18105298

AMA Style

Kato T. Measurement Invariance in the Center for Epidemiologic Studies-Depression (CES-D) Scale among English-Speaking Whites and Asians. International Journal of Environmental Research and Public Health. 2021; 18(10):5298. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18105298

Chicago/Turabian Style

Kato, Tsukasa. 2021. "Measurement Invariance in the Center for Epidemiologic Studies-Depression (CES-D) Scale among English-Speaking Whites and Asians" International Journal of Environmental Research and Public Health 18, no. 10: 5298. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18105298

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop