Next Article in Journal
Knowledge, Behaviour and Attitudes Related to Sun Exposure in Sportspeople: A Systematic Review
Next Article in Special Issue
Stress, Burnout, Anxiety and Depression among Teachers: A Scoping Review
Previous Article in Journal
Changes in Canadian Adolescent Well-Being since the COVID-19 Pandemic: The Role of Prior Child Maltreatment
Previous Article in Special Issue
Determinants Affecting the Rationing of Nursing Care and Professional Burnout among Oncology Nurses
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Spanish Version of the State Self-Compassion Scale–Long Form (SSCS–L): A Study of Its Validity and Reliability in a Sample of Nursing Students

1
Department of Methodology for the Behavioral Sciences, University of Valencia, 46010 Valencia, Spain
2
Department of Nursing and Physiotherapy, University of the Balearic Islands, 07122 Palma, Spain
3
Department of Nursing, University of Valencia, 46010 Valencia, Spain
4
Balearic Islands Health Research Institute (IDISBA), 07004 Palma, Spain
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2022, 19(16), 10174; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph191610174
Submission received: 29 July 2022 / Revised: 13 August 2022 / Accepted: 14 August 2022 / Published: 17 August 2022
(This article belongs to the Special Issue Development of Stress, Burnout and Occupational Hygiene)

Abstract

:
Background: In nurses, self-compassion mitigates the effects of stress, burnout and compassion fatigue, and enhances empathy, compassion and well-being and quality of life. The Self-Compassion Scale is the most-used instrument. The aim of this study is to validate the Spanish version of the new developed State Self-Compassion Scale–Long (SSCS–L). Methods: Students of the first year of the Nursing Degree were surveyed online. Together with the SSCS–L, their levels of positive and negative affect was reported. Analyses included descriptive statistics, competitive confirmatory factor analysis, evidence on criterion-related validity and estimates of reliability. Results: The best fitting model for the SSCS–L was the one hypothesizing six-correlated factors of self-compassion: self-kindness, common humanity, mindfulness, self-judgement, isolation, and over-identification. Positive relations between the positive dimensions of self-compassion and positive affect were found, whereas there were negative relations between the positive poles of self-compassion and negative affect. Estimates of reliability were adequate, except for the dimension of over-identification. Conclusions: Self-compassion has become a key competency for nurses. The SSCS–L is an appropriate tool to allow an adequate assessment of self-compassion in experimental contexts.

1. Introduction

Compassion is a multi-faceted construct that can be used to define behavior towards oneself or others. Self-compassion is when compassion is turned inward, approaching one’s inadequacies and failures with kindness [1,2,3], instead of with criticism or self-judgment. It has been defined as an ability to hold one’s feelings with warmth [1,2]. Neff [1,2] further expands on this concept identifying both positive and negative aspects of self-compassion, with self-kindness, common humanity and mindfulness as examples of compassionate behavior, in contrast to self-judgement, isolation and over-identification [4]. It is therefore “a healthy way of relating to oneself in times of suffering, and applies to situations of failure, perceived inadequacy, or general life difficulties” [5] (p.121).
Defined as such, self-compassion has been consistently related to several positive psychological outcomes. For example, literature points its potential to increase life satisfaction [6,7], harmony [6], and subjective well-being [8,9,10]. Indeed, interventions that focus on cultivating self-compassion and its components have been found to reduce shame and depression [11,12,13,14,15]. In line with this research, self-compassion has been also considered a protector against of suicidal thoughts and self-harm [16]. It also benefits interpersonal relationships [17], by improving mindful parenting [18,19,20], decreasing attachment anxiety and avoidance [21,22,23], and improving romantic relationship satisfaction and dyadic adjustment, as well as being better accepting of both our own and our romantic partner’s personal flaws [24,25]. It has also been linked to several improvements in the working environment, increasing levels of job satisfaction and job performance [26,27,28] and improving professional quality of life [29].
This is especially true for nursing professionals and students where self-compassion can be seen as a useful tool to face excessive workloads. Both in qualitative and quantitative terms, nurses are exposed to very high levels of stress caused by the work environment [30,31]. Considering this, self-compassion could be useful in order to face such stress, as it seems to act as a buffer against the effects of stress [32,33,34,35], burnout [32,33,35,36,37,38,39,40,41,42], and compassion fatigue [35,40,41,42]. It has also been linked to higher levels of empathy [35,43], compassion for others [44], compassion satisfaction [35,37,38,41,42,45], increased compassionate care [36,46], and higher caring efficacy [47]. Additionally, adequate levels of self-compassion have been related to well-being [36,40,46] and quality of life [32,40].
The most common tool to measure self-compassionate behaviors is the Self-Compassionate Scale (SCS) [29]. This consists of a 26-part self-reporting questionnaire that measures individual differences with regard to trait and self-compassion. A shortened version of this form has also been developed: the Self-Compassion Scale–Short Form (SCS–SF) [48]. This version consists of only 12 items instead of the original 26. Both the SCS and the SCS–SF have been adapted and translated to several languages, including Brazilian Portuguese [49], Chinese [50], French [51], German [52], Greek [53], Italian [54], Japanese [55], Korean [56], Norwegian [57], Persian [58], Portuguese [59], or Spanish [60]. A recent review shows that the SCS is by far the most used instrument with regards to the study of self-compassion for nurses and midwifes [61], with the Spanish version of the SCS–SF being recently validated [42].
Based on this conceptualization and measurement of self-compassion, Neff et al. [62] have recently developed the State Self-Compassion State (SSCS). As stated by Neff et al. [62], there is a growing tendency to study self-compassion in experimental contexts. Literature on self-compassion shows that it is common to induce a self-compassionate mindset, either with writing exercises or guided meditations [63,64,65,66,67]. In such studies, the assessment of state self-compassion is key, and the SSCS is a good tool for this end. This new scale is based on the original SCS, and uses 18 of its items that have been rewritten in the present moment language. Additionally, participants are also instructed to think about current painful or difficult situations. The SSCS has demonstrated evidence of validity and reliability, with state self-compassion being related to positive and negative affect, and adequately assessing experimental manipulations of self-compassion [62].
The purpose of this study is to test the psychometric properties of the Spanish version of the State Self-Compassion State–Long.

2. Materials and Methods

2.1. Design

The study has a longitudinal design. Four surveys of nursing students will be conducted during the years 2022–2025. Cross-sectional data of the first wave was used. This first assessment (time 1 or pre–internship assessment) took place during May 2022. The study has been reported using the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement [68].
For the translation of the scale, we used the backward and forward translation process. First, the scale was translated into Spanish by two professional natives. Then, it was translated back into English by two native professionals. In the final version, no differences were found. The resulting Spanish version of the scale can be consulted in Table 1.

2.2. Participants

Students in the first year of the Nursing Degree from the University of Valencia and the University of the Balearic Islands (Spain) were encouraged to participate. In order to be included, the participants had to be nursing students, with no previous experience of internships. The students fulfilled the online questionnaire in approximately 20 min.
For the determination of sample size, the total population of nursing students of both universities was considered. For a population of students that was calculated to be N = 1880, with a confidence interval of 95% and an error limit of 5%, the number of elements of the sample to obtain was n = 320.

2.3. Instruments

The Spanish version of the State Self-Compassion State (SSCS–L) [62] includes 18 items, assessing six dimensions of self-compassion; self-kindness, common humanity and mindfulness would represent compassionate behaviors, whereas their opposite poles, self-judgement, isolation and over-identification, would represent the uncompassionate ones [4]. Each dimension is assessed with three items, which refer to a painful or difficult situation that the respondent is experiencing in that time. Items score in a five-point Likert-type scale, from 1 (not at all true for me) to 5 (very true for me).
Additionally, the Positive and Negative Affect Scale (PANAS) [69] was used to gather evidence of criterion-related validity. This is a 20-item self-reported measure of positive and negative mood, in which participants rate how they are feeling at the time using a series of adjectives (e.g., disgusted, irritable). Items score in a 5-point Likert-type scale, ranging from 1 (very slightly or not at all) to 5 (extremely). For the positive affect score, the mean of the 10 items representing positive adjectives is calculated, while for the negative one, the mean of the 10 items representing negative adjectives is calculated. This version of the PANAS has previously demonstrated adequate reliability, and was used in the original study of development and validation of the State Self-Compassion Scale–Long form (SSCS–L) [62]. In the original study [69], reliability estimates ranged from 0.860 to 0.900 for positive affect, and from 0.840 to 0.870 for negative affect; in this sample, estimates of reliability were 0.901 and 0.782, respectively.

2.4. Data Analysis

Firstly, descriptive statistics for the items of the scale, including means, standard deviations, and minimum and maximum scores, were calculated.
Secondly, construct validity was studied. For the study of the internal structure, competitive confirmatory factor analysis (CFA) was used. Three CFAs were specified and tested, following Lluch-Sanz et al.’s [42] work. Specifically, the tested models included:
  • One-factor model. This model tested a general factor of self-compassion that explained the 18 items of the SSCS–L—that is, it tested a unidimensional structure.
  • Two-correlated-factor model. This model hypothesized a two-correlated factor solution, a positive self-compassionate factor and a negative one.
  • Six-correlated-factor model. This model hypothesized six correlated factors, including self-kindness, common humanity and mindfulness, which would represent compassionate behaviors, together with self-judgement, isolation and over-identification representing their opposite poles.
Details can be consulted in Figure 1.
To assess the model fit, several criteria were used: the chi-square statistic, the Comparative Fit Index (CFI), the Tucker-Lewis Index (TLI), the Standardized Root Mean Square Residual (SRMR), and the Root Mean Square Error of Approximation (RMSEA). Cut-off criteria to determine good fit were: CFI and TLI above 0.90 (better over 0.95) and SRMR or RMSEA below 0.08 (better under 0.06) [70]. For model comparison, as the competitive CFA were not nested, subjective criteria were used. That is, if a parsimonious model evidences adequate levels of practical fit, it is preferred over the more complex model. CFI differences (ΔCFI) lower than 0.010 [71] or 0.050 [72] were used as cut-off criteria. The model were estimated using the weighted least squares mean and variance adjusted (WLSMV) estimation method, according to the ordinal nature of the data and its non-normality [73,74,75].
Then, we gathered evidence of criterion-related validity. The SSCS–L was related to positive and negative affect. For this purpose, Pearson correlations were calculated. Additionally, sex differences in self-compassion were studied using F tests.
Finally, and in order to study the reliability of the scale, Cronbach’s alpha and the Composite Reliability (CR) Index were used. Values of Cronbach’s alpha and CR greater than 0.70 are considered adequate.
For the statistical analyses, SPSS version 26 (IBM, New York, NY, USA) [76] and Mplus version 8.4 (Muthén and Muthén, Los Angeles, CA, USA) [75] were used.

3. Results

3.1. Sociodemographic Characteristics of the Sample

The final sample was composed by 324 nursing students, of whom 84.0% were women. Their mean age was 22.61 (SD = 7.22) years old. 51.9% were University of Valencia students, and 48.1% were University of the Balearic Islands students. Most lived with their parents (43.2%) or with other students (30.2%). The majority of the students were not working at the time of the survey (70.7%). 14.5% were working as healthcare professionals. For more details, see Table 2.

3.2. Items’ Descriptive Statistics

Descriptive statistics were calculated for the items of the scale. Means ranged from 2.51 (item 18) to 3.85 (item 9). These can be consulted in Table 1.

3.3. Construct Validity

To study the internal structure of the scale, three were specified and tested. The one-factor and the two-correlated-factor model showed inadequate fit, whereas the six-correlated-factor model showed an excellent fit (see Table 3). Therefore, this latest model was retained as the best fitting model.
As displayed in Figure 2, the highest factor loading for the self-kindness dimension was item 13 (“I’m being supportive toward myself”), while for the self-judgement dimension it was item 10 (“I’m being a bit cold-hearted towards myself”), for common humanity it was item 9 (“I’m remembering that there are lots of others in the world feeling like I am”), for isolation it was item 18 (“I’m feeling all alone right now”), for mindfulness it was item 17 (“I’m keeping things in perspective”), and for over-identification it was item 2 (“I’m obsessing and fixating on everything that’s wrong”). Although all factor loadings resulted in statistical significance, a very small value was found for item 8 (“I’m getting carried away with my feelings”) in the dimension of over-identification.

3.4. Criterion-Related Validity

In the third place, we gathered evidence of criterion-related validity by relating the SSCS–L scores with levels of positive and negative affect. The Pearson correlations, displayed in Table 4, showed positive relations between the positive dimensions of self-compassion and positive affect, and negative relations between the positive poles of self-compassion and negative affect. That is, higher levels of self-kindness, common humanity and mindfulness were positively related to positive affect and negatively related to negative affect. On the contrary, higher levels on the negative dimensions of self-compassion, which included self-judgement, isolation and over-identification, were related to higher levels of negative affect and lower levels of positive affect.
Regarding sex differences in self-compassion, statistically significant differences were found in the dimensions of self-kindness and mindfulness, with lower levels for women. In self-judgment, common humanity, isolation and over-identification differences between women and men were not statistically significant (see Table 4).

3.5. Reliability

To study the reliability of the SSCS–L scale, Cronbach’s alpha and the Composite Reliability Index were used. Reliability estimates of all the dimensions resulted as adequate, except for over-identification. This dimension showed poor reliability, both when estimated using Cronbach’s alpha and CR (see Table 5).

4. Discussion

The current research analyzed the psychometric properties of the Spanish version of the SSCS–L scale [62]. Evidence of construct, convergent and discriminant, and criterion-related validity was gathered, as well as reliability estimates. A forward–backward translation was conducted to ensure that the Spanish version measured the same features as the English version.
Our results pointed that the Spanish version of the SSCS–L scale exhibited excellent evidence of construct validity. Indeed, the competitive CFA models pointed the six-correlated-factor structure as the best representation of the data. This is in line with previous studies carried out with both the long and short forms of the Self-Compassion Scale (SCS). This is demonstrated in a variety of studies that reveal that a six-factor structure best reflects health service worker outcomes, such as Raes et al. [48], who found evidence of a six-factor structure, with a single higher-order factor of self-compassion, or García-Campayo et al. [60], who found this six-factor structure to be the solution for both SCS and SCS/SF in Spanish Health Service workers. The six-factor structure of self-compassion has also been identified amongst the Saudi nursing students Alabdulaziz et al. [77]. We know from the scientific literature that all six self-compassion dimensions can be improved by programed interventions. Some of the successful interventions tested, for example, are those used by Rao and Kemper [46], in which online training in Gratitude, Positive Word and Love-Kindness/Compassion Meditation showed a significant improvement in all the dimensions of self-compassion. Similarly, the study by Sansó et al. [78] evidenced significant improvements in all the dimensions of self-compassion after a mindfulness training program in palliative care professionals, except for the Common Humanity dimension.
Regarding criterion-related validity evidence, the results obtained in the current study were in line with self-compassion previous literature: higher positive affect is related to higher levels of self-compassion (in its positive meaning), and higher negative affect is related to lower levels (lower scores in self-kindness, common humanity and mindfulness, and higher ones in self-judgement, isolation and over-identification) [2,62,79,80]. It is worth noting the positive effect that self-compassion has emotions, since self-compassion not only replaces negative emotions, but also generates positive emotions through the acceptance of negative states [81]. On other hand, self-compassion attenuates the negative affective responses [82]. Indeed, some authors have pointed to the role of affect in self-regulation as an alternative explanation for the beneficial effect of self-compassion on health behaviors [66,82].
Regarding sex differences in self-compassion, lower levels of self-kindness and mindfulness were found for women. This is in line with previous research, which has pointed out that males had slightly higher levels of self-compassion than females [83,84]. However, it is noteworthy to mention that the sample of this study was mostly made up of women, and therefore men’s presence in the study was very small in size. Therefore, generalization of these results should be made with caution.
Finally, results on reliability pointed adequate reliability estimates for the dimensions of the Spanish version of the SSCS–L scale, except for the dimension of over-identification. This result is in line with Neff’s study [62]. A possible explanation of the failure of the over-identification dimension could be that this dimension is made up of three items; two of these are clearly negative, but the third is less pronounced, since it literally says: I’m getting carried away with my feelings. Therefore, some respondents may interpret this item in a positive way, contrary to the remainder of the dimension. It is precisely the only item with low reliability, and the culprit of such low reliability of the entire dimension. Future studies should delve into the meaning of this item, especially in samples that are not familiar with meditative techniques, such as the one in this study. For example, studies on content validity could be done, in order to delimitate the representativeness and adequacy of the items’ content to the evaluation of state self-compassion.

Study Limitations

This study presents some shortcomings, including the small size of the sample, which can affect to the generalizability of the results obtained. Additionally, test-retest reliability estimates could not be provided. Another limitation regards the models tested, which do not include the vastness of proposed structures for the study of self-compassion. Finally, and as stated by Neff et al. [62], it should be noted that the SSCS–L scale measures the construct of self-compassion as defined by Neff [1,2], and therefore it cannot be used to assess other definitions of self-compassion. Future longitudinal studies testing the psychometric properties of the Spanish version of the SSCS–L scale in bigger, more representative samples should be welcomed.

5. Conclusions

The results of the present study show that the Spanish version of the SSCS-L is psychometrically valid, and is a reliable measure for the state self-compassion in nursing students. Self-compassion, which is a protective factor against stress and burnout, can be enhanced through the development of positive affect, and the reduction of negative affect. As self-compassion is positively related with empathy, compassion for others, effectiveness of care and compassionate care, it has become a key competency for healthcare professionals. As the professionals most vulnerable to suffer the negative effects of helping others with their suffering, nurses—and especially nursing students—need to have a valid and reliable tool that allows for periodic assessments of self-compassion, as one way to improve professionals’ well-being and to ensure compassionate care.
The global shortage of nurses, exacerbated by the health crisis caused by the COVID-19 pandemic, makes it even more necessary to work on all those aspects that can prevent processes such as burnout and compassion fatigue. Both of them can lead to premature abandonment of the profession. Introducing skills such as self-compassion and valuing them in undergraduate training when professionals are still in training is possibly the most effective time to do so. The State Self-Compassion Scale–Long (SSCS–L) is an essential tool for this purpose, as it will allow for an adequate assessment of self-compassion in experimental contexts. The results of the present study will facilitate the incorporation of soft skills such as self-compassion in the curriculum of nursing students.

Author Contributions

Conceptualization, L.G. and N.S.; methodology, L.G. and N.S.; software, L.G.; validation, M.G., A.P., S.L.F., G.V.-B. and N.S.; formal analysis, L.G.; investigation, L.G., M.G., A.P., S.L.F., G.V.-B. and N.S.; resources, L.G. and N.S.; data curation, L.G.; writing—original draft preparation, L.G. and N.S.; writing—review and editing, L.G., M.G., A.P., S.L.F., G.V.-B. and N.S.; visualization, L.G. and N.S.; supervision, L.G. and N.S.; and project administration, L.G. and N.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was approved by the Ethics Research Committee at the University of the Balearic Islands (263CER22). Students participated voluntarily and anonymously. The study complied with the ethical principles for research in health sciences established in the Declaration of Helsinki. The participants signed an informed consent document to authorize the collection and processing of their information, and they were able to withdraw their consent at any time and without any consequences.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data that support the findings of this study are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Neff, K.D. The development and validation of a scale to measure self-compassion. Self Identity 2003, 2, 223–250. [Google Scholar] [CrossRef]
  2. Neff, K.D. Self-compassion: An alternative conceptualization of a healthy attitude toward oneself. Self Identity 2003, 2, 85–101. [Google Scholar] [CrossRef]
  3. Neff, K.D. The self-compassion scale is a valid and theoretically coherent measure of self-compassion. Mindfulness 2016, 7, 264–274. [Google Scholar] [CrossRef]
  4. Neff, K.D.; Dahm, K.A. Self-compassion: What it is, what it does, and how it relates to mindfulness. In Handbook of Mindfulness and Self-Regulation; Ostafin, B.D., Robinson, M.D., Meier, B.P., Eds.; Springer: New York, NY, USA, 2015; pp. 121–137. [Google Scholar]
  5. Neff, K.D.; Bluth, K.; Tóth-Király, I.; Davidson, O.; Knox, M.C.; Williamson, Z.; Costigan, A. Development and Validation of the Self-Compassion Scale for Youth. J. Pers. Assess. 2021, 103, 92–105. [Google Scholar] [CrossRef]
  6. Demirci, I.; Halil, E.K.S.I.; Fusun, E.K.S.I. Narcissism, life satisfaction, and harmony: The mediating role of self-esteem and self-compassion. Eurasian J. Educ. Res. 2019, 19, 159–178. [Google Scholar] [CrossRef]
  7. Kim, C.; Ko, H. The impact of self-compassion on mental health, sleep, quality of life and life satisfaction among older adults. Geriatr. Nurs. 2018, 39, 623–628. [Google Scholar] [CrossRef] [PubMed]
  8. Booker, J.A.; Dunsmore, J.C. Testing Direct and Indirect Ties of Self-Compassion with Subjective Well-Being. J. Happiness Stud. 2019, 20, 1563–1585. [Google Scholar] [CrossRef]
  9. Kang, M.J.; Kim, J.H.; Kim, M. The effects of self-compassion program on internalized shame and subjective well-being in female university students with depressive mood. Korean J. Stress Res. 2019, 27, 464–471. [Google Scholar] [CrossRef]
  10. Toplu-Demirtaş, E.; Kemer, G.; Pope, A.L.; Moe, J.L. Self-compassion matters: The relationships between perceived social support, self-compassion, and subjective well-being among LGB individuals in Turkey. J. Couns. Psychol. 2018, 65, 372–382. [Google Scholar] [CrossRef]
  11. Braehler, C.; Gumley, A.; Harper, J.; Wallace, S.; Norrie, J.; Gilbert, P. Exploring change processes in compassion focused therapy in psychosis: Results of a feasibility randomized controlled trial. Br. J. Clin. Psychol. 2013, 52, 199–241. [Google Scholar] [CrossRef]
  12. Judge, L.; Cleghorn, A.; McEwan, K.; Gilbert, P. An exploration of group-based compassion focused therapy for a heterogeneous range of clients presenting to a community mental health team. Int. J. Cogn. Ther. 2012, 5, 420–429. [Google Scholar] [CrossRef]
  13. Lucre, K.M.; Corten, N. An exploration of group compassion-focused therapy for personality disorder. Psychol. Psychother. 2013, 86, 387–400. [Google Scholar] [CrossRef] [PubMed]
  14. Pullmer, R.; Chung, J.; Samson, L.; Balanji, S.; Zaitsoff, S. A systematic review of the relation between self-compassion and depressive symptoms in adolescents. J. Adolesc. 2019, 74, 210–220. [Google Scholar] [CrossRef] [PubMed]
  15. Schuling, R.; Huijbers, M.; van Ravesteijn, H.; Donders, R.; Cillessen, L.; Kuyken, W.; Speckens, A. Recovery from recurrent depression: Randomized controlled trial of the efficacy of mindfulness-based compassionate living compared with treatment-as-usual on depressive symptoms and its consolidation at longer term follow-up. J. Affect. Disord. 2020, 273, 265–273. [Google Scholar] [CrossRef] [PubMed]
  16. Cleare, S.; Gumley, A.; O’Connor, R.C. Self-compassion, self-forgiveness, suicidal ideation, and self-harm: A systematic review. Clin. Psychol. Psychother. 2019, 26, 511–530. [Google Scholar] [CrossRef] [PubMed]
  17. Lathren, C.R.; Rao, S.S.; Park, J.; Bluth, K. Self-Compassion and Current Close Interpersonal Relationships: A Scoping Literature Review. Mindfulness 2021, 12, 1078–1093. [Google Scholar] [CrossRef] [PubMed]
  18. Gouveia, M.J.; Carona, C.; Canavarro, M.C.; Moreira, H. Self-compassion and dispositional mindfulness are associated with parenting styles and parenting stress: The mediating role of mindful parenting. Mindfulness 2016, 7, 700–712. [Google Scholar] [CrossRef]
  19. Kim, E.; Krägeloh, C.U.; Medvedev, O.N.; Duncan, L.G.; Singh, N.N. Interpersonal mindfulness in parenting scale: Testing the psychometric properties of a Korean version. Mindfulness 2019, 10, 516–528. [Google Scholar] [CrossRef]
  20. Moreira, H.; Canavarro, M.C. Psychometric properties of the interpersonal mindfulness in parenting scale in a sample of Portuguese mothers. Mindfulness 2017, 8, 691–706. [Google Scholar] [CrossRef]
  21. Fuochi, G.; Veneziani, C.A.; Voci, A. Exploring the social side of self-compassion: Relations with empathy and outgroup attitudes. Eur. J. Soc. Psychol. 2018, 48, 769–783. [Google Scholar] [CrossRef]
  22. Hwang, Y.S.; Medvedev, O.N.; Krägeloh, C.; Hand, K.; Noh, J.E.; Singh, N.N. The role of dispositional mindfulness and self-compassion in educator stress. Mindfulness 2019, 10, 1692–1702. [Google Scholar] [CrossRef]
  23. Arambasic, J.; Sherman, K.A.; Elder, E. Attachment styles, self-compassion, and psychological adjustment in long-term breast ancer survivors. Psychooncology 2019, 28, 1134–1141. [Google Scholar] [PubMed]
  24. Jacobson, E.H.K.; Wilson, K.G.; Solomon Kurz, A.; Kellum, K.K. Examining self-compassion in romantic relationships. J. Contextual Behav. Sci. 2018, 8, 69–73. [Google Scholar] [CrossRef]
  25. Zhang, J.; Chen, S.; Tomova Shakur, T. From me to you: Self-compassion predicts acceptance of own and others’ imperfections. Personal. Soc. Psychol. Bull. 2020, 46, 228–242. [Google Scholar] [CrossRef] [PubMed]
  26. Babenko, O.; Mosewich, A.D.; Lee, A.; Koppula, S. Association of physicians’ self-compassion with work engagement, exhaustion, and professional life satisfaction. Med. Sci. 2019, 7, 29. [Google Scholar] [CrossRef]
  27. Reizer, A. Bringing self-kindness into the workplace: Exploring the mediating role of self-compassion in the associations between attachment and organizational outcomes. Front. Psychol. 2019, 10, 1148. [Google Scholar] [CrossRef]
  28. Voci, A.; Veneziani, C.A.; Bernardi, S. Dispositional mindfulness and self-compassion as predictors of work-related well-being. Psicol. Soc. 2016, 11, 69–88. [Google Scholar]
  29. Galiana, L.; Sansó, N.; Muñoz-Martínez, I.; Vidal-Blanco, G.; Oliver, A.; Larkin, P.J. Palliative Care Professionals’ Inner Life: Exploring the Mediating Role of Self-Compassion in the Prediction of Compassion Satisfaction, Compassion Fatigue, Burnout and Wellbeing. J. Pain Symptom Manag. 2022, 63, 112–123. [Google Scholar] [CrossRef]
  30. Kowalczuk, K.; Krajewska-Kułak, E.; Sobolewski, M. The Effect of Subjective Perception of Work in Relation to Occupational and Demographic Factors on the Mental Health of Polish Nurses. Front. Psychiatry 2020, 11, 591957. [Google Scholar] [CrossRef]
  31. Escot, C.; Artero, S.; Gandubert, C.; Boulenger, J.P.; Ritchie, K. Stress levels in nursing staff working in oncology. Stress Health 2001, 17, 273–279. [Google Scholar] [CrossRef]
  32. Dev, V.; Fernando, A.T.; Consedine, N.S. Self-compassion as a Stress Moderator: A Cross-sectional Study of 1700 Doctors, Nurses, and Medical Students. Mindfulness 2020, 11, 1170–1181. [Google Scholar] [CrossRef] [PubMed]
  33. Duarte, J.; Pinto-Gouveia, J. Mindfulness, self-compassion and psychological inflexibility mediate the effects of a mindfulness-based intervention in a sample of oncology nurses. J. Contextual Behav. Sci. 2017, 6, 125–133. [Google Scholar] [CrossRef]
  34. Mahon, M.A.; Mee, L.; Brett, D.; Dowling, M. Nurses’ perceived stress and compassion following a mindfulness meditation and self-compassion training. J. Res. Nurs. 2017, 22, 572–583. [Google Scholar] [CrossRef]
  35. Duarte, J.; Pinto-Gouveia, J.; Cruz, B. Relationships between nurses’ empathy, self-compassion and dimensions of professional quality of life: A cross-sectional study. Int. J. Nurs. Stud. 2016, 60, 1–11. [Google Scholar] [CrossRef] [PubMed]
  36. Andrews, H.; Tierney, S.; Seers, K. Needing permission: The experience of self-care and self-compassion in nursing: A constructivist grounded theory study. Int. J. Nurs. Stud. 2020, 101, 103436. [Google Scholar] [CrossRef] [PubMed]
  37. Vaillancourt, E.S.; Wasylkiw, L. The Intermediary Role of Burnout in the Relationship Between Self-Compassion and Job Satisfaction Among Nurses. Can. J. Nurs. Res. 2020, 52, 246–254. [Google Scholar] [CrossRef] [PubMed]
  38. Delaney, M.C. Caring for the caregivers: Evaluation of the effect of an eight-week pilot mindful self-compassion (MSC) training program on nurses’ compassion fatigue and resilience. PLoS ONE 2018, 13, e0207261. [Google Scholar] [CrossRef]
  39. Dev, V.; Fernando, A.T.; Lim, A.G.; Consedine, N.S. Does self-compassion mitigate the relationship between burnout and barriers to compassion? A cross-sectional quantitative study of 799 nurses. Int. J. Nurs. Stud. 2018, 81, 81–88. [Google Scholar] [CrossRef]
  40. Durkin, M.; Beaumont, E.; Hollins Martin, C.J.; Carson, J. A pilot study exploring the relationship between self-compassion, self-judgement, self-kindness, compassion, professional quality of life and wellbeing among UK community nurses. Nurse Educ. Today 2016, 46, 109–114. [Google Scholar] [CrossRef]
  41. Sansó, N.; Galiana, L.; Oliver, A.; Tomás-Salvá, M.; Vidal-Blanco, G. Predicting Professional Quality of Life and Life Satisfaction in Spanish Nurses: A Cross-Sectional Study. Int. J. Environ. Res. Public Health 2020, 17, 4366. [Google Scholar] [CrossRef]
  42. Lluch-Sanz, C.; Galiana, L.; Vidal-Blanco, G.; Sansó, N. Psychometric Properties of the Self-Compassion Scale-Short Form: Study of Its Role as a Protector of Spanish Nurses Professional Quality of Life and Well-Being during the COVID-19 Pandemic. Nurs. Rep. 2022, 12, 65–76. [Google Scholar] [CrossRef] [PubMed]
  43. Savieto, R.M.; Mercer, S.; Matos, C.; Leão, E.R. Nurses in the triage of the emergency department: Self-compassion and empathy. Enfermeiros na triagem no serviço de emergência: Autocompaixão e empatia. Rev. Lat. Am. Enferm. 2019, 27, e3151. [Google Scholar] [CrossRef] [PubMed]
  44. Mills, J.; Wand, T.; Fraser, J.A. Exploring the meaning and practice of self-care among palliative care nurses and doctors: A qualitative study. BMC Palliat. Care 2018, 17, 63. [Google Scholar] [CrossRef] [PubMed]
  45. Duarte, J.; Pinto-Gouveia, J. The role of psychological factors in oncology nurses’ burnout and compassion fatigue symptoms. Eur. J. Oncol. Nurs. 2017, 28, 114–121. [Google Scholar] [CrossRef]
  46. Rao, N.; Kemper, K.J. Online Training in Specific Meditation Practices Improves Gratitude, Well-Being, Self-Compassion, and Confidence in Providing Compassionate Care Among Health Professionals. J. Evid. Based Complement. Altern. Med. 2017, 22, 237–241. [Google Scholar] [CrossRef]
  47. Varghese, B. Relationships Between Positive and Negative Attributes of Self-Compassion and Perceived Caring Efficacy Among Psychiatric-Mental Health Nurses. J. Psychosoc. Nurs. Ment. Health Serv. 2020, 58, 32–40. [Google Scholar] [CrossRef]
  48. Raes, F.; Pommier, E.; Neff, K.D.; Van Gucht, D. Construction and factorial validation of a short form of the self-compassion scale. Clin. Psychol. Psychother. 2011, 18, 250–255. [Google Scholar] [CrossRef]
  49. Souza, L.K.D.; Hutz, C.S. Self-compassion in Brazilian women and relations with self-esteem, self-efficacy and demographic aspects. Psico 2016, 47, 89–98. [Google Scholar] [CrossRef]
  50. Chen, J.; Yan, L.S.; Zhou, L.H. Reliability and validity of Chinese version of Self-compassion Scale. Chin. J. Clin. Psychol. 2011, 33, 440–443. [Google Scholar]
  51. Kotsou, I.; Leys, C. Self-Compassion Scale (SCS): Psychometric Properties of The French Translation and Its Relations with Psychological Well-Being, Affect and Depression. PLoS ONE 2016, 11, e0152880. [Google Scholar] [CrossRef]
  52. Hupfeld, J.; Ruffieux, N. Validierung einer deutschen version der Self-Compassion Scale (SCS-D). Z. Fur Klin. Psychol. Und Psychother. 2011, 40, 115. [Google Scholar] [CrossRef]
  53. Mantzios, M.; Wilson, J.C.; Giannou, K. Self-Compassion Scale-Greek Version. Mindfulness 2015, 6, 123–132. [Google Scholar] [CrossRef]
  54. Petrocchi, N.; Ottaviani, C.; Couyoumdjian, A. Dimensionality of self-compassion: Translation and construct validation of the self-compassion scale in an Italian sample. J. Ment. Health 2014, 23, 72–77. [Google Scholar] [CrossRef] [PubMed]
  55. Arimitsu, K. Development and validation of the Japanese version of the self-compassion scale. Shinrigaku Kenkyu 2014, 85, 50–59. [Google Scholar] [CrossRef]
  56. Kim, K.E.; Yi, G.D.; Cho, Y.R.; Chai, S.H.; Lee, W.K. The validation study of the Korean version of the Self-Compassion Scale. Hanguk Simni Hakhoe Chi Kongang 2008, 13, 1023–1044. [Google Scholar]
  57. Dundas, I.; Svendsen, J.L.; Wiker, A.S.; Granli, K.V.; Schanche, E. Self-compassion and depressive symptoms in a Norwegian student sample. Nord. Psychol. 2016, 68, 58–72. [Google Scholar] [CrossRef]
  58. Ghorbani, N.; Chen, Z.H.; Saeedi, Z.; Behjati, Z.; Watson, P.G. Sakhtare Ameli Meghyase Shafeghat e Khod dar Iran (Factorial Structure of Self-Compassion Scale in Iran). Pazhohesh Haye Karbordi Ravanshenakhti 2013, 4, 29–41. [Google Scholar]
  59. Castilho, P.; Pinto-Gouveia, J. Self-Compassion: Validation of the Portuguese version of the Self-Compassion Scale and its relation with early negative experiences, social comparison and psychopathology. Psychologica 2011, 54, 203–231. [Google Scholar] [CrossRef]
  60. Garcia-Campayo, J.; Navarro-Gil, M.; Andrés, E.; Montero-Marin, J.; López-Artal, L.; Demarzo, M.M. Validation of the Spanish versions of the long (26 items) and short (12 items) forms of the Self-Compassion Scale (SCS). Health Qual. Life Outcomes 2014, 12, 4. [Google Scholar] [CrossRef]
  61. Steen, M.; Javanmard, M.; Vernon, R. Influence of Self-Compassion on the Health of Midwives and Nurses: Protocol for a Scoping Review. JMIR Res. Protoc. 2021, 19, 16–30. [Google Scholar]
  62. Neff, K.D.; Tóth-Király, I.; Knox, M.C.; Kuchar, A.; Davidson, O. The development and validation of the state self-compassion scale (long-and short form). Mindfulness 2021, 12, 121–140. [Google Scholar] [CrossRef]
  63. Blackie, R.A.; Kocovski, N.L. Examining the Relationships Among Self-Compassion, Social Anxiety, and Post-Event Processing. Psychol. Rep. 2018, 121, 669–689. [Google Scholar] [CrossRef] [PubMed]
  64. Breines, J.G.; Chen, S. Self-compassion increases self-improvement motivation. Pers. Soc. Psychol. Bull. 2012, 38, 1133–1143. [Google Scholar] [CrossRef] [PubMed]
  65. Kirschner, H.; Kuyken, W.; Wright, K.; Roberts, H.; Brejcha, C.; Karl, A. Soothing Your Heart and Feeling Connected: A New Experimental Paradigm to Study the Benefits of Self-Compassion. Clin. Psychol. Sci. 2019, 7, 545–565. [Google Scholar] [CrossRef]
  66. Leary, M.R.; Tate, E.B.; Adams, C.E.; Allen, A.B.; Hancock, J. Self-compassion and reactions to unpleasant self-relevant events: The implications of treating oneself kindly. J. Pers. Soc. Psychol. 2007, 92, 887–904. [Google Scholar] [CrossRef]
  67. Odou, N.; Brinker, J. Exploring the relationship between rumination, self-compassion, and mood. Self Identity 2014, 13, 449–459. [Google Scholar] [CrossRef]
  68. Von Elm, E.; Altman, D.G.; Egger, M.; Pocock, S.J.; Gøtzsche, P.C.; Vandenbroucke, J.P. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. J. Clin. Epidemiol. 2008, 61, 344–349. [Google Scholar] [CrossRef]
  69. Watson, D.; Clark, L.A.; Tellegen, A. Development and validation of brief measures of positive and negative affect: The PANAS scales. J. Pers. Soc. Psychol. 1988, 54, 1063–1070. [Google Scholar] [CrossRef]
  70. Hu, L.; Bentler, P.M. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct. Equ. Model. Multidiscip. J. 1999, 6, 1–55. [Google Scholar] [CrossRef]
  71. Cheung, G.W.; Rensvold, R.B. Evaluating goodness-of-fit indexes for testing measurement invariance. Struct. Equ. Model. 2002, 9, 233–255. [Google Scholar] [CrossRef]
  72. Little, T.D. Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivar. Behav. Res. 1997, 32, 53–76. [Google Scholar] [CrossRef] [PubMed]
  73. Brown, T.A. Confirmatory Factor Analysis for Applied Research; Guilford Press: New York, NY, USA, 2006. [Google Scholar]
  74. Flora, D.B.; Curran, P.J. An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol. Methods 2004, 9, 466–491. [Google Scholar] [CrossRef] [PubMed]
  75. Muthén, L.; Muthén, B. Mplus User’s Guide, 8th ed.; Muthén & Muthén: Los Angeles, CA, USA, 2017. [Google Scholar]
  76. IBM Corp. IBM SPSS Statistics for Windows, Version 26.0; IBM Corp.: Armonk, NY, USA, 2019. [Google Scholar]
  77. Alabdulaziz, H.; Alquwez, N.; Almazan, J.U.; Albougami, A.; Alshammari, F.; Cruz, J.P. The Self-Compassion Scale Arabic version for baccalaureate nursing students: A validation study. Nurse Educ. Today 2020, 89, 104420. [Google Scholar] [CrossRef] [PubMed]
  78. Sansó, N.; Galiana, L.; Oliver, A.; Cuesta, P.; Sánchez, C.; Benito, E. Evaluación de una intervención mindfulness en equipos de cuidados paliativos. Interv. Psicosoc. 2018, 27, 88–91. [Google Scholar] [CrossRef]
  79. Neff, K.D.; Kirkpatrick, K.L.; Rude, S.S. Self-compassion and adaptive psychological functioning. J. Res. Pers. 2007, 41, 139–154. [Google Scholar] [CrossRef]
  80. Guan, F.; Wu, Y.; Ren, W.; Zhang, P.; Jing, B.; Xu, Z.; Wu, S.T.; Peng, K.P.; He, J.B. Self-compassion and the Mitigation of Negative Affect in the Era of Social Distancing. Mindfulness 2021, 12, 2184–2195. [Google Scholar] [CrossRef]
  81. Germer, C.K.; Neff, K.D. Self-compassion in clinical practice. J. Clin. Psychol. 2013, 69, 856–867. [Google Scholar] [CrossRef]
  82. Terry, M.L.; Leary, M.R.; Mehta, S.; Henderson, K. Self-compassionate reactions to health threats. Pers. Soc. Psychol. Bull. 2013, 39, 911–926. [Google Scholar] [CrossRef]
  83. Yarnell, L.M.; Stafford, R.E.; Neff, K.D.; Reilly, E.D.; Knox, M.C.; Mullarkey, M. Meta-analysis of gender differences in self-compassion. Self Identity 2015, 14, 499–520. [Google Scholar] [CrossRef]
  84. Yarnell, L.M.; Neff, K.D.; Davidson, O.A.; Mullarkey, M. Gender differences in self-compassion: Examining the role of gender role orientation. Mindfulness 2019, 10, 1136–1152. [Google Scholar] [CrossRef]
Figure 1. Competitive Confirmatory Factor Analyses for the SSCS–L.
Figure 1. Competitive Confirmatory Factor Analyses for the SSCS–L.
Ijerph 19 10174 g001
Figure 2. Analytical fit of the best fitting model for the SSCS–L. Notes: All factor loadings resulted statistically significant (p < 0.001). For the sake of clarity, standard errors are not shown.
Figure 2. Analytical fit of the best fitting model for the SSCS–L. Notes: All factor loadings resulted statistically significant (p < 0.001). For the sake of clarity, standard errors are not shown.
Ijerph 19 10174 g002
Table 1. Items and descriptive statistics for the SSCS–L.
Table 1. Items and descriptive statistics for the SSCS–L.
Item *MSDMinMax
1. I’m giving myself the care and tenderness I need.
1. Me doy todo el cuidado y el cariño que necesito.
2.9661.0331.005.00
2. I’m obsessing and fixating on everything that’s wrong.
2. Me obsesiono y me centro únicamente en las cosas negativas.
3.0111.0701.005.00
3. I see my difficulties as part of life that everyone goes through.
3. Veo las dificultades que tengo como algo por lo que todo el mundo pasa en la vida.
3.4740.9551.005.00
4. I’m being pretty tough on myself.
4. Estoy siendo muy duro/a conmigo mismo/a.
3.4131.0651.005.00
5. I’m keeping my emotions in balanced perspective.
5. Veo mis emociones con perspectiva.
3.2020.9581.005.00
6. I feel separate and cut off from the rest of the world.
6. Me siento apartado/a y desconectado/a del resto del mundo.
2.8861.2151.005.00
7. I’m being kind to myself.
7. Estoy siendo amable conmigo mismo/a.
3.0721.0821.005.00
8. I’m getting carried away with my feelings.
8. Me estoy dejando llevar por mis emociones.
3.3020.9371.005.00
9. I’m remembering that there are lots of others in the world feeling like I am.
9. Tengo presente que hay muchas otras personas en el mundo que se sienten como yo.
3.8530.9681.005.00
10. I’m being a bit cold-hearted towards myself.
10. Estoy siendo un poco cruel conmigo mismo/a.
3.0611.2101.005.00
11. I’m taking a balanced view of this painful situation.
11. Abordo esta dolorosa situación de forma equilibrada.
3.0230.9271.005.00
12. I feel like I’m struggling more than others right now.
12. Siento que me está costando más que a otros en este momento.
3.1591.1221.005.00
13. I’m being supportive toward myself.
13. Estoy siendo comprensivo/a conmigo mismo/a.
3.0381.0051.005.00
14. I’m blowing this painful incident out of proportion.
14. Estoy magnificando demasiado esta dolorosa situación.
2.9241.1321.005.00
15. I’m remembering that difficult feelings are shared by most people.
15. Tengo presente que la mayoría de la gente experimenta las mismas sensaciones desagradables.
3.6501.0191.005.00
16. I feel intolerant and impatient toward myself.
16. Siento que soy un/a intolerante y un/a impaciente conmigo mismo/a.
3.0801.1381.005.00
17. I’m keeping things in perspective.
17. Veo las cosas con perspectiva.
3.2690.9791.005.00
18. I’m feeling all alone right now.
18. Ahora mismo me siento muy solo/a.
2.5151.2791.005.00
* Italics for the Spanish version of the SSSC–L.
Table 2. Sample description.
Table 2. Sample description.
VariableGroupsM 1SD 2
Age-22.617.22
VariableGroupsn%
SexWomen27284.0
Men5115.7
Missing10.3
UniversityUniversity of Valencia16851.9
University of the Balearic Islands15648.1
Missing00.0
LivingAlone113.4
With parents14043.2
With other students9830.2
With couple 3611.1
Others3912.0
Missing00.0
JobWithout job22970.7
Part-time job4413.6
Full-time job 5115.7
Missing00.0
Healthcare professionalNo27785.5
Yes4714.5
Missing00.0
1 M = mean; 2 SD = standard deviation.
Table 3. Goodness-of-fit indices for the estimated solutions for the SSCS-L.
Table 3. Goodness-of-fit indices for the estimated solutions for the SSCS-L.
Modelχ2dfpCFITLIRMSEA (90% CI)SRMR
One-factor CFA1269.710135< 0.0010.7410.7060.177 (0.169, 0.186)0.119
Two-factor CFA673.873134< 0.0010.8770.8590.123 (0.114, 0.132)0.076
Six-factor CFA319.126120< 0.0010.9550.9420.079 (0.068, 0.089)0.050
Table 4. Criterion-related validity results for the Spanish SSCS–L.
Table 4. Criterion-related validity results for the Spanish SSCS–L.
VariablePositive AffectNegative AffectFdfeffectdferrorpMwomenSDwomenMmenSDmen
Self-kindness0.532 **−0.404 **10.52212640.0012.9490.9303.4360.793
Self-judgement−0.333 **0.345 **0.00012610.9943.1800.9793.1780.910
Common humanity0.253 **−0.094 n.s.0.01512620.9013.6510.7693.6670.804
Isolation−0.448 **0.357 **0.24512620.6212.8300.9532.9091.064
Mindfulness0.419 **−0.324 **6.31112620.0133.1120.7823.4320.710
Over-identification−0.255 **0.284 **0.59412620.4423.0570.7363.1510.782
** p < 0.001; n.s. = not statistically significant.
Table 5. Cronbach’s alpha, CR and bivariate correlations for the Spanish SSCS–L.
Table 5. Cronbach’s alpha, CR and bivariate correlations for the Spanish SSCS–L.
Variable SK 1SJ 2CH 3IS 4MI 5OI 6Cronbach’s alphaCR
Self-kindness - 0.8570.887
Self-judgement −0.584 **- 0.8100.848
Common humanity 0.362 **−0.032 n.s.- 0.6810.753
Isolation−0.488 **0.784 **−0.270 **- 0.7290.786
Mindfulness0.892 **−0.442 **0.610 **−0.412 **- 0.7460.790
Over-identification−0.504 **0.998 **−0.065 n.s.0.939 **−0.445 **-0.5060.557
1 SK = self-kindness; 2 SJ = self-judgment; 3 CH = common humanity; 4 IS = isolation; 5 MI = mindfulness; 6 OI = overidentification; CR = composite reliability; ** p < 0.001; n.s. = not statistically significant.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Galiana, L.; Guillén, M.; Pades, A.; Flowers, S.L.; Vidal-Blanco, G.; Sansó, N. The Spanish Version of the State Self-Compassion Scale–Long Form (SSCS–L): A Study of Its Validity and Reliability in a Sample of Nursing Students. Int. J. Environ. Res. Public Health 2022, 19, 10174. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph191610174

AMA Style

Galiana L, Guillén M, Pades A, Flowers SL, Vidal-Blanco G, Sansó N. The Spanish Version of the State Self-Compassion Scale–Long Form (SSCS–L): A Study of Its Validity and Reliability in a Sample of Nursing Students. International Journal of Environmental Research and Public Health. 2022; 19(16):10174. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph191610174

Chicago/Turabian Style

Galiana, Laura, Mireia Guillén, Antonia Pades, Sarah L. Flowers, Gabriel Vidal-Blanco, and Noemí Sansó. 2022. "The Spanish Version of the State Self-Compassion Scale–Long Form (SSCS–L): A Study of Its Validity and Reliability in a Sample of Nursing Students" International Journal of Environmental Research and Public Health 19, no. 16: 10174. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph191610174

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop