Next Article in Journal
Change in Physical Activity, Sleep Quality, and Psychosocial Variables during COVID-19 Lockdown: Evidence from the Lothian Birth Cohort 1936
Next Article in Special Issue
Identification of Risk Factors to Predict the Occurrences of Relapses in Individuals with Schizophrenia Spectrum Disorder in Iran
Previous Article in Journal
Response to Flavored Cartridge/Pod-Based Product Ban among Adult JUUL Users: “You Get Nicotine However You Can Get It”
Previous Article in Special Issue
Thought Suppression in Primary Psychotic Disorders and Substance/Medication Induced Psychotic Disorder
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Suicide Attempts and Perceived Social Support among Chinese Drug Users: The Mediating Role of Self-Esteem and Depression

1
School of Social Work, University of Maryland Baltimore, Baltimore, MD 21201, USA
2
The Graduate Center, City University of New York, New York, NY 10016, USA
3
School of Social and Behavioral Sciences, Nanjing University, Nanjing 210023, China
4
Department of Social and Behavioural Sciences, City University of Hong Kong, Hong Kong, China
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(1), 208; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18010208
Submission received: 17 October 2020 / Revised: 13 December 2020 / Accepted: 25 December 2020 / Published: 30 December 2020
(This article belongs to the Special Issue Adult Psychiatry)

Abstract

:
Suicidal behavior is a severe problem among drug users. This study examines influential factors related to suicide attempts and analyzes possible mediators of the relationship between perceived social support and suicide attempts amongst Chinese drug users under compulsory institutional drug treatment. Taking perceived social support as the independent variable, we found that the relationship between suicide attempts and perceived social support is mediated by self-esteem as a protective factor and depression as a risk factor. Path analysis shows that self-esteem contributes relatively more to the indirect effects than depression does, accounting for 31.1% and 24.2% of the total effect, respectively. Generally speaking, the findings of this study point to an urgent need for addressing suicide attempts among Chinese drug users while treating self-esteem as the protective factor that deserves as substantial attention as depression receives.

1. Introduction

Suicide is a worldwide health problem. According to the World Health Organization [1], in 2016, the global suicide rate was 10.5 per 100,000 people, and suicide is the second leading cause of death among people aged 15 to 29. In China, the suicide rate was 8.0 per 100,000 people in 2016. While the suicide rate in China was lower than that of the global rate, the number of suicide deaths was still high, namely 136,267, accounting for about 17% of the world’s suicide deaths (800,000 per year) [1]. In China, the national suicide rates decreased significantly from 2002 to 2015. However, the drop in suicide rates slowed down around 2007, and the rate even increased in some subgroups, such as young male adults [2]. Male and rural populations have a higher suicide rate and a lower decreasing trend than female and urban populations [3]. Chinese studies found similar predictors of suicide to those in other cultures, including physical health, psychological and psychopathological factors, social support, and stressful life events [4].
Drug users are primarily documented as a high-risk population of suicidal behavior [5,6], since drug use can exert a negative impact on individuals’ health and mental health, and can also cause problems such as cognitive neurological disorder, depression, and anxiety [7,8]. For example, previous research findings reported that the occurrence of suicidal ideation and suicide attempts among illicit drug users were as high as 55% and 32%, respectively [9,10]. Moreover, the suicide mortality rate of heroin users was found to be 16.2 fold higher than that of the general population [11].
Suicide issues among drug users have become salient in China, considering its large population of drug users. Along with its rapid economic growth, the Chinese society has been facing a fast and steady increase in the drug use rate since the late 1970s [12,13]. The number of Chinese registered drug users, i.e., those caught by police at least once for drug use, has doubled in the past decade and grew to 2.5 million in 2016 [13]. While China has seen a decrease in registered drug users from 2017 to 2019, the total population remains large, i.e., 2.14 million by the end of 2019 [14]. Previous empirical studies in China showed that the rates of lifetime suicidal ideation and suicide attempts among methadone-maintained patients were 58.9% and 34.2%, respectively [15,16]. The rate of suicidal ideation among male and female drug users under compulsory institutional drug treatment was 31.5% and 21.3%, respectively [17,18]. The rate of suicidal ideation after enrolling in compulsory treatment facilities was higher than pre-treatment rates (24.6% vs. 16.4%) [19]. Under such a context, the studies on Chinese drug users’ suicidal behavior are much needed.

2. Literature Review and Theoretical Perspective

“Suicide” used in the introduction section refers to completed suicide. In fact, the nomenclature of “suicidology” falls into three distinct categories―suicidal ideation, suicide attempt, and completed suicide [20,21]. Suicidal ideation refers to thoughts of ending one’s own life [22]. Suicide attempt as a behavioral consequence of suicidal ideation [23] refers to self-harm behavior with a certain degree of suicidal ideation and a non-fatal result [24]. The third terminology, completed suicide, is used when the outcomes are fatal [25]. Logically, these three distinct terms, suicidal ideation, suicide attempt, and completed suicide, form a progression from ideation to action, whilst illustrating three stages of suicidality with different severity of consequences [26]. This study uses suicide attempt as the dependent variable, rather than suicidal ideation or completed suicide, because suicide attempt connects suicide ideation and completed suicide. Suicidal ideation does not inevitably lead people to commit suicide [27]; however, suicide attempts have been found to be the most significant predictor of the next attempt and completed suicide [28,29]. Moreover, assessing suicide attempts is more direct and reliable than assessing suicidal ideation. Suicidal ideation is a subjective thought or latent variable that cannot be observed and is thus hard to precisely measure [30]. In contrast, suicide attempt as a concrete behavior is observable and countable. Compared to the data collection of completed suicide, which often requires interviews with the decedents’ family members or close relatives [31], suicide attempts could be self-reported.
Among studies of suicide, many traditional theories focused on the risk factors, which refer to the influencing factors that encourage the occurrence of a negative result [32], such as psychache [33], burdensomeness, and social alienation [34]. Klonsky and May [27] proposed a three-step theory of suicide, which incorporates connectedness as a protective factor against the escalation of suicidal ideation. Connectedness is defined broadly, referring to the connection of other people or “any sense of perceived purpose or meaning that keeps one invested in living” [27] (p. 117).
Social support as a kind of connectedness is documented to be a protective factor of lifetime suicide attempts [35]. Social support refers to an asset, including instrumental, emotional, informational resources, and social companionship that one can obtain from their social networks [36]. Social support can be qualitative and quantitative [37], and can be further divided into received social support and perceived social support [38]. Received social support is defined as the morphological properties of individuals’ social networks, measured quantitatively through the networks’ reachability, density, anchorage, and range [39]. Perceived social support refers to individuals’ perception or general satisfaction of the support from others in their social network [40]. Compared to received social support, perceived social support as a subjective feeling has been proved to have a more significant effect on one’s mental health [41], and mental health is highly related to suicidal behavior among drug users [9]. For example, a higher likelihood of suicide attempts was found to be associated with a lower level of perceived parental support for adolescents [42]. In this regard, the present study used perceived social support as the independent variable, rather than received social support.
Defined as people’s perception of themselves [43], self-esteem is also found to act as a protective factor of suicidal behavior [44]. According to a study with substance users, those with higher self-esteem have a lower risk of suicidal ideation [45]. Previous studies have also proved that self-esteem is a potential factor that mediates the relationship between perceived social support and suicidal ideation [46]. For example, Kleiman and Riskind [46] revealed that perceived social support might increase self-esteem and then reduces the strength of suicidal ideation among college students. However, its mediating effect among drug users in the suicide attempts/perceived social support relationship remains unclear.
In addition to protective factors, there are also risk factors for suicide attempts. Psychological distress and mental disorders were risk factors of suicide attempts among drug users, including depression, anxiety, borderline personality disorder, and post-traumatic stress disorder [11,47,48,49]. Among all the risk factors, this study explores the possible mediating function of depression for the association between suicide attempts and perceived social support. Studies on rural left-behind children have shown that depression could be a mediator to the relationship between suicidal ideation and perceived social support [26]. In other words, depression is not only directly related to suicidal ideation [50] and perceived social support [51], but also standing in between, serving a mediating role for the relationship [52]. This study intends to swap suicidal ideation with suicide attempts and examine the possible associations with the sample of Chinese drug users, an underexplored group.
Suicide attempts are also found to be associated with some demographic factors among Chinese drug users, including gender, education level, and age. Evidence has shown that a high likelihood of suicide attempts is related to females with an educational level of primary school or lower and younger age (20–39 years old) among Chinese individuals receiving methadone maintenance treatment [16,53]. However, another study conducted in Taiwan has found that recent suicide attempt is associated with a higher level of education [54], and studies in some western societies found that female heroin users have higher rates of suicidal ideation and attempts while having lower rates of completed suicide than male heroin users [9]. Further, being single/divorced/widowed [16], having a long history of drug use [17], and experiencing adverse childhood experiences [55] may also increase the chance of suicide attempts among drug users. As a result, these factors were used in the analytical models as control variables.
In summary, although the studies on Chinese drug epidemics have grown substantially in recent years, research on drug users’ suicide attempts is minimal. To fill this gap, we intend to provide newer empirical data for suicide attempts and explore the influencing factors among Chinese drug users. While there have been numerous studies on suicidal ideation and perceived social support, the relationship between suicide attempts and perceived social support remains underexplored. Additionally, our research aims to explore the possible mediators for the association, primarily self-esteem and depression. Thus, we propose the following hypotheses: (1) Suicide attempts are negatively associated with perceived social support. (2) Suicide attempts are negatively associated with self-esteem. (3) Suicide attempts are positively associated with depression. (4) Self-esteem and depression mediate the effect of suicide attempts on perceived social support.

3. Materials and Methods

3.1. Participants and Procedures

This study is based on a cross-sectional survey conducted in nine compulsory drug treatment institutions in China. China has a “zero-tolerance” policy on using illicit drugs, including “opium, heroin, methamphetamine, morphine, marijuana, cocaine, 121 types of narcotic drugs, and 130 types of psychotropic drugs” [56] (p. 310). Individuals caught using the aforementioned illicit drugs would face administrative punishment. They would be fined for being caught for the first time or required to participate in a community-based treatment program if caught for the second time. Being caught for the third time or more would make them subject to a two-year compulsory institutional drug treatment [57,58], which involves vocational training and educational rehabilitation, but does not involve any psychiatric drug treatment [57]. In 2016, 357,000 drug users were subjected to institutional compulsory drug treatment, accounting for the largest group of drug users who received treatment [59]. The research protocol was approved by the School of Social and Behavioral Sciences of Nanjing University to make sure that steps were taken to protect human research participants, and the research was conducted in an ethical manner.
Stratified cluster sampling was used to recruit participants. Two residential halls were randomly selected from each of the nine compulsory drug treatment institutions. All individuals (around 200) in each selected residential hall were invited to complete the self-administered questionnaires. Research participants were fully informed of this study’s purpose, their voluntary participation, and the obligation of researchers to protect the privacy of participants and maintain the confidentiality of data before completing the questionnaire. The trained research assistants also emphasized that, if prospective participants declined participation, it would not affect their continued access to drug treatment programs—no penalties would be imposed for their decline. A total of 3473 questionnaires were distributed, and 3239 valid responses (70% male and 30% female) were received with a response rate of 93.3%. Among them, 27.5% were meth users, i.e., people who primarily used meth prior to residential treatment; 13.2% were heroin users, and 2.1% used other drugs such as cocaine, ecstasy, ketamine, and marijuana. About 57.2% of the participants refused to report the type of drug they primarily used.

3.2. Variables and Measures

All the valid samples from the survey were used for the logistic regression and path analyses, though listwise deletion was applied to variables with missing values. The final sample consisted of 1895 Chinese drug users. Suicide attempt, as the dependent variable, was measured by a “yes” or “no” single-choice question, “Have you ever attempted suicide in the past 30 days?” (Yes = 1; No = 0). Considering perceived social support is a latent variable that is hard to observe, a well-developed scale, the Multidimensional Scale of Perceived Social Support (MSPSS), was used to measure the concept. With MSPSS, drug users’ perceived social support from family, friends, and significant others could be measured [60]. MSPSS contains 12 items, and a 7-point Likert scale measures each item (1 = Strongly Disagree and 7 = Strongly Agree). In this study, scores for all items were summed up to compute a total score to predict the perceived social support of each case. A higher score indicates a higher level of perceived social support. This scale has been proven to have high reliability and validity by various psychometric evaluation scales across different academic disciplines [60,61]. In this study, the Cronbach’s α of the MSPSS was 0.87.
We hypothesize that self-esteem and depression to be the mediators of suicide attempts regress on perceived social support. Self-esteem was measured by Rosenberg’s Self-Esteem Scale (SES) [43], a 10-item scale with some positive and some negative dimensions. This scale was rated by a 4-point Likert scale (1 = Strongly Disagree, 2 = Disagree, 3 = Agree, 4 = Strongly Agree). The score of the negative domain was reversed, and then the scores for ten items were summed up to compute a total score. The higher the score, the higher level of self-esteem. The Chinese version of SES has been proved reliable among Chinese drug users [62]. The Cronbach’s α of SES in this study is 0.77.
The severity of depression was measured by Zung Self-Rating Depression Scale (SDS) [63]. This scale contains 20 items, 10 items assessing the positive domain and 10 items assessing the negative domain. All items were rated by a 4-point Likert scale ranging from 1 (Rarely) to 4 (Almost Always). We reversed the score of the positive domain and summed up the rating of all items. A higher total score indicates a higher level of depression. The Chinese version of SDS has been employed in various populations and has shown great reliability and validity [64]. In this study, the Cronbach’s α of SDS is 0.70.
Finally, control variables include demographic factors like gender, age, education level, marital status, length of drug use, and abuse experience. The dichotomous variables, gender, marital status, and abuse experience, were coded as dummy variables. Marital status was recoded as “single (including divorced and widowed) = 0” and “married (including cohabitation) = 1”. History of abuse was measured by two-option “yes” or “no” single-choice questions, “Have you ever experienced physical abuse during your lifetime” and “Have you ever experienced emotional abuse during your lifetime”. A positive answer to either question indicates a history of being abused, while negative responses for both indicate no history of being abused. The non-dichotomous categorical variable, level of education, was recoded as “primary school or below = 1”, “middle school = 2”, “high school = 3”, and “junior college or above = 4”. Continuous variables―age and length of drug use variables—were used in our analysis in the same form as the data was initially collected.

3.3. Analytical Process

Binary logistic regression was applied to examine factors associated with suicide attempts because the dependent variable is a dichotomous variable, namely had or never had suicide attempts. Moreover, logistic regression is a function of the logarithm of the ratio between the probabilities of something happening and not happening [65]. Therefore, it is usually used to predict the likelihood of an event. In this study, we ran five different models with logistic regression to provide an exploratory description of the associations between the dependent variable, independent variable, control variables, and the two primary mediators. In Model 1, the dependent variable regresses only on the independent variable, while in Model 2, control variables were added. In Models 3 and 4, self-esteem and depression were added, respectively, on top of Model 2. Finally, we put all variables in Model 5.
Furthermore, path analysis with logistic regression was performed to examine the primary mediating role of self-esteem and depression, both respectively and combined. The KHB method developed by Karlson, Holm, and Breen [66] was applied in path analysis with Stata 14. As a general decomposition method, the KHB method is used for “comparing the estimated coefficients of two nested nonlinear probability models” [66] (p. 420). First, the KHB method decomposes the total effect into direct and indirect effects and then further produces a confounding percentage that interprets the magnitude of the indirect effect. Second, the KHB command in Stata allows more than one mediator in one path analysis and disentangles the contributions of these mediators. Thus, we can compare the confounding percentages to determine one of the multiple mediators contributing most to the confounding. In this study, three mediation analyses with two different possible mediators were conducted. We firstly examined the probable mediation effect of self-esteem and depression individually and then put them together into the mediation model for path analysis to compare their contributions to the indirect effect. We only focused on the dependent variable, independent variable, and two mediators; thus, no controls were included in all three path analyses.

4. Results

4.1. Description of Samples

After list-wise deletion, we first performed descriptive statistics on all variables. As all continuous variables have a skewness between −1 and 2, we view distributions as normal and report mean values for their central tendency. For the dependent variable, 7.8% of the respondents had suicide attempts in the last 30 days (Table 1). Table 1 presents the mean value and standard deviation of perceived social support, self-esteem, and depression; perceived social support shows the highest dispersion. Male drug users were the majority (70%) of all participants. Nearly two-thirds (63.2%) of drug users only completed nine years of education—middle school or less. Approximately 43.6% of the respondents were married, including cohabitation. The data showed that 22.2% of the respondents experienced physical or emotional abuse during their lifetime. The average age was 32.5 years old, while the average length of drug use was close to ten years.
In Table 2, the correlation matrix presents correlations and the possible collinearity between all continuous variables, namely perceived social support, self-esteem, depression, age, and length of drug use. All correlation coefficients were under 0.7. Perceived social support, self-esteem, and depression were all significantly correlated with one another. A higher level of perceived social support was correlated with a higher level of self-esteem (r = 0.188) and a lower level of depression (r = −0.141); a higher level of self-esteem indicates a lower level of depression, and vice versa (r = −0.391). Age was positively correlated with the length of drug use (r = 0.62), inferring a certain level of lifetime drug use behavior.

4.2. Logistic Regression for Suicide Attempts on Perceived Social Support

Binary logistic regression analysis with five different models was used to explore the associations between suicide attempts and perceived social support, controlling for demographic variables, and possible mediators, self-esteem, and depression (Table 3). Model 1 examines the possible association between suicide attempts and perceived social support. Suicide attempts have been found to be negatively associated with perceived social support. For every one-unit increase in perceived social support, we expect a 2% (e−0.014−1, p < 0.05) decrease in the likelihood of suicide attempts. Model 2 has control variables added. The significance of the association between suicide attempts and perceived social support disappears, while suicide attempts were positively associated with male and abuse experience. Compared to females, male drug users have 125% (e0.812−1, p < 0.001) higher likelihood of attempting suicides holding all other variables in the model constant. Drug users in the study with abuse experience have 77% (e0.573−1, p < 0.01) higher likelihood of attempting suicides compared to those who had never experienced abuse.
In Model 3, we added self-esteem on top of Model 2, and suicide attempts were negatively associated with self-esteem. For every one-unit increase in self-esteem, the likelihood of suicide attempts decreases by 10% (e−0.109−1, p < 0.001), holding all controls constant. In Model 4, we swapped self-esteem with depression in Model 3, and suicide attempts were positively associated with depression. For every one-unit increase in depression, the likelihood of suicide attempts increases by 6% (e0.057−1, p < 0.001), holding all controls constant. Finally, all variables were put into Model 5. Suicide attempts were still significantly associated with self-esteem, depression, male, and history of abuse.
In summary, suicide attempts were only significantly associated with perceived social support in Model 1. When controls were added, the association between suicide attempts and perceived social support disappears, while other factors showed significance. This pattern remained when we added self-esteem and depression, both individually and combined in Models 3–5. This result implies not only a possible spurious association between suicide attempts and perceived social support, but also potential mediators. Therefore, mediation analyses were performed.

4.3. Mediation Analyses

The KHB method is applied to examine the mediating effect of self-esteem and depression on the relationship between suicide attempts and perceived social support. We performed three mediation analyses, including the dependent variable, independent variable, and mediators; no control variable was added (Table 4).
Firstly, we took self-esteem as the only mediator. The effect of perceived social support, when mediated by self-esteem, reduced from 0.015 to 0.008, leaving an indirect effect of 0.007; in other words, 45.2% of the total effect is contributed by self-esteem.
Secondly, we took depression as the only mediator in the relationship between suicide attempts and perceived social support. The effect of perceived social support, when mediated by depression, reduced from 0.015 to 0.01, leaving an indirect effect of 0.005; in other words, 33.5% of the total effect is due to depression.
Finally, we took both self-esteem and depression together into the mediation model. These two variables reduced the effect of perceived social support from 0.016 to 0.007, with an indirect effect of 0.009, accounting for 55.3%. Compared to depression (24.2%), self-esteem (31.1%) contributed 6.9% more to the indirect effect.

5. Discussion

In this study, we explored suicide attempts and associated factors among Chinese drug users under compulsory institutional drug treatment, and further investigated the mediating effect of self-esteem and depression on the relationship between suicide attempts and perceived social support. First, the prevalence of suicide attempts in the last 30 days is 7.8%, which is relatively lower than the numbers reported in previous studies on Chinese drug users, for instance, 9.5% or 10.9% among methadone-maintained patients [16,54]. Additionally, the findings showed that drug users with abuse experience have a significantly higher number of suicide attempts, which is consistent with previous studies [55]. People tend to develop suicidal capacity due to being exposed to abuse [27]. Further, we performed logistic regression analysis and examined the primary mediating role of self-esteem and depression. Being consistent with what we hypothesized, a higher likelihood of suicide attempts was significantly associated with a lower level of self-esteem, and a higher level of depression. We also found that suicide attempts among drug users are not directly affected by one’s level of perceived social support; instead, perceived social support plays its protective role via self-esteem and depression. This finding challenges Hypothesis 1, but confirms Hypothesis 4. In other words, a higher perceived social support was associated with a lower level of depression, which in turn reduces the chance of suicide attempts; meanwhile, perceived social support may reduce the likelihood of suicide attempts by increasing self-esteem.
Firstly, the findings of this study challenge the conclusion from previous studies. We argue that perceived social support has no significant direct effect on suicide attempts [35]. To further explain this finding, we refer to the three-step theory of suicide [27]. There are three steps before reaching the stage of suicide attempts: the emerging of suicidal ideation, the escalating of suicidal ideation, and lastly, suicide attempts and suicidal ideation is bridged by suicide ability. In this theory, loss of social connectedness does not necessarily contribute to the emerging of suicidal ideation, while strong connectedness plays a protective role against the escalating of suicidal ideation. Thus, we believe that perceived social support as a kind of connectedness acts indirectly on suicide attempts by reducing factors that escalate suicidal ideation.
Secondly, the finding of the mediating role of self-esteem between suicide attempts and perceived social support could be explained by the theory of positive thinking [67]. Studies showed that self-esteem could promote one’s positive thinking, which, in turn, enhances their suicide resilience. Apart from self-esteem, depression is also found to mediate the relationship between suicide attempts and perceived social support by our study among drug users. This finding can also be explained by the aforementioned three-step theory of suicide, in which depression, as the most significant risk factor of suicidal behavior [68], enhances the suicidal ideation that brings people to the last stage—suicide attempts. Thus, perceived social support affects drug users’ suicidal ideation through reducing the level of depression, and eventually decreases a drug users’ likelihood of suicide attempts.
Thirdly, using the KHB command, we found that self-esteem as a mediator contributed more amount to the indirect effect than depression did. In other words, self-esteem needs substantial attention in studying suicidal behavior, especially among drug users. Depression is a widely discussed mental health problem in suicide [9], but self-esteem is not. Drug-dependents, in general, experience significantly lower self-esteem than the general population [69]. A qualitative study has indicated that drug use brings a feeling of guilt or self-hate for users, which destroys their self-esteem and self-image [70]. While our study reinforces the importance of depression that has been highlighted in previous studies, we argue that for special populations like drug users, self-esteem could also be an essential protective factor of suicidal behavior.
These findings have significant theoretical and practical contributions. To the best of our knowledge, supported by the three-step theory of suicide, this study is the first to explore the mediating effect of self-esteem and depression on the association between suicide attempts and perceived social support among Chinese drug users. Practice-wise, the finding of this study indicates the importance of developing mental health counseling programs to reduce suicide attempts among drug users, especially those under compulsory institutional drug treatment. They have limited connection with people from outside due to the residential treatment policy and confined environment. The lower level of perceived social support may increase suicide attempts by influencing their mental health conditions. Therefore, programs addressing depression and improving self-esteem would help prevent suicide attempts within the compulsory drug treatment institutions. Further studies can also examine the operation processes and the effectiveness of these programs, thus contributing to drug treatment improvement.
Despite the aforementioned implication, this study has a few limitations. First, the representativeness of the sample is limited. Since all participants were recruited from compulsory institutional treatment programs, the interpretation of the results should be limited to this specific period and situated environment. However, this limitation also enhanced the uniqueness of our empirical data and related findings. Another limitation is the measurement of perceived social support. The scale of MSPSS can only measure people’s general perception, without considering the positive or negative domain of the social support they perceived. However, in the field of criminology, previous studies suggested asking what the social relations’ views on drug users’ deviant behavior [12] are because social support may not always have a beneficial effect. For example, studies showed that having a first-degree relative with a history of suicide attempts was a predictor of suicidal behavior among drug users [49]. Therefore, future research can further consider perceived both positive social support and negative social support. Lastly, this study primarily focused on the psychological and social relationship factors while failing to include physical health factors [71]. Further studies can explore physical health factors, such as perceived health status and sleep disorders [47,72].

6. Conclusions

In conclusion, this research sampled Chinese drug users under compulsory treatments, studied the association between suicide attempts and perceived social support, and explored the possible mediating roles of self-esteem and depression. We found that suicide attempts and perceived social support could be a spurious association. Further analysis showed that perceived social support did not directly affect drug users’ suicide attempts but functioned indirectly by reducing the level of depression and improving the level of self-esteem. According to the results of path analysis with the KHB command, we found that self-esteem as a mediator contributes more to the indirect effect than depression does. Our finding also indicates that self-esteem deserves substantial attention in the field of suicide research, especially among drug users.

Author Contributions

Conceptualization, L.L.; methodology, Y.D. and X.L.; software, Y.D. and X.L.; validation, Y.D., X.L., and L.L.; formal analysis, Y.D. and X.L.; investigation, L.L.; resources, L.L.; data curation, Y.D.; writing—original draft preparation, Y.D.; writing—review and editing, X.L., L.L., and W.H.C.; visualization, Y.D., X.L., and L.L.; supervision, L.L.; project administration, L.L.; funding acquisition, L.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by The National Social Science Fund of the People’s Republic of China, grant number 19BSH029.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of the School of Social and Behavioral Sciences, Nanjing University.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to the privacy.

Acknowledgments

Thanks to Yuxiao Wu from Nanjing University for consulting during the preparation of the article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. Suicide in the World: Global Health Estimates. 2016. Available online: https://www.who.int/publications-detail/suicide-in-the-world (accessed on 9 September 2019).
  2. Jiang, H.; Niu, L.; Hahne, J.; Hu, M.; Fang, J.; Shen, M.; Xiao, S. Changing of suicide rates in China, 2002–2015. J. Affect. Disord. 2018, 240, 165–170. [Google Scholar] [CrossRef] [PubMed]
  3. Liu, R.Z.; Huang, Q.Y.; Chao, M.A.; Shang, L.L.; Zhang, T.T.; Chen, G.H. Suicide rate trends in China from 2002 to 2015. Chin. Ment. Health J. 2017, 31, 756–767. (In Chinese) [Google Scholar]
  4. Zhang, J.; Conwell, Y.; Zhou, L.; Jiang, C. Culture, risk factors and suicide in rural China: A psychological autopsy case control study. Acta Psychiatr. Scand. 2004, 110, 430–437. [Google Scholar] [CrossRef] [PubMed]
  5. Conner, K.R.; Bridge, J.A.; Davidson, D.J.; Pilcher, C.; Brent, D.A. Metaanalysis of mood and substance use disorders in proximal risk for suicide deaths. Suicide Life-Threat. Behav. 2019, 49, 278–292. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Tiet, Q.Q.; Ilgen, M.A.; Byrnes, H.F.; Moos, R.H. Suicide attempts among substance use disorder patients: An initial step toward a decision tree for suicide management. Alcohol Clin. Exp. Res. 2006, 30, 998–1005. [Google Scholar] [CrossRef]
  7. Sharikova, A.V.; Quaye, E.; Park, J.Y.; Maloney, M.C.; Desta, H.; Thiyagarajan, R.; Seldeen, K.L.; Parikh, N.U.; Sandhu, P.; Khmaladze, A.; et al. Methamphetamine induces apoptosis of microglia via the intrinsic mitochondrial-dependent pathway. J. Neuroimmune Pharmacol. 2018, 13, 396–411. [Google Scholar] [CrossRef]
  8. Glasner-Edwards, S.; Marinelli-Casey, P.; Hillhouse, M.; Ang, A.; Rawson, R. Depression among methamphetamine users association with outcomes from the methamphetamine treatment project at 3-year follow-up. J. Nerv. Ment. Dis. 2009, 197, 225–231. [Google Scholar] [CrossRef] [Green Version]
  9. Darke, S.; Ross, J. Suicide among heroin users: Rates, risk factors and methods. Addiction 2002, 97, 1383–1394. [Google Scholar] [CrossRef]
  10. Darke, S.; Torok, M.; Kaye, S.; Ross, J. Attempted suicide, self-harm, and violent victimization among regular illicit drug users. Suicide Life-Threat. Behav. 2010, 40, 587–596. [Google Scholar] [CrossRef]
  11. Pan, C.H.; Jhong, J.R.; Tsai, S.Y.; Lin, S.K.; Chen, C.C.; Kuo, C.J. Excessive suicide mortality and risk factors for suicide among patients with heroin dependence. Drug Alcohol Depend. 2014, 145, 224–230. [Google Scholar] [CrossRef]
  12. Liu, L.; Wang, H.; Chui, W.H.; Cao, L. Chinese drug users’ abstinence intentions: The role of perceived social support. J. Drug Issues 2018, 48, 519–535. [Google Scholar] [CrossRef]
  13. Liu, L.; Cao, Q. Perceived stress and sleep quality among Chinese drug users: Analysis of rumination as a mediator and resilience as a moderator. Int. J. Ment. Health Ad. 2020. [Google Scholar] [CrossRef]
  14. National Narcotics Control Commission of China. Drug Situation in China. 2019. Available online: http://www.nncc626.com/2020-06/25/c_1210675877.htm (accessed on 25 June 2020).
  15. Xu, Y.M.; Zhong, B.L.; Chen, W.C.; Zhu, J.H.; Lu, J. Suicidal ideation among Chinese methadone-maintained patients: Prevalence and correlates. Oncotarget 2017, 8, 86181. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Dragisic, T.; Dickov, A.; Dickov, V.; Mijatovic, V. Drug addiction as risk for suicide attempts. Mater. Sociomed. 2015, 27, 188–191. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Chen, Y.L.; Zhang, J.J.; Song, X.G.; Cheng, J.; Sun, Y.J. Analysis of suicide ideation and suicide attempts of 625 female drug addicts under compulsory rehabilitation in Anhui. Chin. J. Dis. Control 2018, 22, 1303–1305. (In Chinese) [Google Scholar]
  18. Huang, L.J. The Researh on the Relationship among Quality of Life, Psychache and Suicidal Ideation of the Male Drug Abstainers. Master’s Thesis, Shanxi Medical University, Taiyuan, China, 2017. (In Chinese). [Google Scholar]
  19. Ma, H.; Wang, Y.F.; Li, S.S.; Zhang, Z.H.; Huang, L.Q.; Hu, L.R. Analysis on the correlation between suicidal ideation with social support and family function among drug addicts. Prev. Med. Trib. 2019, 25, 731–734. (In Chinese) [Google Scholar]
  20. Silverman, M.M. The language of suicidology. Suicide Life-Threat. Behav. 2006, 36, 519–532. [Google Scholar] [CrossRef] [Green Version]
  21. Beck, A.T.; Resnik, H.L.P.; Lettieri, D.J. The Prediction of Suicide; The Charles Press: Bowie, MD, USA, 1974. [Google Scholar]
  22. Hasley, J.P.; Ghosh, B.; Huggins, J.; Bell, M.R.; Adler, L.E.; Shroyer, A.L.W. A review of “suicidal intent” within the existing suicide literature. Suicide Life-Threat. Behav. 2008, 38, 576–591. [Google Scholar] [CrossRef]
  23. Lyu, J.; Wang, Y.; Shi, H.; Zhang, J. Early warnings for suicide attempt among Chinese rural population. J. Affect. Disord. 2018, 238, 353–358. [Google Scholar] [CrossRef]
  24. O’Carroll, P.W.; Berman, A.L.; Maris, R.W.; Moscicki, E.K.; Tanney, B.L.; Silverman, M.M. Beyond the tower of babel: A nomenclature for suicidology. Suicide Life-Threat. Behav. 1996, 26, 237–252. [Google Scholar] [CrossRef]
  25. Leo, D.D.; Burgis, S.L.; Bertolote, J.M.; Kerkhof, A.J.F.M.; Bille-Brahe, U. Definitions of suicidal behavior: Lessons learned from the who/euro multicentre study. Crisis 2006, 27, 4–15. [Google Scholar] [CrossRef] [PubMed]
  26. Xiao, Y.; Chen, Y.; Chang, W.; Pu, Y.; Chen, X.; Guo, J.; Li, Y.; Yin, F. Perceived social support and suicide ideation in Chinese rural left-behind children: A possible mediating role of depression. J. Affect. Disord. 2020, 261, 198–203. [Google Scholar] [CrossRef] [PubMed]
  27. Klonsky, E.D.; May, A.M. The three-step theory (3ST): A new theory of suicide rooted in the “ideation-to-action” framework. Int. J. Cogn. Ther. 2015, 8, 114–129. [Google Scholar] [CrossRef] [Green Version]
  28. Suominen, K.; Isometsä, E.; Suokas, J.; Haukka, J.; Achte, K.; Lönnqvist, J. Completed suicide after a suicide attempt: A 37-year follow-up study. Am. J. Psychiatry 2004, 161, 562–563. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Darke, S.; Williamson, A.; Ross, J.; Teesson, M. Attempted suicide among heroin users: 12-month outcomes from the Australian Treatment Outcome Study (ATOS). Drug Alcohol Depend. 2005, 78, 177–186. [Google Scholar] [CrossRef]
  30. Schofield, L.S. Correcting for measurement error in latent variables used as predictors. Ann. Appl. Stat. 2015, 9, 2133. [Google Scholar] [CrossRef]
  31. Hawton, K.; Appleby, L.; Platt, S.; Foster, T.; Cooper, J.; Malmberg, A.; Simkin, S. The psychological autopsy approach to studying suicide: A review of methodological issues. J. Affect. Disord. 1998, 50, 269–276. [Google Scholar] [CrossRef]
  32. Bell, C.; Pham, A.V.; Carlson, J.S. Protective factors. In Encyclopedia of Child Behavior and Development; Goldstein, S., Naglieri, J.A., Eds.; Springer: Boston, MA, USA, 2011; p. 1168. [Google Scholar]
  33. Shneidman, E.S. Suicide as psychache. J. Nerv. Ment. Dis. 1993, 18, 147–149. [Google Scholar] [CrossRef]
  34. Joiner, T.E. Why People Die by Suicide; Harvard University Press: Cambridge, MA, USA, 2005. [Google Scholar]
  35. Kleiman, E.M.; Liu, R.T. Social support as a protective factor in suicide: Findings from two nationally representative samples. J. Affect. Disord. 2013, 150, 540–545. [Google Scholar] [CrossRef] [Green Version]
  36. Cohen, S.; Wills, T.A. Stress, social support, and the buffering hypothesis. Psychol. Bull. 1985, 98, 310. [Google Scholar] [CrossRef]
  37. Thoits, P.A. Conceptual, methodological, and theoretical problems in studying social support as a buffer against life stress. J. Health Soc. Behav. 1982, 23, 145–159. [Google Scholar] [CrossRef] [PubMed]
  38. Zhou, K.; Li, H.; Wei, X.; Yin, J.; Liang, P.; Zhang, H.; Kou, L.; Hao, M.; You, L.; Li, X.; et al. Reliability and validity of the multidimensional scale of perceived social support in Chinese mainland patients with methadone maintenance treatment. Compr. Psychiatry 2015, 60, 182–188. [Google Scholar] [CrossRef] [PubMed]
  39. Kaplan, B.H.; Cassel, J.C.; Gore, S. Social support and health. Med. Care 1977, 15, 47–58. [Google Scholar] [CrossRef] [PubMed]
  40. Sarason, I.G.; Sarason, B.R.; Shearin, E.N.; Pierce, G.R. A brief measure of social support: Practical and theoretical implications. J. Soc. Pers. Relat. 1987, 4, 497–510. [Google Scholar] [CrossRef]
  41. Prati, G.; Pietrantoni, L. The relation of perceived and received social support to mental health among first responders: A meta-analytic review. J. Community Psychol. 2010, 38, 403–417. [Google Scholar] [CrossRef]
  42. Miller, A.B.; Esposito-Smythers, C.; Leichtweis, R.N. Role of social support in adolescent suicidal ideation and suicide attempts. J. Adolesc. Health 2015, 56, 286–292. [Google Scholar] [CrossRef]
  43. Rosenberg, M. Society and the Adolescent Self-Image; Princeton University Press: Princeton, NJ, USA, 1965. [Google Scholar]
  44. Sharaf, A.Y.; Thompson, E.A.; Walsh, E. Protective effects of self-esteem and family support on suicide risk behaviors among at-risk adolescents. J. Child Adolesc. Psychiatr. Nurs. 2009, 22, 160–168. [Google Scholar] [CrossRef]
  45. Wilke, D.J. Predicting suicide ideation for substance users: The role of self-esteem, abstinence, and attendance at 12-step meetings. Addict. Res. Theory 2004, 12, 231–240. [Google Scholar] [CrossRef]
  46. Kleiman, E.M.; Riskind, J.H. Utilized social support and self-esteem mediate the relationship between perceived social support and suicide ideation. Crisis 2013, 34, 42–49. [Google Scholar] [CrossRef]
  47. Park, S.; Song, H. Factors that affect adolescent drug users’ suicide attempts. Psychiatry Investig. 2016, 13, 360–363. [Google Scholar] [CrossRef] [Green Version]
  48. Maloney, E.; Degenhardt, L.; Darke, S.; Mattick, R.P.; Nelson, E. Suicidal behaviour and associated risk factors among opioid-dependent individuals: A case–control study. Addiction 2007, 102, 1933–1941. [Google Scholar] [CrossRef] [PubMed]
  49. Trémeau, F.; Darreye, A.; Staner, L.; Corrêa, H.; Weibel, H.; Khidichian, F.; Macher, J.P. Suicidality in opioid-dependent subjects. Am. J. Addict. 2008, 17, 187–194. [Google Scholar] [CrossRef] [PubMed]
  50. Conner, K.R.; Bohnert, A.S.; Mccarthy, J.F.; Bossarte, R.; Ignacio, R.; Lu, N.; Ilgen, M.A. Mental disorder comorbidity and suicide among 2.96 million men receiving care in the veterans health administration health system. J. Abnorm. Psychol. 2013, 122, 256–263. [Google Scholar] [CrossRef]
  51. Risser, J.; Cates, A.; Rehman, H.; Risser, W. Gender differences in social support and depression among injection drug users in Houston, Texas. Am. J. Drug Alcohol Abuse 2010, 36, 18–24. [Google Scholar] [CrossRef]
  52. Ge, D.; Sun, L.; Zhou, C.; Qian, Y.; Zhang, L.; Medina, A. Exploring the risk factors of suicidal ideation among the seniors in Shandong, China: A path analysis. J. Affect. Disord. 2017, 207, 393–397. [Google Scholar] [CrossRef] [PubMed]
  53. Wines, J.D., Jr.; Saitz, R.; Horton, N.J.; Lloyd-Travaglini, C.; Samet, J.H. Suicidal behavior, drug use and depressive symptoms after detoxification: A 2-year prospective study. Drug Alcohol Depend. 2004, 76, S21–S29. [Google Scholar] [CrossRef] [PubMed]
  54. Chen, C.H.; Lin, T.Y.; Lee, T.C.; Lai, T.J.; Chen, H.; Ferri, C.P.; Gossop, M. Suicide attempts prior to starting methadone maintenance treatment in taiwan. Drug Alcohol Depend. 2010, 109, 139–143. [Google Scholar] [CrossRef]
  55. Rossow, I.; Lauritzen, G. Shattered childhood: A key issue in suicidal behavior among drug addicts? Addiction 2001, 96, 227–240. [Google Scholar] [CrossRef]
  56. Liu, L.; Chui, W.H.; Deng, Y.; Li, H. Dealing with resistance: Working with involuntary clients in community-based drug treatment programs in China. Aust. Soc. Work 2020, 73, 309–320. [Google Scholar] [CrossRef]
  57. Liu, L.; Hsiao, S.C. Chinese female drug users’ experiences and attitudes with institutional drug treatment. Int. J. Offender Ther. 2018, 62, 4221–4235. [Google Scholar] [CrossRef]
  58. Liu, L.; Chui, W.H. Rehabilitation policy for drug addicted offenders in china: Current trends, patterns, and practice implications. Asia Pac. J. Soc. Work 2018, 28, 192–204. [Google Scholar] [CrossRef]
  59. National Narcotics Control Commission of China. Annual Report on Drug-Using Situation in China. 2016. Available online: http://www.nncc626.com/2017-03/27/c_129519255.htm (accessed on 27 March 2020). (In Chinese).
  60. Zimet, G.D.; Dahlem, N.W.; Zimet, S.G.; Farley, G.K. The multidimensional scale of perceived social support. J. Pers. Assess. 1988, 52, 30–41. [Google Scholar] [CrossRef] [Green Version]
  61. Cheng, S.T.; Chan, A.C.M. The multidimensional scale of perceived social support: Dimensionality and age and gender differences in adolescents. Pers. Individ. Dif. 2004, 37, 1359–1369. [Google Scholar] [CrossRef]
  62. Chen, X.; Ye, J.; Zhou, H. Chinese male addicts’drug craving and their global and contingent self-esteem. Soc. Behav. Personal. 2013, 41, 907–919. [Google Scholar] [CrossRef]
  63. Zung, W.K.A. Self-rating depression scale. Arch. Gen. Psychiat. 1965, 12, 63–70. [Google Scholar] [CrossRef]
  64. Lee, H.C.; Chiu, H.F.K.; Wing, Y.K.; Leung, C.M.; Kwong, P.K.; Chung, D.W.S. The Zung self-rating depression scale: Screening for depression among the Hong Kong Chinese elderly. J. Geriatr. Psychiatry Neurol. 1994, 7, 216–220. [Google Scholar] [CrossRef]
  65. Sperandei, S. Understanding logistic regression analysis. Biochem. Med. 2014, 24, 12–18. [Google Scholar] [CrossRef]
  66. Kohler, U.; Karlson, K.B.; Holm, A. Comparing coefficients of nested nonlinear probability models. Stata J. 2011, 11, 420–438. [Google Scholar] [CrossRef] [Green Version]
  67. Matel-Anderson, D.M.; Bekhet, A.K.; Garnier-Villarreal, M. Mediating effects of positive thinking and social support on suicide resilience. West. J. Nurs. Res. 2018, 41, 25–41. [Google Scholar] [CrossRef]
  68. Galaif, E.R.; Sussman, S.; Newcomb, M.D.; Locke, T.F. Suicidality, depression, and alcohol use among adolescents: A review of empirical findings. Int. J. Adolesc. Med. Health 2007, 19, 27–36. [Google Scholar] [CrossRef] [Green Version]
  69. Gossop, M. Drug dependence and self-esteem. Int. J. Addict. 1976, 11, 741–753. [Google Scholar] [CrossRef] [PubMed]
  70. Butler, R.; Wheeler, A.; Sheridan, J. Physical and psychological harms and health consequences of methamphetamine use amongst a group of New Zealand users. Int. J. Ment. Health Addict. 2010, 8, 432–443. [Google Scholar] [CrossRef]
  71. Tran, B.X.; Moir, M.; Nguyen, T.M.T.; Do, H.N.; Vu, G.T.; Dang, A.K.; Ha, G.H.; Nguyen, T.H.T.; Vuong, H.Q.; Ho, T.M.; et al. Changes in quality of life and its associated factors among illicit drug users in Vietnamese mountainous provinces: A 12-month follow-up study. Subst. Abuse Treat. PR 2020, 15. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  72. Morita, N.; Kouda, M.; Umeno, M.; Ikeda, T.; Yabe, Y.; Endo, K.; Abe, Y.; Hirai, H.; Takahashi, K.; Aikawa, Y.; et al. Study on risk factors of suicidal ideation in people with drug abuse. Jpn. J. Alcohol Stud. Drug Depend. 2012, 47, 24–38. [Google Scholar]
Table 1. Descriptive statistics.
Table 1. Descriptive statistics.
VariableMeanSD
Suicide attempts (1 = yes) a,b0.078-
Perceived social support61.411.9
Self-esteem26.74.0
Depression48.48.3
Gender (1 = male)0.70-
Age32.58.0
Education level
Primary or below0.198-
Middle school0.434-
High school0.267-
Junior college or above0.101-
Marital status (1 = married) c0.436-
Length of drug use9.26.6
Ever experienced abuse (1 = yes)0.222-
a The number of valid cases is 1895. b For dummy variables, percentages for category “1” are reported in the cell. c Married includes cohabitation.
Table 2. Correlation between continuous variables.
Table 2. Correlation between continuous variables.
PSS aSelf-esteemDepressionAgeLDU b
PSS1
Self-esteem0.188 ***1
Depression−0.141 ***−0.391 ***1
Age−0.022−0.0350.01431
LDU0.011−0.0080.0180.621 ***1
a Abbrevation PSS = perceived social support b LDU = length of drug use, *** p < 0.001.
Table 3. Logistic regression models for suicide attempts.
Table 3. Logistic regression models for suicide attempts.
VariablesModel 1Model 2Model 3Model 4Model 5
Perceived social support−0.014 *−0.010−0.005−0.006−0.004
(0.007)(0.007)(0.007)(0.007)(0.007)
Self-esteem -−0.109 ***-−0.075 **
-(0.025)-(0.026)
Depression --0.057 ***0.044 ***
--(0.012)(0.013)
Male 0.812 ***0.800 ***0.943 ***0.905 ***
(0.232)(0.233)(0.235)(0.236)
Age −0.008−0.008−0.009−0.009
(0.014)(0.014)(0.014)(0.014)
Education level 0.0920.1150.0440.070
(0.094)(0.094)(0.095)(0.095)
Being married 0.0390.0450.0380.042
(0.177)(0.178)(0.178)(0.179)
Length of drug use 0.0020.0020.0010.000
(0.018)(0.018)(0.018)(0.018)
Ever experienced abuse 0.573 **0.542 **0.494 *0.489 *
(0.191)(0.193)(0.193)(0.194)
Constant−1.633 ***−2.613 ***−0.138−5.598 ***−3.203 **
(0.412)(0.630)(0.837)(0.896)(1.218)
Observations18951895189518951895
Significance of models0.0430.0000.0000.0000.000
Pseudo R-squared0.0040.0270.0460.0500.059
Standard errors in parentheses * p < 0.05, ** p < 0.01, *** p < 0.001.
Table 4. Self-esteem and depression as mediators among the relationship between suicide attempts and perceived social support.
Table 4. Self-esteem and depression as mediators among the relationship between suicide attempts and perceived social support.
MediatorEffectORp-Value% Mediated
Self-esteemTotal0.9850.03045.2
Direct0.9920.239
Indirect0.9930.000
DepressionTotal0.9850.02933.5
Direct0.9900.148
Indirect0.9950.000
All mediatorsTotal0.9840.02555.3 = 31.1 (SES)
(Self-esteemDirect0.9930.323+24.2 (SDS)
+ Depression)Indirect0.9910.000
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Deng, Y.; Li, X.; Liu, L.; Chui, W.H. Suicide Attempts and Perceived Social Support among Chinese Drug Users: The Mediating Role of Self-Esteem and Depression. Int. J. Environ. Res. Public Health 2021, 18, 208. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18010208

AMA Style

Deng Y, Li X, Liu L, Chui WH. Suicide Attempts and Perceived Social Support among Chinese Drug Users: The Mediating Role of Self-Esteem and Depression. International Journal of Environmental Research and Public Health. 2021; 18(1):208. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18010208

Chicago/Turabian Style

Deng, Yali, Xuemeng Li, Liu Liu, and Wing Hong Chui. 2021. "Suicide Attempts and Perceived Social Support among Chinese Drug Users: The Mediating Role of Self-Esteem and Depression" International Journal of Environmental Research and Public Health 18, no. 1: 208. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph18010208

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop