Next Article in Journal
Age-Related Differences in Anxiety and Depression Diagnosis among Adults in Puerto Rico during the COVID-19 Pandemic
Next Article in Special Issue
New Caregiver Diagnoses of Severe Depression and Child Asthma Controller Medication Adherence
Previous Article in Journal
Pediatric Behavioral Health during the COVID-19 Pandemic: Expert Advice for Preparedness, Response, and Recovery
Previous Article in Special Issue
Remote Implementation of a School-Based Health Promotion and Health Coaching Program in Low-Income Urban and Rural Sites: Program Impact during the COVID-19 Pandemic
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Leveraging the Expertise of the Community: A Case for Expansion of a Peer Workforce in Child, Adolescent, and Family Mental Health

1
Department of Psychiatry, Georgetown University Medical Center, Washington, DC 20007, USA
2
MedStar Georgetown University Hospital, Washington, DC 20007, USA
3
Milken Institute School of Public Health, George Washington University, Washington, DC 20052, USA
4
Children’s National Hospital, Washington, DC 20001, USA
5
Department of Pediatrics, Georgetown University Medical Center, Washington, DC 20007, USA
*
Authors to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(11), 5921; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph20115921
Submission received: 11 March 2023 / Revised: 2 May 2023 / Accepted: 19 May 2023 / Published: 23 May 2023

Abstract

:
The rise in child and adolescent mental health concerns has led to the need for an expanded workforce to meet the needs of our nation’s families. Peer paraprofessionals (PPs) have proven to be impactful in the areas of adult mental health (MH) and substance use disorders, and for persons with chronic medical conditions. PPs can contribute to addressing child, adolescent, and family MH needs by being deployed in community settings and providing both emotional and tangible support to families and children. Additional use of PPs can address equity gaps in MH services by improving access to support and enhancing the cultural acceptability of MH interventions. A concentrated effort to expand and develop this workforce may help to alleviate the strain on the current MH system. The Georgetown University Infant and Early Childhood Certificate program is a paraprofessional training program that prepares community members to meet the MH needs of families with young children. The authors will describe the results of a qualitative study examining the landscape of peer paraprofessional services in DC that was conducted to support the expansion of the peer workforce to include individuals with expertise in infant and early childhood mental health.

1. Introduction

The last decade has seen a well-documented, much-discussed, and still-growing crisis in child and adolescent mental health in the United States [1,2]. Rates of depression, anxiety, loneliness, disruptive behavior problems, and suicide have increased dramatically in young people [3]. These concerning developments preceded the global pandemic and have continued to worsen since 2020 [2,4]. Important demographic shifts in the prevalence of mental health problems in children and adolescents have also emerged, with notable acceleration in rates of depression and suicidal ideation in adolescent girls, as well as marked increases in rates of completed suicide in pre-pubertal children, boys, and Black-identifying youth [2]. These trends have prompted calls for action, including changes in healthcare payment and policy, enhancement of school-based services, development of effective interventions for underserved populations, and strategies to grow the professional mental health workforce [1].
As researchers, policymakers, and clinicians have sought to understand and respond to this ongoing crisis, several issues in pediatric mental health research have emerged as relevant factors to consider. First, disparities in mental health by multiple demographic factors, including race, ethnicity, language, income, gender and sexual identity, and geography, are shaping clinical outcomes for children and adolescents [2]. Racial and ethnic minorities, LGBTQI+(Lesbian, Gay, Bisexual, Transgender, Queer/Questioning, Intersex+) youth, the poor, and rural populations have profoundly inadequate access to effective, evidence-based mental health care [2,5]. Additionally, many interventions with evidence of clinical efficacy were developed and tested with predominantly white populations and very few of these have been adapted with cultural or linguistic specificity for distinct populations. Only a small number of mental health interventions are developed by or with the community they intend to serve and very few leverage culturally specific strengths or protective factors. Importantly, racially marginalized and underserved populations have significantly increased rates of exposure to adversity and trauma, and abundant evidence strongly connects these exposures to childhood-onset mental health problems [2,6]. Finally, there is increasing recognition that family factors, including parental mental illness, parenting skills, and social support for parents, impact the mental health of children and adolescents [7].
While it is critical to address the factors that contribute to the youth mental health crisis, population-level improvements in mental health will not be achieved until the field also addresses the substantial gaps in the mental health workforce. Estimates are that 30,000 child and adolescent psychiatrists are required to meet clinical demand in the United States, while fewer than 7000 are in active practice [8]. Similar shortfalls exist in the fields of clinical psychology, clinical social work, and counseling. Explanations for these gaps include inadequate training opportunities, arduous training regimens, stigma attached to working in mental health fields, and inadequate reimbursement [9].
One strategy with significant potential to expand the pediatric mental health workforce is the training and deployment of community members to provide a range of mental health supports. Such training does not include enrollment in multi-year programs from traditional degree-granting professional schools and universities but instead focuses on briefer vocational instruction. Students in these programs, who have relevant lived experience and cultural familiarity with the population intended to be served, can be considered “peers” to the community members to whom they will provide support. A variety of terms have been used to describe this workforce but for the purposes of the current paper, we will use the term peer paraprofessionals (PPs).
Training PPs to provide support and deliver mental health interventions is a promising strategy for several key reasons. First, this approach is cost-effective, as the educational and training requirements for these roles tend to be significantly smaller than those for degreed clinicians. In addition, research suggests that peer-delivered interventions are effective for addressing a range of physical and mental health conditions. Finally, there is growing research to suggest that within mental health care specifically, there may be unique benefits to PPs providing services [10]. We will argue that within historically divested communities, employing and effectively deploying PPs has the potential to advance equity across both health and economic domains, as this approach may provide effective mental health support to community members while also creating jobs paying reasonable wages and providing entry into the health services workforce. In the context of increasing interest in expanding intervention strategies for child, adolescent, and family mental health care, as well as the ongoing lack of supply of trained clinicians to meet growing demand, the potential contributions of PPs deserves exploration. The goal of this paper is to provide a summary of the research regarding the effectiveness of PPs, to describe our efforts to develop a paraprofessional training program that prepares PPs to meet the mental health needs of families with young children, and to describe the results of a qualitative study examining the current landscape of peer paraprofessional services for families with young children in District of Columbia (DC).

2. Effectiveness of Peer Paraprofessional Support

The following sections provide descriptive examples of how PPs have been deployed to address both physical health and mental health and an overview of research regarding the feasibility, acceptability, and effectiveness of these approaches with a particular focus on paraprofessionals who are peers to the individuals they serve.

2.1. Adult Physical Health

In health care settings, community health workers (CHWs) are paraprofessionals tasked with providing essential support to individuals living with chronic medical conditions such as HIV/AIDS, diabetes, and chronic kidney disease. These individuals are often part of a patient’s clinical team, working in conjunction with other providers to support management plans and to address contributing lifestyle factors and social determinants of health (SDOH) [11]. Typical CHW roles include chronic disease management and prevention, health education, care coordination, connection to services, social support, community outreach, health promotion, and advocacy. CHWs provide a bridge between health care systems and the community and are deployed within the broader health workforce to improve health outcomes by enhancing quality of care, access to care, health literacy, cultural competency, and attention to SDOH. Through these mechanisms, CHWs can contribute to reducing health disparities, stigma, and health care costs.
According to the American Public Health Association (APHA), a CHW is a “… frontline public health worker who is a trusted member of and/or has an unusually close understanding of the community served” [12]. Having a shared cultural and community background with patients can support management plan adherence and overcome environmental barriers to lifestyle change [13]. This definition highlights the complicated nature of defining the “peer” component of peer support. Membership in a specific geographic, cultural, racial, ethnic, or linguistic community may be one characteristic of a peer. Another definition is shared lived experience with a specific health condition. For example, within HIV/AIDS health services, HIV positive individuals are often recruited to support medication adherence, deliver education, and provide linkage to community resources and emotional support to other HIV positive individuals [14]. In this example, peer status is achieved through shared personal experiences with the health condition and the healthcare system. Thus, CHWs are considered “peers” based upon shared lived experiences based upon cultural, racial, ethnic, linguistic, and/or geographic commonalities with their clients, and they sometimes share lived experiences based upon common health conditions.
A growing body of research suggests that CHWs contribute to improved outcomes for individuals diagnosed with chronic medical conditions. Research on individuals diagnosed with diabetes has found increased knowledge in patients who receive care from CHWs [15]. In a systematic review of CHW effectiveness for the management of diabetes that included eight randomized clinical trials, many studies found a decrease in inappropriate healthcare utilization with the inclusion of CHWs on healthcare teams [15]. Several studies indicate the benefits of CHW-delivered supports on biomarkers as well as psychosocial markers associated with Type One and Type Two diabetes management, with “peer” status defined as having personal experience receiving diabetes care [11,13]. There is research to suggest peer CHW-delivered support for those with chronic kidney disease empowers patients and supports communication between patients and medical staff [16]. In one study of families whose child was diagnosed with asthma, healthcare teams that included CHWs reduced hospitalizations and emergency room visits by over 50% [17]. In addition to providing support, the use of CHWs reduces costs within the healthcare system, especially for low-income or underserved populations [18].

2.2. Adult Mental Health

Peer support has also been a vital element of mental and behavioral health care, particularly in the deployment of Peer Support Workers (PSWs) focused on supporting adults with chronic mental illnesses and substance use disorders. In this context, the “peer” status of PSWs is established based upon the paraprofessionals’ own experiences with recovery from a mental health or substance use disorder [19]. Thus, significant overlap exists between CHWs in the realm of physical health conditions and PSWs in the realm of mental health conditions. PSWs in mental health care have been referred to by a range of other terms including peer specialists, peer recovery coaches, peer advocates, and peer recovery support specialists.
Within these roles, individuals act as educators and advocates, promote autonomy and empowerment, and serve as knowledgeable partners who are able to link clients to community support and resources [20]. PSWs also support the development of life skills, communication, and general social functioning [21,22]. For adults with mental health conditions, peer support has been shown to be moderately effective at improving health outcomes and reducing healthcare costs [23,24,25,26]. The supportive role of PSWs compared to the directive role of clinicians has been found to support increased engagement in treatment and life satisfaction [21,27,28]. The well-known role of sponsors within 12-step programs for addiction recovery are often classified as peer support due to the shared lived experience that defines the role [29]. Numerous studies have demonstrated that having a sponsor is associated with increased likelihood of successful abstinence [29,30,31,32,33].

2.3. Child and Adolescent Physical Health

While peer support is increasingly available in health systems to address chronic physical and mental health conditions in adults, these services are less common to support pediatric health conditions. For families with children with special healthcare needs, peer support is typically delivered to caregivers by peers with lived experience caring for children with similar health concerns or developmental challenges (e.g., developmental disabilities). This form of support is also known as family peer support or family support services. Family peer support is a vital resource to parents navigating the clinical, social, and emotional support systems available to support children with physical needs and developmental challenges [34]. This form of support can take different forms based on specific needs and circumstances. The most common delivery forms are one-on-one family support or group participation led by a trained family peer support worker [35,36].
In one feasibility study that involved reviewing medical records of patient encounters, family peer support integrated within the medical team for parents of children with special healthcare needs has been shown to enhance the care team’s ability to provide both tangible and emotional support for families [34]. In several studies, including one randomized control trial with Black and Hispanic caregivers of children with autism spectrum disorder, increases in parental knowledge growth and confidence, as well as decreased feelings of isolation and stigmatization, were observed following engagement with family peer support programs [35,37]. Qualitative research suggests that emotional support and improved feelings of resiliency from family peer support services improve caregiver reports of family quality of life and parent–child relationships [38].

2.4. Child and Adolescent Mental Health

There is emerging interest in exploring the roles that PPs can play in enhancing pediatric mental health care services through peer support directed toward children and adolescents as well as through peer support to parents and caregivers. Research is growing on the importance of family-focused approaches to address child and adolescent mental health needs [7,39]. Parent mental health and child mental health have bidirectional effects, with challenges for each member of the family contributing to emotional strain for other family members. Parenting a child with mental health concerns is stressful, and the parental/caregiver burden is a substantial contributor to caregivers seeking clinical services [40]. Additionally, addressing parent mental health needs and building parenting skills benefits children. While these opportunities to address family-based mental health factors are recognized, the shortage of mental health professionals, particularly acute in underserved communities, continues to limit access to clinical care. Furthermore, clinical care that is available may be lacking in cultural humility and compatibility, limiting its effectiveness and acceptability for the communities being served. In the context of these convergent factors, there is growing interest in the roles of PPs in providing targeted interventions, including through parent-to-parent peer support as well as peer mentorship to children and adolescents. Parent peers provide social support, parenting guidance, and practical assistance in navigating child-serving systems focused on mental health, education, juvenile justice, child welfare, and substance use treatment [41].

2.4.1. Parent-to-Parent Peer Paraprofessional Support

A crucial and often overlooked contributor to child and adolescent mental health problems is untreated mental health problems in parents and caregivers [7]. Parent mental health difficulties contribute to child and adolescent mental health difficulties through a range of mechanisms including modeling and impaired parenting skills. Addressing symptoms in parents can have an important positive effect on offspring mental health [42]. Peer-delivered interventions offer a novel and promising strategy to address this challenge. Trained peers can help parents to identify their own mental health problems, offer psychoeducation and social support, encourage help-seeking, and reduce barriers to accessing care. Peer support provides empathetic support in addition to expressions of concern and instrumental assistance [43]. Peers can also provide scaffolding for adherence to prescribed clinical interventions by encouraging compliance with treatment and helping parents to practice behavioral strategies. Narrative reviews of peer support programs for parental mental health have found the benefits of peer support in supporting coping needs and desires for social connection and understanding from those who have experienced the mental health challenges that can accompany parenthood [43].
PPs also provide support to parents and caregivers in social situations that can challenge effective parenting. For example, peer support programs for non-resident fathers show improvements in co-parenting relationships and increased time spent with their children as a result [44]. Similarly, a program facilitating parenting skills for incarcerated mothers utilized peer support as a way for mothers in the group to provide mutual support for one another [45]. Despite preliminary evidence that supports the value of peers and community health workers to promote resilient family functioning, there are limited peer-reviewed studies in the literature.
Parent-focused and dyadic interventions that enhance parents’ capacities to support young children’s acquisition of self-regulatory, social, and cognitive skills are effective strategies for improving early childhood mental health [39]. Use of positive parenting strategies is associated with improved parent–child relationships, improved self-regulatory skills, and reduced disruptive behaviors in young children [46,47]. Positive parenting skills programs have been identified as deliverable by different interventionists, including clinicians and paraprofessionals [48,49]. Attachment-focused interventions are a second promising practice in this domain and have been developed for high-risk families who have experienced significant trauma or adversity [50,51,52]. Emerging research suggests that these interventions can be delivered by non-clinicians with appropriate training and support [53].

2.4.2. Child and Adolescent Peer Paraprofessional Support

Middle childhood and adolescence are developmental stages in which children and youth build important relationships with adults outside of their family and also begin to prioritize relationships with peers [54]. Mentorship is a well-established approach to leveraging these relationships to effectively support academic success, promote healthy social and emotional development, and mitigate risk for youth [55]. Youth mentor, community mentor, health mentor, and therapeutic mentor are all examples of terms that can be used to describe an individual who provides guidance, support, encouragement, attention, and care to someone in need over an extended period of time [56]. This individual often has experience and cultural knowledge relevant to the mentee and is able to build a trusting relationship based on social, community, or school-based networks [57].
Capitalizing on the knowledge, lived experience, and cultural affinity of trained mentors offers opportunities to enhance culturally congruent and accessible mental health support [58,59,60]. For young people with mental health challenges, support from trained mentors can be an important resource for social support, modeling of positive behaviors, and scaffolding to practice skills to enhance social and emotional functioning. As such, mentors can be considered part of the peer paraprofessional workforce, provided that they receive specialized training to work with youth with mental health concerns. These trainings help mentors to develop skills including reducing stigma around seeking clinical support, connecting mentees to appropriate clinical services, and helping mentees practice mental health skills in real life outside of clinical settings.
Therapeutic mentorship is a specific paraprofessional care model with evidence of medium-to-large effect size [61]. Therapeutic mentors are trained in an array of basic therapeutic skills and work closely with licensed clinicians and the child’s family to practice emotional and behavioral skills relevant to the child’s mental health difficulties [62]. A recent publication provides a very helpful framework for integrating peer paraprofessional mentorship into the landscape of mental health services [60].
Near-age or cross-age peers are another potential addition to the peer paraprofessional workforce for supporting child and adolescent mental health [60]. A recent meta-analysis found that cross-age peer mentorship has a medium-sized overall effect on positive outcomes for youth and was particularly effective in programs in which peer mentors had strong oversight and supervision from adults [63]. Research suggests that receiving mental health support from peers is acceptable and effective for adolescents [57,64]. Improved social emotional functioning and decreased family conflict is also reported by adolescents who receive peer support mental health services [65]. Mentors who receive specific training that focuses on helping youth to develop relevant social, emotional, and cognitive skills can have a significantly positive effect on youth mental health [55,66]. Participation in mentorship programs may be more acceptable and accessible for many families who have low rates of participation in clinical mental health treatment for children and adolescents [67].
An additional role for trained mentors may be found in their deployment to augment digital mental health interventions (DHMI). DHMI are increasingly prevalent and are a promising strategy to address gaps in mental health care. A recent meta-review suggests that trained mentors may be specifically helpful in increasing the effectiveness of DHMI by providing “human support” to increase the uptake and practice of emotional and behavioral skills introduced through these digital tools [68].

3. The Promise of Peer Paraprofessionals for Promoting Mental Health Equity

Despite the high prevalence of mental health problems in pediatric populations and the development of effective interventions, utilization of and engagement with services remain low, with 80% of children in need of services not receiving them [69]. Rates of service access are even lower among African American and Latino families, likely due to underdiagnosis in many cases [69,70]. For some groups, such as African Americans, research suggests common usage of informal support for mental health, although research is mixed on whether these forms of support are used in lieu of or in tandem with professional mental health care [71]. Similarly, stigma related to mental health prevents individuals from seeking mental health services and research suggests that minority racial and ethnic groups are more likely to experience mental health stigma than their white counterparts [72,73]. Beyond the cultural factors and stigma that may lead individuals to prefer informal support, many people from marginalized groups have a historically-grounded mistrust of the medical system, with ongoing systemic racism further preventing access for those who seek treatment [74,75]. Even when families initiate mental health treatment, barriers to accessing basic social service needs, including lack of transportation and housing insecurity, are likely to affect mental health service utilization for low income and underserved families [76].
Incorporating PPs into family mental health services is a promising strategy to facilitate access and retention because peers are uniquely suited to enhance intervention acceptability and to address common barriers by establishing trusting relationships with families and connecting them to appropriate resources. The scope of services offered by PPs is great and includes the promotion of positive attitudes and beliefs through psychoeducation and emotional support (e.g., empowering families, stigma reduction, reducing families’ sense of isolation and self-blame), motivation enhancement through motivational interviewing techniques (e.g., empathic listening, enhancing parent self-efficacy), and addressing environmental obstacles through instrumental support (e.g., coordination of care, assistance with resources such as respite and transportation) [77,78,79]. Peer support interventions have been effective across racial/ethnic groups and health diagnoses (see [80,81,82] for examples). For groups such as refugees and immigrants who are likely to face financial, insurance, or language barriers to receiving care, peer support has been demonstrated to be culturally acceptable and to facilitate mental wellness [83,84]. The alignment of their personal background, race/ethnicity, and lived experience with that of their client’s helps peer workers to combat commonly faced barriers to mental health care for underserved families.
The use of PPs as members of the mental health service workforce may hold additional promise in addressing mental health inequities because the services that they provide are potentially easier to scale and of lower-cost compared to treatment by a licensed mental health professional. Considerations for the scalability of an intervention include its effectiveness across target groups, resources required by the workforce or organizations, acceptability of the intervention, and its compatibility with already existing programs, as well as several other factors [85]. Peer support can function as a standalone intervention and can also be integrated within existing programs to supplement professional mental health care [86]. Several family-focused interventions have documented the positive effects of peer-delivered interventions, although additional evaluation is needed [87]. Peer support can be used as a health promotion or prevention strategy in the context of a continuum of care so that families with emergent or subclinical needs are supported without needing to navigate clinical services, allowing those with greater technical skill to serve families with the highest clinical needs. When peer support is used this way, it can alleviate strain on the current mental health system.
For many individuals living with mental health conditions or facing other challenges, peer support is identified as a desired method of receiving care and support [88]. Peer support offers a recovery-focused approach that is possible due to the relationship formed between a peer worker and their client, eliminating some of the barriers that exist in the medical professional–patient dynamic [89]. The nature of the peer support–client relationship allows for increased nuance in the support workers’ understanding of the client’s challenges and needs [21,27,28]. In this way, peer support allows for the dimensionality that exists in each individual’s unique experience of mental illness that moves beyond traditional diagnosis-driven treatment approaches that may not be as effective for improving mental health outcomes [90]. Peer-delivered interventions can be tailored for specific population groups, and evidence suggests that these approaches may be more acceptable in cultural contexts in which clinical mental health care may be less desirable based upon stigma and other cultural–historical factors [21,27,28].
PP-delivered services for child, adolescent, and family mental health show promise based upon evidence from other PSW and CHW interventions in other populations, and also based upon the potential for these interventions to bridge gaps that tend to exacerbate disparities in mental health care. How can this promise be translated into additional action? The purpose of the two sections that follow is to (a) summarize existing efforts to train, deploy, and sustain PP workforces; (b) describe a new training initiative that specifically focuses on preparing PP to support infant, early childhood, and family mental health through peer-delivered support; and (c) to present new research findings from a landscape analysis in the District of Columbia that reviews current PP services available to support families.

4. Developing a Peer Paraprofessional Workforce

4.1. Training the Workforce

In order to gain the competencies necessary to provide high quality and effective services as a PP, individuals need training and experience that build their competencies across a wide array of domains. Education and training requirements for PSWs and CHWs vary across states and organizations. Although many states have adopted the APHA’s definition of a CHW and the National Association of Community Health Workers recently developed a Six Pillars of Community Health Workers definition of this role, there are currently no nationally recognized standards for CHW education or certification. Many states have professional networks and associations that provide membership and training opportunities to CHWs. The National Council for Mental Wellbeing offers behavioral health training for CHWs to help teach the necessary expertise to provide community-level behavioral health support. The training is a one-day in-person group training designed to provide CHWs with the skills and expertise needed to support people with physical and behavioral health disorders [91].
Healthy Start, a national program sponsored by the Health Resources and Services Administration (HRSA) within the Department of Health and Human Services focuses on promoting maternal and child health and reducing disproportionate rates of infant mortality across racial/ethnic groups. Given the extensive use of CHWs in their program, Healthy Start developed and published a set of core competencies for the CHWs delivering that program [92]. In addition to competence in the Healthy Start program and perinatal health, CHWs delivering the program are expected to exhibit competence in several areas related to their role including outreach, participant screening and community assessment, health education, care coordination, patient empowerment, and community engagement. Foundational competencies for Healthy Start CHWs are defined as effective communication, cultural competence, mediation, and public health.
The National Association of Peer Supporters (NAPS) is one organization that specifically develops training and credentialing standards and certification exams for PSWs. This allows organizations to utilize this credentialing service within their peer support role specifications and requirements. For instance, the Veterans Health Administration and Medicaid reimbursement for peer support services requires state peer support workers to pass the NAPS exam as a condition of hire [24]. According to a landscape report conducted by the Behavioral Health Workforce Research Center in 2019, every state besides South Dakota and Vermont offered at least one statewide peer support credential in adult mental and behavioral health, to total 65 different credential entities across the entire country. Many states allow these credentials to be transferred if a PSW moves across state lines and wants to continue their work.
The Substance Abuse and Mental Health Services Administration (SAMHSA) has a major influence on training and promoting PSWs within behavioral health settings. It develops training materials and resources for PSWs in mental health and substance recovery organizations. SAMHSA defines twelve core competencies for PSWs in Behavioral Health Services [18]. Several states offer content-specific training depending on the interest and placement of PSWs in their service systems. Many utilize the PSW training curriculum from Appalachian Consulting Group for mental health peer workers, which consists of 24 one-hour training sessions covering topics such as ethics, problem solving, and PSW wellbeing [93].
Most states also require some sort of lived experience with a behavioral health disorder to qualify for the role of PSW [94]. PSWs focused on family and child mental health may not need direct experience with the behavioral health system to be eligible for training and credentialing as a PSW. Instead, lived experience as a parent or caregiver may be more valuable and relevant. Typically, lived and practical experience are more significant credentials for PSWs than academic training. A PSW credential does not often require more than a GED or high school diploma but does often require at least 50 h of specialized training, 500 practice hours, and 25–50 supervisory hours, depending on the state [95]. A key consideration in PSW training and health system integration is also ensuring the curriculum and job duties allow for the maintenance of PSW wellbeing and self-care [96,97].
While there is much overlap in CHW and PSW skills and training, the PSW training requires lived experience, making it distinctly unique from CHW training. Additionally, the training modules for certification for CHWs are often longer than that of PSWs. Despite these differences, CHWs and PSWs addressing mental health share a common goal: bettering the mental health of at-risk populations through tailored and culturally competent approaches. In this respect, the two would benefit from interdisciplinary work, building off each other’s skills and experiences and ultimately strengthening the workforce.

4.2. Sustaining the Workforce

Despite the many social and economic benefits of PSWs, many states have failed to establish a sustainable PP workforce and are therefore underutilizing the potential of this service [98]. Barriers to integration of PSWs into the healthcare system include lack of formal financing to sustain the workforce, stigma from the current healthcare workforce, and policies that limit PSW’s creativity and flexibility in the services they are providing [99,100]. Policymakers that have successfully integrated PPs into the healthcare system ensure that training, credentialing, and financing structures for these workers are equivalent to the economic value that they bring.
Sustainable financing is one of the most important aspects of integrating PPs into a statewide healthcare infrastructure. As of 2019, 39 states included PSWs in their Medicaid billing schedules [94]. While there is no statistically significant correlation between Medicaid funding and availability of PSWs, a stable payment structure such as this promotes work–life balance and reduced burnout which contribute to a more sustainable workforce [96]. As of 2019, 33 states had credentialing for parent and or youth peer support that could be billed through Medicaid, though the specific definition of that credentialing and the billing code for peer support varied by state [101]. This report documents that most of these states utilize their state Medicaid plan as the funding authority, but some use other means of fundings including grants and institutional funds.
Of the many approaches states have taken to integrate PSWs into their healthcare system, the most effective policies have reduced stigma, ensured financial stability, and allowed for a standardized but flexible training curriculum. States hoping to expand and sustain their PSW workforce should ensure that PSWs are provided with the tools and resources to do their job and should enforce policies that promote the dignity and respect for the importance of peer support in mental health treatment settings.

4.3. Family Leadership Track of the Georgetown IECMH Certificate Program

The Early Childhood Innovation Network (ECIN) at Georgetown University (GU) has developed an innovative training program for PPs through the Family Leadership Track of its Infant and Early Childhood Mental Health (IECMH) Certificate Program. The Family Leadership Track (FLT) builds off of the core competencies established in the PSW and CHW literature to provide an opportunity for caregivers to develop the core competencies of a CHW with knowledge specialization in infant, early childhood, and family mental health and learn to harness the power of their lived experiences to support other caregivers. The IECMH certificate program prepares participants to work in their own communities to promote resilience in families by connecting parents, children, and caregivers to resources and fostering family strengths with high quality practices in IECMH prevention, promotion, and support. The certificate is offered through the Georgetown University School of Continuing Studies (GU SCS) which has an extensive history of providing a variety of professional certificates across education, health, and policy. Recruitment efforts were supported through posting on the GU SCS website. Additionally, the developers of the FLT leveraged ECIN’s collaboration with the Georgetown University Center for Child and Human Development (GUCCHD). For more than four decades, the GUCCHD has been recognized as a national, regional, and local leader in the field of child development. GUCCHD houses and leads several national centers that are focused on supporting the development of Early Childhood Education systems and the concomitant workforce. Similarly, ECIN’s extensive collaboration with local community organizations provided a gateway for attracting participants.
The FLT is unique because it is the only certificate program at GU SCS that focuses on increasing educational and workforce development opportunities for first-generation students who have a GED or high school diploma. Beyond first-generation students, the educational space is blended with educators, family engagement specialists, social workers, and infrastructure builders from diverse professional settings. The course is grounded in a commitment to health equity and social justice. It is designed to increase the competence of individuals historically impacted by structural racism who live in medically underserved and economically underdeveloped communities and to build and diversify the mental health workforce. The program prioritizes the recruitment of historically marginalized caregivers of young children as participants. The definition of “lived experience” for these participants is broader than how it is typically defined in peer support programs that focus on mental health or substance use recovery. The first cohort of certificate participants were recruited in 2021. There were 21 applicants for the program and 14 enrolled in the course. All fourteen students completed all requirements of the certificate program and graduated from the program. The majority of students in the program were African American. A little more than a quarter had a High School Diploma or GED, a third had a Bachelor’s Degree, two students had a Master’s Degree, and a few were currently enrolled in a degree program. More than half of the students reported having some type of specialty training or professional certification. Of these students, the majority had prior peer or family support training. However, of the students with prior training, very few reported that they had received any prior training in mental health.

Next Steps in the FLT of the IECMH Certificate Program

In response to feedback from the participants in cohort one, the course was updated in year two to include a focus on all CHW competencies and an apprenticeship opportunity. The current course is offered virtually, organized into 10 consecutive months of modules that focus on PP and IECMH competencies, and involves both synchronous and asynchronous learning. Over the ten months of the program, coursework is divided into twelve modules which focus on public health principles, the social determinants of health, personal wellness, attachment and social-emotional wellbeing of young children, motivational interviewing, basics of care coordination and system navigation, trauma, community asset building, advocacy, case documentation, and foundations of adult learning. Beyond the modules, the certificate program incorporates a 200-h competency-based practicum, weekly one-on-one professional success coaching, weekly facilitated group peer support sessions and mindfulness classes, monthly one-on-one wellbeing mentorship with a clinical psychologist that includes development and implementation of personal wellbeing plans, and professional training (e.g., resume creation, interview skills, and career navigation supports). Students enrolled in the program experiencing underemployment have the opportunity to participate in apprenticeships in healthcare, early childhood education, and community-based settings, and are paid stipends as apprentices.

5. Current Study: The Landscape of Peer Paraprofessionals for Families with Young Children in DC

In order to further refine the FLT of the IECMH Certificate Program and understand how to maximize its successful dissemination, members of ECIN’s research and policy teams designed a qualitative study of the peer support services available to families with young children in DC. Our approach was to conduct semi-structured interviews with a convenience sample of agency and organization leaders that serve families with young children.

5.1. Methods

Eighteen semi-structured interviews were conducted with 19 leaders from 11 organizations serving families with young children in Washington, DC. Participating organizations represented the health sector, early childhood education, mental health, and community-based organizations. Leaders represented 18 programs across these organizations. We use the term program to refer to a defined team of individuals who serve a defined group of recipients. Interviews ranged in duration from 20 min to 1 h and 29 min and lasted an average of 38 min. Interviews were conducted and recorded via Zoom and were professionally transcribed. Participants received a USD 75 gift card for completing the interview. Transcripts were managed and coded using Dedoose (SocioCultural Research Consultants, LLC, Los Angeles, CA, USA), a mixed methods research software program [102]. The research team reviewed the transcripts, noted themes, and came together to discuss the development of the codebook. After the initial codebook was developed, two interviews were coded by two separate members of the research team and the team of four coders came together to review discrepancies and reach consensus. After the initial round of coding and discussion, the codebook was revised and finalized. The remaining 16 transcripts were fully coded by one coder and 20% of each transcript was coded by a second person. The double coded excerpts were reviewed and discussed by all four coders to reach agreement. The Institutional Review Board at the lead author’s home institution determined this study to be exempt.

5.2. Qualitative Results

Table 1 provides a comprehensive overview of key themes present in the analysis of the interviews and selected quotes to illustrate each theme.
Type of Support Provided. The programs discussed during the interviews provided peer paraprofessional support services to a variety of people. All programs included in the analysis provided services to families with young children, but not all programs were developed specifically for this population. Conversations with participants revealed that family support workers often provide a broad range of support services for their clients. The supports described by program leaders included, but were not limited to, conducting outreach and recruitment, encouraging client engagement, providing information on available resources, making referrals, and assisting with system navigation, running educational or support groups, and empowering caregivers to advocate for themselves and their children. Some participants discussed the level of variation in the role of a peer professional as a challenge within the field.
Characteristics of the Workforce. The titles that programs use to describe the individuals on staff who provide support to families varied by program. Of those discussed, seven included the word “family”, five included the words “support worker”, four included the word “peer”, and three included the word “specialist”. The majority of positions were full-time, benefit-eligible positions. However, some positions were part-time or paid hourly as needed. Although opinions regarding the necessity of a degree varied, participants consistently described the value of lived experience for facilitating connections between the peer paraprofessional and the family.
Training and Supervision. Although few respondents mentioned requiring specific training or certification of applicants for these positions, nearly all participants in the study with active peer support programs mentioned providing several ongoing training opportunities for the peer support workers after they were hired onto the program. Training opportunities included things such as motivational interviewing, setting boundaries, resource navigation, Mental Health First Aid, and protective factors training.
Organizational Challenges. Participants discussed several challenges faced by their organizations when incorporating peer paraprofessionals into their programming including capacity for recruitment and supervision, sustainable funding mechanisms, and retention.
System Level Infrastructure. Participants were specifically asked to think about professional or governmental support that would contribute to the development of the PP workforce. The establishment of professional standards emerged as a theme during our coding. Participants emphasized that PPs should be viewed as a professional role and suggested that local government or professional agency standards could contribute to affirming the professional role of peers. Establishing evidence for PPs was discussed as one way to contribute to the legitimacy of the role.

6. Discussion and Next Steps for Peer Paraprofessional Models for Child, Adolescent, and Family Mental Health

Growing evidence demonstrates the effectiveness of peer support for improving outcomes across a range of physical and mental health concerns, including family mental health. Expanding the PP workforce to specialize in child, adolescent, and family mental health has the potential to address increasing demands on an already strained healthcare system. While the extant literature provides preliminary evidence that peer support can address family mental health concerns and be integrated with professional mental health services, additional research is needed to identify the core components of effective peer support for families, the mechanisms driving its effectiveness, and how to implement it in service systems to maximize its benefits for children, adolescents, and the adults that care for them.
Our literature review suggested that the educational and training requirements for PPs varied across states and organizations and whether the provider was considered a CHW or a PSW. PSWs have nationally recognized training, credentialing standards, and certification exams in most states, whereas certificate programs at the state level are typically used to provide training and field experience in public health to CHWs. The Family Leadership Track of our GU IECMH Certificate Program has evolved over the past year to become a training for community mental health workers (CHWs) who promote infant, early childhood, and family mental health.
The qualitative study presented in this paper was conducted so that we could better understand the availability of peer paraprofessional support for families with young children in the District of Columbia, which would allow us to further refine the certificate program and understand how to disseminate it in the city. Our findings were consistent with the broader research literature in terms of documenting that PPs working in our community provide a broad range of support services for their clients including access to resources, system navigation, fostering engagement in program, intervention delivery, and empowering caregivers to advocate for themselves and their children. One of the most consistent findings was the perceived value of PPs by the participants, and while organizations varied in the extent to which they required their PPs to have specific experiences to be eligible for this role, most agreed that “lived experience” facilitated a connection between PPs and the individuals they serve. However, many cautioned that attempts to standardize this concept must allow for appropriate variation in its definition and application.
Respondents in our study did not require any training or certification for the PPs yet several participants indicated that there is a need for this type of workforce development program in DC. In the context of our Certificate Program, we have learned that the cost of peer paraprofessional training programs can hinder students from enrolling and impact whether they can participate for the duration of a program. Providing funding for students to attend a training program such as the one created at GU SCS increases the educational and workforce opportunities for individuals with lived experience to leverage their experiences on behalf of others. We are confident that this certificate program will prepare them for successful peer-led positions within the communities they serve and realize that we will need to make program leaders in DC aware of what graduates of FLT have to offer. We intend to use the next several years to document the effects of PPs on family mental health outcomes and advocate for sustainable funding to support this work locally. We also hope to facilitate a network of family-focused PPs to continue to learn from those who deliver and receive peer support.

Limitations

There were limitations to our study that should be acknowledged. Interviews highlighted in this analysis may not be representative of all family-serving organizations in the city. Although there are countless family-serving organizations within the Washington, DC Metro area, only nineteen were available to participate due to time and resource constraints surrounding the study interview process. Second, the study was a limited convenience sample of agency and organization leaders in the Washington, DC area; therefore, it may not be generalizable outside of DC. Despite these limitations, our interviews were a rich source of information that will be useful for developing additional research to better understand PP services in DC and other cities across the country.

7. Conclusions and Future Directions

One challenge to expanding research is the fact that many PP programs are developed within community organizations where evidence-informed practice may be more feasible than evidence-based practice [103,104]. Evidence-informed practice is often more flexible and able to adjust to the unique and dynamic needs of specific populations [105]. An important next step for the literature on PP programs includes increasing the dissemination of evidence-informed programs that are benefiting diverse groups and are easily scalable so that these models have the potential to inform what is being evaluated and considered for large-scale dissemination. Many PP innovations that improve access to quality mental health care are being implemented and evaluated outside of the peer-reviewed literature. Without continuing to consider data from a variety of sources, and without developing research–practice partnerships that value co-creation, it is likely that we are missing invaluable insights.
Early childhood is a period of foundational development heavily dependent on the caregiving environment, making it an age that may particularly benefit from peer support services for the family. However, including middle-childhood through adolescence in paraprofessional mental health certificate programs is a future direction that should be emphasized in the field for its potential to support improved mental health outcomes across the course of life. Expanded training opportunities for therapeutic mentorship and other PP models that directly support children and adolescents will accelerate the dissemination of this effective mental health strategy. Untreated mental health conditions result in significant costs to society through a range of direct and indirect economic impacts, and most mental health conditions begin in childhood and implicate the health of entire families [106]. PP models are very promising approaches to enhancing the responsiveness, reach, and cost effectiveness of systems seeking to address these challenges.

Author Contributions

Conceptualization, M.G.B., H.A.R. and C.E.D.; methodology, H.A.R., C.E.D. and L.C.; analysis, H.A.R., L.C., K.R.H., S.S. and C.M.S.; writing—original draft preparation, M.G.B., H.A.R., C.E.D., K.R.H., L.C., E.S.C., S.S., N.B. and C.M.S.; writing—review and editing, H.A.R., C.E.D., M.G.B., K.R.H., D.C.-S., A.G. and E.E.C.; funding acquisition, M.G.B. and C.E.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Perigee Fund, DC Department of Health (FO-CHA-PG-00002-000), and the J. Willard and Alice S. Marriott Foundation.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board of Georgetown University (STUDY00005173, 17 August 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are unavailable due to privacy restrictions.

Acknowledgments

The authors would like to acknowledge the students in the certificate program for their participation in this study.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Office of the Surgeon General. Protecting Youth Mental Health; SAGE Publications Ltd.: Thousand Oaks, CA, USA, 2022; Volume 137.
  2. Centers for Disease Control and Prevention. YRBS Data Summary & Trends; Centers for Disease Control and Prevention: Atlanta, GA, USA, 2023.
  3. American Academy of Pediatrics; American Academy of Child and Adolescent Psychiatry; Children’s Hospital Association. AAP-AACAP-CHA Declaration of a National Emergency in Child and Adolescent Mental Health 2022; American Academy of Pediatrics: Itasca, IL, USA, 2021. [Google Scholar]
  4. Centers for Disease Control and Prevention New CDC Data Illuminate Youth Mental Health Threats during the COVID-19 Pandemic. Available online: https://www.cdc.gov/media/releases/2022/p0331-youth-mental-health-covid-19.html (accessed on 9 March 2023).
  5. American Psychiatric Association. Mental Health Disparities: Diverse Populations. Available online: https://www.psychiatry.org/psychiatrists/diversity/education/mental-health-facts (accessed on 9 March 2023).
  6. Alegria, M.; Green, J.G.; McLaughlin, K.A.; Loder, S. Disparities in Child and Adolescent Mental Health and Mental Health Services in the US; William T. Grant Foundation: New York, NY, USA, 2015. [Google Scholar]
  7. Biel, M.G.; Tang, M.H.; Zuckerman, B. Pediatric Mental Health Care Must Be Family Mental Health Care. JAMA Pediatr. 2020, 174, 519–520. [Google Scholar] [CrossRef] [PubMed]
  8. AACAP Workforce Issues Committee. Workforce Issues. Available online: https://www.aacap.org/aacap/Resources_for_Primary_Care/Workforce_Issues.aspx (accessed on 1 May 2023).
  9. Covino, N.A. Developing the Behavioral Health Workforce: Lessons from the States. Adm. Policy Ment. Health 2019, 46, 689–695. [Google Scholar] [CrossRef] [PubMed]
  10. Kepley, H.O.; Streeter, R.A. Closing Behavioral Health Workforce Gaps: A HRSA Program Expanding Direct Mental Health Service Access in Underserved Areas. Am. J. Prev. Med. 2018, 54, S190–S191. [Google Scholar] [CrossRef] [PubMed]
  11. Warshaw, H.; Hodgson, L.; Heyman, M.; Oser, T.K.; Walker, H.R.; Deroze, P.; Rinker, J.; Litchman, M.L. The Role and Value of Ongoing and Peer Support in Diabetes Care and Education. Diabetes Educ. 2019, 45, 569–579. [Google Scholar] [CrossRef] [PubMed]
  12. American Public Health Association (APHA). Community Health Workers. Available online: https://www.apha.org/apha-communities/member-sections/community-health-workers (accessed on 8 February 2023).
  13. Dale, J.R.; Williams, S.M.; Bowyer, V. What Is the Effect of Peer Support on Diabetes Outcomes in Adults? A Systematic Review. Diabet. Med. 2012, 29, 1361–1377. [Google Scholar] [CrossRef]
  14. Cabral, H.J.; Davis-Plourde, K.; Sarango, M.; Fox, J.; Palmisano, J.; Rajabiun, S. Peer Support and the HIV Continuum of Care: Results from a Multi-Site Randomized Clinical Trial in Three Urban Clinics in the United States. AIDS Behav. 2018, 22, 2627–2639. [Google Scholar] [CrossRef]
  15. Norris, S.L.; Chowdhury, F.M.; Van Le, K.; Horsley, T.; Brownstein, J.N.; Zhang, X.; Jack, L.; Satterfield, D.W. Effectiveness of Community Health Workers in the Care of Persons with Diabetes. Diabet. Med. 2006, 23, 544–556. [Google Scholar] [CrossRef]
  16. National Kidney Foundation of Michigan. Peer Mentoring. Available online: https://nkfm.org/program-article/peer-mentoring/ (accessed on 9 March 2023).
  17. Peretz, P.J.; Matiz, L.A.; Findley, S.; Lizardo, M.; Evans, D.; McCord, M. Community Health Workers as Drivers of a Successful Community-Based Disease Management Initiative. Am. J. Public Health 2012, 102, 1443. [Google Scholar] [CrossRef]
  18. Kim, K.; Choi, J.S.; Choi, E.; Nieman, C.L.; Joo, J.H.; Lin, F.R.; Gitlin, L.N.; Han, H.R. Effects of Community-Based Health Worker Interventions to Improve Chronic Disease Management and Care among Vulnerable Populations: A Systematic Review. Am. J. Public Health 2016, 106, e3–e28. [Google Scholar] [CrossRef]
  19. Substance Abuse and Mental Health Services Administration. Peer Support Workers for Those in Recovery. Available online: https://www.samhsa.gov/brss-tacs/recovery-support-tools/peers (accessed on 9 March 2023).
  20. Jacobson, N.; Trojanowski, L.; Dewa, C.S. What Do Peer Support Workers Do? A Job Description. BMC Health Serv. Res. 2012, 12, 205. [Google Scholar] [CrossRef]
  21. Mahlke, C.I.; Krämer, U.M.; Becker, T.; Bock, T. Peer Support in Mental Health Services. Curr. Opin. Psychiatry 2014, 27, 276–281. [Google Scholar] [CrossRef] [PubMed]
  22. Walker, G.; Bryant, W. Peer Support in Adult Mental Health Services: A Metasynthesis of Qualitative Findings. Psychiatr. Rehabil. J. 2013, 36, 28–34. [Google Scholar] [CrossRef] [PubMed]
  23. Bologna, M.J.; Pulice, R.T. Evaluation of a Peer-Run Hospital Diversion Program: A Descriptive Study. Am. J. Psychiatr. Rehabil. 2011, 14, 272–286. [Google Scholar] [CrossRef]
  24. Chinman, M.; George, P.; Dougherty, R.H.; Daniels, A.S.; Ghose, S.S.; Swift, A.; Delphin-Rittmon, M.E. Peer Support Services for Individuals With Serious Mental Illnesses: Assessing the Evidence. Psychiatr. Serv. 2014, 65, 429–441. [Google Scholar] [CrossRef] [PubMed]
  25. Cook, J.A.; Copeland, M.E.; Corey, L.; Buffington, E.; Jonikas, J.A.; Curtis, L.C.; Grey, D.D.; Nichols, W.H. Developing the Evidence Base for Peer-Led Services: Changes among Participants Following Wellness Recovery Action Planning (WRAP) Education in Two Statewide Initiatives. Psychiatr. Rehabil. J. 2010, 34, 113–120. [Google Scholar] [CrossRef] [PubMed]
  26. Trachtenberg, M.; Parsonage, M.; Shepherd, G.; Boardman, J. Peer Support in Mental Health: Is It Good Value for Money? Centre for Mental Health: London, UK, 2013. [Google Scholar]
  27. Bellamy, C.; Schmutte, T.; Davidson, L. An Update on the Growing Evidence Base for Peer Support. Ment. Health Social. Incl. 2017, 21, 161–167. [Google Scholar] [CrossRef]
  28. Druss, B.G.; Zhao, L.; von Esenwein, S.A.; Bona, J.R.; Fricks, L.; Jenkins-Tucker, S.; Sterling, E.; DiClemente, R.; Lorig, K. The Health and Recovery Peer (HARP) Program: A Peer-Led Intervention to Improve Medical Self-Management for Persons with Serious Mental Illness. Schizophr. Res. 2010, 118, 264. [Google Scholar] [CrossRef]
  29. Bassuk, E.L.; Hanson, J.; Greene, R.N.; Richard, M.; Laudet, A. Peer-Delivered Recovery Support Services for Addictions in the United States: A Systematic Review. J. Subst. Abus. Treat. 2016, 63, 1–9. [Google Scholar] [CrossRef]
  30. Caldwell, P.E.; Cutter, H.S.G. Alcoholics Anonymous Affiliation During Early Recovery. J. Subst. Abus. Treat. 1998, 15, 221–228. [Google Scholar] [CrossRef]
  31. Crape, B.L.; Latkin, C.A.; Laris, A.S.; Knowlton, A.R. The Effects of Sponsorship in 12-Step Treatment of Injection Drug Users. Drug Alcohol Depend. 2002, 65, 291–301. [Google Scholar] [CrossRef]
  32. Sheeren, M. The Relationship between Relapse and Involvement in Alcoholics Anonymous. J. Study Alcohol. Drugs 2015, 49, 104–106. [Google Scholar] [CrossRef] [PubMed]
  33. Morgenstern, J.; Blanchard, K.A.; Mcveigh, K.H.; Riordan, A.; McCrady, B.S. Intensive Case Management Improves Substance Abuse and Employment Outcomes of Female Welfare Recipients: Preliminary Findings; ASPE: Washington, DC, USA, 2002. [Google Scholar]
  34. Pollock, M.D.; Ming, D.; Chung, R.J.; Maslow, G. Parent-to-Parent Peer Support for Children and Youth with Special Health Care Needs: Preliminary Evaluation of a Family Partner Program in a Healthcare System. J. Pediatr. Nurs. 2022, 66, 6–14. [Google Scholar] [CrossRef] [PubMed]
  35. Jamison, J.M.; Fourie, E.; Siper, P.M.; Trelles, M.P.; George-Jones, J.; Buxbaum Grice, A.; Krata, J.; Holl, E.; Shaoul, J.; Hernandez, B.; et al. Examining the Efficacy of a Family Peer Advocate Model for Black and Hispanic Caregivers of Children with Autism Spectrum Disorder. J. Autism Dev. Disord. 2017, 47, 1314–1322. [Google Scholar] [CrossRef] [PubMed]
  36. Schippke, J.; Provvidenza, C.; Kingsnorth, S. Peer Support for Families of Children with Complex Needs: Development and Dissemination of a Best Practice Toolkit. Child Care Health Dev. 2017, 43, 823–830. [Google Scholar] [CrossRef]
  37. Feinberg, E.; Abufhele, M.; Sandler, J.; Augustyn, M.; Cabral, H.; Chen, N.; Diaz Linhart, Y.; Cesar Levesque, Z.; Aebi, M.; Silverstein, M. Reducing Disparities in Timely Autism Diagnosis Through Family Navigation: Results From a Randomized Pilot Trial. Psychiatr. Serv. 2016, 67, 912–915. [Google Scholar] [CrossRef]
  38. Dew, A.; Collings, S.; Dowse, L.; Meltzer, A.; Smith, L. ‘I Don’t Feel like I’m in This on My Own’: Peer Support for Mothers of Children with Intellectual Disability and Challenging Behaviour. J. Intellect. Disabil. 2019, 23, 344–358. [Google Scholar] [CrossRef]
  39. Buka, S.L.; Beers, L.S.; Biel, M.G.; Counts, N.Z.; Hudziak, J.; Parade, S.H.; Paris, R.; Seifer, R.; Drury, S.S. The Family Is the Patient: Promoting Early Childhood Mental Health in Pediatric Care. Pediatrics 2022, 149, 2021053509. [Google Scholar] [CrossRef]
  40. Angold, A.; Costello, E.J.; Worthman, C.M. Puberty and Depression: The Roles of Age, Pubertal Status and Pubertal Timing. Psychol. Med. 1998, 28, 51–61. [Google Scholar] [CrossRef]
  41. SAMHSA. Peers Supporting Recovery from Mental Health Conditions; SAMHSA: Rockville, MD, USA, 2017.
  42. Weissman, M.M.; Wickramaratne, P.; Nomura, Y.; Warner, V.; Verdeli, H.; Pilowsky, D.J.; Grillon, C.; Bruder, G. Families at High and Low Risk for Depression: A 3-Generation Study. Arch. Gen. Psychiatry 2005, 62, 29–36. [Google Scholar] [CrossRef]
  43. Leger, J.; Letourneau, N. New Mothers and Postpartum Depression: A Narrative Review of Peer Support Intervention Studies. Health Soc. Care Community 2015, 23, 337–348. [Google Scholar] [CrossRef]
  44. Mchale, J.; Waller, M.R.; Pearson, J. Coparenting Interventions for Fragile Families: What Do We Know and Where Do We Need to Go Next? Fam. Process. 2012, 51, 284–306. [Google Scholar] [CrossRef] [PubMed]
  45. Loper, A.B.; Tuerk, E.H. Parenting Programs for Incarcerated Parents: Current Research and Future Directions. Crim. Justice Policy Rev. 2006, 17, 407–427. [Google Scholar] [CrossRef]
  46. Collins, W.A.; Maccoby, E.E.; Steinberg, L.; Hetherington, E.M.; Bornstein, M.H. Contemporary Research on Parenting: The Case for Nature and Nurture. Am. Psychol. 2000, 55, 218–232. [Google Scholar] [CrossRef] [PubMed]
  47. Pinquart, M. Associations of Parenting Dimensions and Styles with Externalizing Problems of Children and Adolescents: An Updated Meta-Analysis. Dev. Psychol. 2017, 53, 873–932. [Google Scholar] [CrossRef] [PubMed]
  48. Maxwell, A.M.; McMahon, C.; Huber, A.; Reay, R.E.; Hawkins, E.; Barnett, B. Examining the Effectiveness of Circle of Security Parenting (COS-P): A Multi-Site Non-Randomized Study with Waitlist Control. J. Child. Fam. Stud. 2021, 30, 1123–1140. [Google Scholar] [CrossRef]
  49. The National Child Traumatic Stress Network. Strengthening Family Coping Resources. Available online: https://www.nctsn.org/interventions/strengthening-family-coping-resources (accessed on 9 March 2023).
  50. Bernard, K.; Dozier, M.; Bick, J.; Lewis-Morrarty, E.; Lindhiem, O.; Carlson, E. Enhancing Attachment Organization Among Maltreated Children: Results of a Randomized Clinical Trial. Child. Dev. 2012, 83, 623–636. [Google Scholar] [CrossRef]
  51. Hagan, M.J.; Browne, D.T.; Sulik, M.; Ippen, C.G.; Bush, N.; Lieberman, A.F. Parent and Child Trauma Symptoms During Child–Parent Psychotherapy: A Prospective Cohort Study of Dyadic Change. J. Trauma. Stress. 2017, 30, 690–697. [Google Scholar] [CrossRef]
  52. Waters, S.F.; Hulette, A.; Davis, M.; Bernstein, R.; Lieberman, A. Evidence for Attachment Vitamins: A Trauma-Informed Universal Prevention Programme for Parents of Young Children. Early Child. Dev. Care 2018, 190, 1109–1114. [Google Scholar] [CrossRef]
  53. Hameed Shalaby, R.A.; Agyapong, V.I.O. Peer Support in Mental Health: Literature Review. JMIR Ment. Health 2020, 7, e15572. [Google Scholar] [CrossRef]
  54. Viner, R.M.; Ozer, E.M.; Denny, S.; Marmot, M.; Resnick, M.; Fatusi, A.; Currie, C. Adolescence and the Social Determinants of Health. Lancet 2012, 379, 1641–1652. [Google Scholar] [CrossRef]
  55. Raposa, E.B.; Rhodes, J.; Stams, G.J.J.M.; Card, N.; Burton, S.; Schwartz, S.; Sykes, L.A.Y.; Kanchewa, S.; Kupersmidt, J.; Hussain, S. The Effects of Youth Mentoring Programs: A Meta-Analysis of Outcome Studies. J. Youth Adolesc. 2019, 48, 423–443. [Google Scholar] [CrossRef] [PubMed]
  56. Karcher, M.J. The Effects of Developmental Mentoring and High School Mentors’ Attendance on Their Younger Mentees’ Self-Esteem, Social Skills, and Connectedness. Psychol. Sch. 2005, 42, 65–77. [Google Scholar] [CrossRef]
  57. Schwartz, S.E.O.; Lowe, S.R.; Rhodes, J.E. Mentoring Relationships and Adolescent Self-Esteem. Prev. Res. 2012, 19, 17. [Google Scholar] [PubMed]
  58. Gopalan, G.; Lee, S.J.; Harris, R.; Acri, M.C.; Munson, M.R. Utilization of Peers in Services for Youth with Emotional and Behavioral Challenges: A Scoping Review. J. Adolesc. 2017, 55, 88–115. [Google Scholar] [CrossRef] [PubMed]
  59. Gustafson, E.L.; Lakind, D.; Walden, A.L.; Rusch, D.; Atkins, M.S. Engaging Parents in Mental Health Services: A Qualitative Study of Community Health Workers’ Strategies in High Poverty Urban Communities. Adm. Policy Ment. Health Ment. Health Serv. Res. 2021, 48, 1019–1033. [Google Scholar] [CrossRef] [PubMed]
  60. McQuillin, S.D.; Hagler, M.A.; Werntz, A.; Rhodes, J.E. Paraprofessional Youth Mentoring: A Framework for Integrating Youth Mentoring with Helping Institutions and Professions. Am. J. Community Psychol. 2022, 69, 201–220. [Google Scholar] [CrossRef]
  61. Johnson, S.B.; Pryce, J.M. Therapeutic Mentoring: Reducing the Impact of Trauma for Foster Youth on JSTOR. Child Welf. 2013, 92, 9–26. [Google Scholar]
  62. Child & Family Services. Therapeutic Mentoring. Available online: https://child-familyservices.org/therapeutic-mentoring-service/ (accessed on 9 March 2023).
  63. Burton, S.; Raposa, E.B.; Poon, C.Y.S.; Stams, G.J.J.M.; Rhodes, J. Cross-Age Peer Mentoring for Youth: A Meta-Analysis. Am. J. Community Psychol. 2022, 70, 211–227. [Google Scholar] [CrossRef]
  64. Rhodes, J.E.; DuBois, D.L. Understanding and Facilitating the Youth Mentoring Movement. Soc. Policy Rep. 2006, 20, 1–20. [Google Scholar] [CrossRef]
  65. Radigan, M.; Wang, R.; Chen, Y.; Xiang, J. Youth and Caregiver Access to Peer Advocates and Satisfaction with Mental Health Services. Community Ment. Health J. 2014, 50, 915–921. [Google Scholar] [CrossRef]
  66. Kupersmidt, J.B.; Rhodes, J.E. Mentor Training. In Handbook of Youth Mentoring; DuBois, D.L., Karcher, M.J., Eds.; SAGE Publications Inc.: Thousand Oaks, CA, USA, 2013; pp. 439–456. ISBN 9781412996907. [Google Scholar]
  67. Rhodes, J.E. A Model of Youth Mentoring. In Handbook of Youth Mentoring; SAGE Publications, Inc.: Thousand Oaks, CA, USA, 2012; pp. 30–43. [Google Scholar]
  68. Werntz, A.; Amado, S.; Jasman, M.; Ervin, A.; Rhodes, J.E. Providing Human Support for the Use of Digital Mental Health Interventions: Systematic Meta-Review. J. Med. Internet Res. 2023, 25, e42864. [Google Scholar] [CrossRef] [PubMed]
  69. Kataoka, S.H.; Zhang, L.; Wells, K.B. Unmet Need for Mental Health Care among U.S. Children: Variation by Ethnicity and Insurance Status. Am. J. Psychiatry 2002, 159, 1548–1555. [Google Scholar] [CrossRef] [PubMed]
  70. Coker, T.R.; Elliott, M.N.; Toomey, S.L.; Schwebel, D.C.; Cuccaro, P.; Emery, S.T.; Davies, S.L.; Visser, S.N.; Schuster, M.A. Racial and Ethnic Disparities in ADHD Diagnosis and Treatment. Pediatrics 2016, 138, e20160407. [Google Scholar] [CrossRef] [PubMed]
  71. Woodward, A.T.; Taylor, R.J.; Bullard, K.M.K.; Neighbors, H.W.; Chatters, L.M.; Jackson, J.S. Use of Professional and Informal Support by African Americans and Caribbean Blacks with Mental Disorders. Psychiatr. Serv. 2008, 59, 1292–1298. [Google Scholar] [CrossRef]
  72. Fripp, J.A.; Carlson, R.G. Exploring the Influence of Attitude and Stigma on Participation of African American and Latino Populations in Mental Health Services. J. Multicult. Couns. Devel 2017, 45, 80–94. [Google Scholar] [CrossRef]
  73. Masuda, A.; Anderson, P.L.; Edmonds, J. Help-Seeking Attitudes, Mental Health Stigma, and Self-Concealment Among African American College Students. J. Black Stud. 2012, 43, 773–786. [Google Scholar] [CrossRef]
  74. Alang, S.M. Mental Health Care among Blacks in America: Confronting Racism and Constructing Solutions. Health Serv. Res. 2019, 54, 346–355. [Google Scholar] [CrossRef]
  75. Miranda, J.; McGuire, T.G.; Williams, D.R.; Wang, P. Mental Health in the Context of Health Disparities. Am. J. Psychiatry 2008, 165, 1102–1108. [Google Scholar] [CrossRef]
  76. Ofonedu, M.E.; Belcher, H.M.E.; Budhathoki, C.; Gross, D.A. Understanding Barriers to Initial Treatment Engagement among Underserved Families Seeking Mental Health Services. J. Child Fam. Stud. 2017, 26, 863–876. [Google Scholar] [CrossRef]
  77. Diaz-Linhart, Y.; Silverstein, M.; Grote, N.; Cadena, L.; Feinberg, E.; Ruth, B.J.; Cabral, H. Patient Navigation for Mothers with Depression Who Have Children in Head Start: A Pilot Study. Soc. Work Public Health 2016, 31, 504–510. [Google Scholar] [CrossRef]
  78. Cavaleri, M.A.; Olin, S.S.; Kim, A.; Hoagwood, K.E.; Burns, B.J. Family Support in Prevention Programs for Children at Risk for Emotional/Behavioral Problems. Clin. Child. Fam. Psychol. Rev. 2011, 14, 399–412. [Google Scholar] [CrossRef] [PubMed]
  79. Rodriguez, J.; Olin, S.S.; Hoagwood, K.E.; Shen, S.; Burton, G.; Radigan, M.; Jensen, P.S. The Development and Evaluation of a Parent Empowerment Program for Family Peer Advocates. J. Child Fam. Stud. 2011, 20, 397. [Google Scholar] [CrossRef] [PubMed]
  80. Hu, J.; Wang, X.; Guo, S.; Chen, F.; Wu, Y.; Ji, F.; Fang, X. Peer Support Interventions for Breast Cancer Patients: A Systematic Review. Breast Cancer Res. Treat 2019, 174, 325–341. [Google Scholar] [CrossRef]
  81. Matthias, M.S.; Mcguire, A.B.; Kukla, M.; Daggy, J.; Myers, L.J.; Bair, M.J. A Brief Peer Support Intervention for Veterans with Chronic Musculoskeletal Pain: A Pilot Study of Feasibility and Effectiveness. Pain Med. 2015, 16, 81–87. [Google Scholar] [CrossRef] [PubMed]
  82. Watkins, S.E.; McGowan, B.L. Black Men Doctoral Scientists and Engineers Persisting: Peer Support and Racism in Science and Engineering. J. Res. Sci. Teach. 2022, 59, 1853–1875. [Google Scholar] [CrossRef]
  83. Block, A.M.; Aizenman, L.; Saad, A.; Harrison, S.; Sloan, A.; Vecchio, S.; Wilson, V. Peer Support Groups: Evaluating a Culturally Grounded, Strengths-Based Approach for Work With Refugees. Adv. Soc. Work 2018, 18, 930–948. [Google Scholar] [CrossRef]
  84. Ho, K.H.M.; Yang, C.; Leung, A.K.Y.; Bressington, D.; Chien, W.T.; Cheng, Q.; Cheung, D.S.K. Peer Support and Mental Health of Migrant Domestic Workers: A Scoping Review. Int. J. Environ. Res. Public. Health 2022, 19, 7617. [Google Scholar] [CrossRef]
  85. Milat, A.J.; King, L.; Bauman, A.E.; Redman, S. The Concept of Scalability: Increasing the Scale and Potential Adoption of Health Promotion Interventions into Policy and Practice. Health Promot. Int. 2013, 28, 285–298. [Google Scholar] [CrossRef]
  86. Bryan, A.E.B.; Arkowitz, H. Meta-Analysis of the Effects of Peer-Administered Psychosocial Interventions on Symptoms of Depression. Am. J. Community Psychol. 2015, 55, 455–471. [Google Scholar] [CrossRef]
  87. Hoagwood, K.E.; Cavaleri, M.A.; Olin, S.S.; Burns, B.J.; Slaton, E.; Gruttadaro, D.; Hughes, R. Family Support in Children’s Mental Health: A Review and Synthesis. Clin. Child. Fam. Psychol. Rev. 2010, 13, 1–45. [Google Scholar] [CrossRef]
  88. Witt, R.E.; Malcolm, M.; Colvin, B.N.; Gill, M.R.; Ofori, J.; Roy, S.; Lenze, S.N.; Rogers, C.E.; Colson, E.R. Racism and Quality of Neonatal Intensive Care: Voices of Black Mothers. Pediatrics 2022, 150, e2022056971. [Google Scholar] [CrossRef] [PubMed]
  89. Mead, S.; Hilton, D.; Curtis, L. Peer Support: A Theoretical Perspective. Psychiatr. Rehabil. J. 2001, 25, 134–141. [Google Scholar] [CrossRef] [PubMed]
  90. Conway, C.C.; Krueger, R.F.; Cicero, D.C.; DeYoung, C.G.; Eaton, N.R.; Forbes, M.K.; Hallquist, M.N.; Kotov, R.; Latzman, R.D.; Ruggero, C.J.; et al. Rethinking the Diagnosis of Mental Disorders: Data-Driven Psychological Dimensions, Not Categories, as a Framework for Mental-Health Research, Treatment, and Training. Curr. Dir. Psychol. Sci. 2021, 30, 151–158. [Google Scholar] [CrossRef]
  91. National Council for Mental Wellbeing Community Health Worker. Available online: https://www.thenationalcouncil.org/service/community-health-worker/ (accessed on 9 March 2023).
  92. Healthy Start EPIC Center. Healthy Start Community Health Worker Definition and Core Competencies; Healthy Start EPIC Center: Boston, MA, USA, 2016. [Google Scholar]
  93. Gagne, C.A.; Finch, W.L.; Myrick, K.J.; Davis, L.M. Peer Workers in the Behavioral and Integrated Health Workforce: Opportunities and Future Directions. Am. J. Prev. Med. 2018, 54, S258–S266. [Google Scholar] [CrossRef] [PubMed]
  94. Videka, L.; Neale, J.; Page, C.; Buche, J.; Beck, A.J.; Wayment, C.; Gaiser, M. National Analysis of Peer Support Providers: Practice Settings, Requirements, Roles, and Reimbursement; University of Michigan: Ann Arbor, MI, USA, 2019. [Google Scholar]
  95. Beck, A.J.; Page, C.; Buche, J.; Rittman, D.; Gaiser, M. Scopes of Practice and Reimbursement Patterns of Addiction Counselors, Community Health Workers, and Peer Recovery Specialists in the Behavioral Health Workforce; University of Michigan: Ann Arbor, MI, USA, 2018. [Google Scholar]
  96. Abraham, K.M.; Erickson, P.S.; Sata, M.J.; Lewis, S.B. Job Satisfaction and Burnout among Peer Support Specialists: The Contributions of Supervisory Mentorship, Recovery-Oriented Workplaces, and Role Clarity. Adv. Ment. Health 2021, 20, 38–50. [Google Scholar] [CrossRef]
  97. Godfrey, K.M.; Kozar, B.; Morales, C.; Scott, S.D. The Well-Being of Peer Supporters in a Pandemic: A Mixed-Methods Study. Jt. Comm. J. Qual. Patient Saf. 2022, 48, 439–449. [Google Scholar] [CrossRef]
  98. Otte, I.; Werning, A.; Nossek, A.; Vollmann, J.; Juckel, G.; Gather, J. Beneficial Effects of Peer Support in Psychiatric Hospitals. A Critical Reflection on the Results of a Qualitative Interview and Focus Group Study. J. Ment. Health 2019, 29, 289–295. [Google Scholar] [CrossRef]
  99. Mirbahaeddin, E.; Chreim, S. A Narrative Review of Factors Influencing Peer Support Role Implementation in Mental Health Systems: Implications for Research, Policy and Practice. Adm. Policy Ment. Health Ment. Health Serv. Res. 2022, 49, 596–612. [Google Scholar] [CrossRef]
  100. Ibrahim, N.; Thompson, D.; Nixdorf, R.; Kalha, J.; Mpango, R.; Moran, G.; Mueller-Stierlin, A.; Ryan, G.; Mahlke, C.; Shamba, D.; et al. A Systematic Review of Influences on Implementation of Peer Support Work for Adults with Mental Health Problems. Soc. Psychiatry Psychiatr. Epidemiol. 2020, 55, 285–293. [Google Scholar] [CrossRef]
  101. Schober, M.; Baxter, K. Medicaid Funding for Family and Youth Peer Support Programs in the United States; SAMHSA & The TA Network: Rockville, MD, USA, 2020. [Google Scholar]
  102. Dedoose, version 9.0.17; SocioCultural Research Consultants, LLC: Los Angeles, CA, USA, 2021.
  103. Mulvale, G.; Wilson, F.; Jones, S.; Green, J.; Johansen, K.J.; Arnold, I.; Kates, N. Integrating Mental Health Peer Support in Clinical Settings: Lessons from Canada and Norway. Healthc. Manag. Forum 2019, 32, 68–72. [Google Scholar] [CrossRef]
  104. Nevo, I.; Slonim-Nevo, V. The Myth of Evidence-Based Practice: Towards Evidence-Informed Practice. Br. J. Soc. Work 2011, 41, 1176–1197. [Google Scholar] [CrossRef]
  105. Kumah, E.A.; McSherry, R.; Bettany-Saltikov, J.; Hamilton, S.; Hogg, J.; Whittaker, V.; van Schaik, P. PROTOCOL: Evidence-Informed Practice versus Evidence-Based Practice Educational Interventions for Improving Knowledge, Attitudes, Understanding, and Behavior toward the Application of Evidence into Practice: A Comprehensive Systematic Review of Undergraduate Students. Campbell Syst. Rev. 2019, 15, e1015. [Google Scholar] [CrossRef] [PubMed]
  106. Kessler, R.C.; Heeringa, S.; Lakoma, M.D.; Petukhova, M.; Rupp, A.E.; Schoenbaum, M.; Wang, P.S.; Zaslavsky, A.M. The Individual-Level and Societal-Level Effects of Mental Disorders on Earnings in the United States: Results from the National Comorbidity Survey Replication. Am. J. Psychiatry 2008, 165, 703. [Google Scholar] [CrossRef] [PubMed]
Table 1. Results of thematic analysis from semi-structured interviews.
Table 1. Results of thematic analysis from semi-structured interviews.
Overview of Current Family Support Programming in DC
Types of Support Provided
“... sitting down with [the client] and having the knowledge and the connections and the ability to navigate and just to be able to fill those gaps and then just starting at the top of that list [of needs] and moving down”.
“This idea that families are not cases, and so it’s not just about connecting poor people to programs that poor people need, like social work. There’s some element of developing and helping a family to cultivate its own agency”.
Characteristics of the Support Workforce
Education and Experience
“It’s really more of a community experience. It’s work experience in addition to the life experience. We do have those who are college educated, but some that do not have degrees”.
“I’mma be honest. In reference to having a degree, I say no. I just say the experience means more because if you’ve been in a situation and you know how it feels to be without, or you’re a single mom, and you just wanna show moms or dads or caregivers where to get resources from, you don’t have to have a degree. You just gotta have passion and you gotta wanna do this work”.
Characteristics of Programs Utilizing Support Workers
Organizational Challenges
“I think there’s a lot of non-billable time that’s a part of supporting that role, so it’s not just one person that we would hire. I think, in the past, what we’ve seen when we’ve incorporated peer support [workers] is that they also need a lot of support, so you need other people to be involved to make sure that they are getting the scaffolding they need in the role”.
“It’s not a position that, right now, you can bill for, so that makes it hard to be sustainable. I think funding is a big thing”.
System Level Infrastructure for the Support Workforce
Establishing Professional Standards
“If I were gonna launch a true peer navigator and not have a bachelor’s degree requirement and be pulling in people from a really diverse depth of professional experience or something. Some who may have done a lot professional work and some who maybe have done very little, but have this really great lived experience, then I would imagine that if the city could provide some kind of structured modules of these are the basics of peer support and confidentiality, and I don’t know. Just those types of things”.
Developing the Profession
“It may be helpful to have a peer-to-peer parity program… it’d be nice for all of them to get together and talk about the strengths, the challenges, and some of the struggles associated with it. I think that another area that will be very helpful is for them to process the trauma that is induced by the work. If I had experienced what you’re experiencing, then I can be triggered by supporting you. Some place that captures some of that and help them with managing that”.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Robertson, H.A.; Biel, M.G.; Hayes, K.R.; Snowden, S.; Curtis, L.; Charlot-Swilley, D.; Clauson, E.S.; Gavins, A.; Sisk, C.M.; Bravo, N.; et al. Leveraging the Expertise of the Community: A Case for Expansion of a Peer Workforce in Child, Adolescent, and Family Mental Health. Int. J. Environ. Res. Public Health 2023, 20, 5921. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph20115921

AMA Style

Robertson HA, Biel MG, Hayes KR, Snowden S, Curtis L, Charlot-Swilley D, Clauson ES, Gavins A, Sisk CM, Bravo N, et al. Leveraging the Expertise of the Community: A Case for Expansion of a Peer Workforce in Child, Adolescent, and Family Mental Health. International Journal of Environmental Research and Public Health. 2023; 20(11):5921. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph20115921

Chicago/Turabian Style

Robertson, Hillary A., Matthew G. Biel, Katherine R. Hayes, Sara Snowden, Latisha Curtis, Dominique Charlot-Swilley, Elyssa S. Clauson, Arrealia Gavins, Caslin M. Sisk, Noel Bravo, and et al. 2023. "Leveraging the Expertise of the Community: A Case for Expansion of a Peer Workforce in Child, Adolescent, and Family Mental Health" International Journal of Environmental Research and Public Health 20, no. 11: 5921. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph20115921

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop