Next Article in Journal
Attitudinal Spillover from Misleading Natural Cigarette Marketing: An Experiment Examining Current and Former Smokers’ Support for Tobacco Industry Regulation
Previous Article in Journal
Elemental Contamination in Indoor Floor Dust and Its Correlation with PAHs, Fungi, and Gram+/− Bacteria
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 16
Issue 19
10.3390/ijerph16193553
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Evidence of Workplace Interventions—A Systematic Review of Systematic Reviews

by
Claudia Pieper
*,
Sarah Schröer
and
Anna-Lisa Eilerts
Institute for Medical Informatics, Biometry and Epidemiology, University Hospital of Essen, 45147 Essen, Germany
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2019, 16(19), 3553; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16193553
Submission received: 31 July 2019 / Revised: 12 September 2019 / Accepted: 14 September 2019 / Published: 23 September 2019
(This article belongs to the Section Health Behavior, Chronic Disease and Health Promotion)
Browse Figure
Versions Notes

Abstract

:
Work environment factors are highly correlated with employees’ health and well-being. Our aim was to sum up current evidence of health promotion interventions in the workplace, focusing on interventions for the prevention of musculoskeletal disorders, psychological and behavioral disorders as well as interventions for older employees and economic evaluations. We conducted a comprehensive literature search including systematic reviews published from April 2012 to October 2017 in electronic databases and search engines, websites of relevant organizations and institutions. It consisted of simple and specific terms and word combinations related to workplace health promotion based on the search strategy of a previous review. After full-text screening, 74 references met the eligibility criteria. Using the same search strategy, there was a higher proportion of relevant high-quality studies as compared with the earlier review. The heterogeneity of health promotion interventions regarding intervention components, settings and study populations still limits the comparability of studies. Future studies should also address the societal and insurer perspective, including costs to the worker such as lost income and lost time at work of family members due to caregiving activities. To this end, more high-quality evidence is needed.

1. Introduction

Work can be a source of psychological distress and ill health [1]. Improving working conditions may promote physical and mental health by combining both the individual and organizational level. A number of reviews and single studies have addressed the efficacy and cost-effectiveness of well-designed worksite health promotion programs to improve the health of employees and save money for employers [2,3,4,5,6,7,8,9,10,11,12,13].
Work environment factors including shift work, work stress and work demands are highly correlated with employees’ health and well-being [14,15,16]. Work-related diseases cause lost working days, increase absenteeism and presentism, and reduce productivity.
Chronic diseases are among the most common and costly of all health problems worldwide. In Germany in 2016, 154 million days of incapacity to work due to musculoskeletal disorders led to a loss of 17.2 billion Euros in production costs and a loss of 30.4 billion Euros in gross value added. With 109.2 million days of incapacity to work, psychological and behavioral disorders rank in second place according to the calculations of the Bundesanstalt für Arbeitsschutz und Arbeitsmedizin (BAuA) for 2016. Psychological and behavioral disorders led to a loss in production costs of 12.2 billion Euros and a loss of gross value added of 21.5 billion Euros [17].
Promoting employees’ health therefore is of great importance for organizations as well as employees to maintain performance capability and productivity. However, does the current evidence of workplace health promotion and prevention encourage employers to provide their employees with preventive programs, training and tools that support healthy behaviors?
In 2014 our working group published a systematic review by order of the “Initiative Gesundheit und Arbeit (IGA)” that summarized the evidence of effectiveness of workplace health promotion and prevention, including publications from 2006 to 2012 [18,19]. Most reviews included studies of different intervention types focusing on physical activity, nutrition or weight management, alcohol dependence and tobacco use, as well as mental health and stress. Because of the heterogeneity of interventions, target groups and study designs, the overall evidence of effectiveness for the respective interventions was no more than moderate. Altogether, the findings emphasize the advantages of complex multi-component interventions. However, it could not be shown which approach leads to the best economic and health-related results for certain occupational groups.
To determine whether there are any new findings, we aimed to synthesize evidence on the (cost) effectiveness of different workplace interventions from recently published systematic reviews (2012–2017). Our current systematic review was designed to provide evidence-based answers on key questions related to common health problems in the workplace and to offer information on available evidence across occupational groups. Effectiveness was determined by regarding the intervention’s impact on health-related outcomes, work disability duration, quality of life and others as well as economic outcomes. Interventions were defined as planned intervention programs in companies.
Because of the impact of musculoskeletal disorders, psychological and behavioral disorders and the proportion of older employees in Germany [20,21,22,23,24], we focused on interventions for the prevention of musculoskeletal, psychological and behavioral disorders as well as interventions for older employees. Additionally, we involved economic evaluations.
Our main research questions were:
Which evidence-based recommendations can be derived,
  • for the prevention of musculoskeletal diseases;
  • for the prevention of mental disorders;
  • for the strengthening of older employees;
  • on the economic impact of workplace interventions?

2. Methods

2.1. Search Process

We conducted a comprehensive literature from October to December 2017 including systematic reviews published from April 2012 to October 2017 in five electronic databases and search engines (PubMed, Cochrane Library, London, UK, Scopus, Web of Science and PsycINFO). In addition, the websites of relevant organizations and institutions were screened (German Bundesanstalt für Arbeitsschutz und Arbeitsmedizin BAuA, Dortmund, Germany, Institut für Arbeitsschutz der Deutschen Gesetzlichen Unfallversicherung, Sankt Augustin, Germany, Campell Collaboration, Oslo, Norway, International Labour Organization, Geneva, Switzerland, Partnership for European Research in Occupational Safety and Health, British Occupational Research Foundation, EPPI-Centre, Centre for Reviews and Dissemination and The National Institute for Occupational Safety and Health). We conducted an advanced search in the archives of the following journals: European Journal of Public Health, Journal Health Promotion International, Journal of Public Health, Oxford Economic Papers, Journal of Occupational and Environmental Medicine, American Journal of Preventive Medicine, Journal of Safety, Health and Environmental Research and Journal Work, Aging and Retirement. Reference lists of all retrieved articles were checked for further relevant publications. We limited our scope to systematic reviews published in peer-reviewed journals to maximize the validity of the findings and to reduce bias. All included publications were formally rated as systematic review articles. However, methodological quality did not always meet the Cochrane Collaboration quality criteria for systematic reviews. The language had to be English or German. The systematic literature search consisted of simple and specific terms and word combinations related to workplace health promotion based on the search strategy of Pieper et al. (2015) [18]. Combinations of search terms were run in all five databases. We used the following search string to identify relevant articles:
musculoskeletal diseases OR musculoskeletal pain OR musculoskeletal system/injuries OR musculoskeletal system/pathology OR musculoskeletal system/physiopathology.
OR
diseases category/psychology OR burnout, professional OR depression OR depressive disorder OR depressive disorder, major OR mental disorders OR mental illness.
OR
older workers OR elder workers OR aged workers OR aged employees OR elderly employees OR aged worker OR mature workers OR aging workforce OR aging working population OR aging employees OR aging employee.
AND
occupational health OR worksite health OR health promotion OR health prevention OR organisational health OR organizational health OR industrial health OR health interventions.
AND
effect OR impact OR cost allocation OR cost OR cost effect OR cost effective OR cost effective benefits OR cost effective disease management OR return on investment OR health economics OR health economics research OR health research OR health impact OR qalys OR quality adjusted life years OR absenteeism OR presenteeism OR cost benefit analysis OR cost effectiveness OR effectiveness OR health benefit plans, employee OR health care evaluation mechanisms OR evaluation OR efficiency OR benefit OR advantage.

2.2. Eligibility Criteria

The assessment of references was carried out in two phases, based on eligibility criteria described hereafter. In the first phase, all authors checked the titles and abstracts of the search results and reviewed the abstracts to determine whether to obtain the identified articles for a full-text search. Reviews were included in full-text search if the reported workplace interventions addressed health- and/or work-related outcomes in the prevention of musculoskeletal disorders, mental illnesses or the strengthening of older employees. Interventions were to focus on either individual, organizational, or combined-level health promotion or prevention at work. The study population included male and female employees in different age groups.
In the second phase, included full texts were finally assessed according to the selection criteria in detail, as comprehensible description of intervention effects and assessment of evidence. We developed a synthesis of included reviews and extracted the results reported in the reviews. Main outcomes were mean effect sizes and evidence levels. Ethical approval was not required, as the study was designed as a secondary literature review without human subjects, medical records or human tissues being directly involved.

2.3. Data Extraction and Study Quality Appraisal

In order to examine the quality of the finally included reviews, we extracted data source, database, study population, evaluated outcomes, reported effects and methodological aspects. Two authors independently analyzed the reviews using the AMSTAR 2 checklist [25]. Data were extracted by one author and checked by a second author. Discrepancies were resolved by consensus or by consulting a third person. AMSTAR is a critical appraisal tool for systematic reviews of randomized studies whereas AMSTAR 2 accounts for both randomized studies and observational (non-randomized) studies. Rating is based on weaknesses in critical domains:
  • High—The systematic review provides an accurate and comprehensive summary of the results of the available studies that address the question of interest.
  • Moderate—The systematic review has more than one weakness, but no critical flaws. It may provide an accurate summary of the results of the available studies that were included in the review.
  • Low—The review has a critical flaw and may not provide an accurate and comprehensive summary of the available studies that address the question of interest.
  • Critically low—The review has more than one critical flaw and should not be relied on to provide an accurate and comprehensive summary of the available studies.

3. Results

3.1. Search Results

The original search identified 6472 references: PubMed n = 927, Scopus n = 291, Web of Science n = 1902, PsycINFO n = 566, Cochrane Library n = 1524, websites n = 1036 and topic-specific journals n = 226. Of these, 6331 references were rejected due to inappropriate outcome evaluation, inadequate study design or population. 141 reviews were included in the full-text screening. Finally, after full text screening, 74 references met the eligibility criteria. Figure 1 shows the results of the search process.
These 74 reviews originated from the USA, Canada, Australia, New Zealand, and Europe, including 1715 single studies. The study designs were heterogeneous, 546 reviews (32%) included randomized controlled trials. Study populations comprised occupational groups from different sectors, including both men and women in varying percentages.

3.2. Main Outcome Categories

We identified 38 reviews on the prevention and improvement of mental disorders. 23 reviews broached the issue of musculoskeletal disorders and four reviews reported interventions for older employees. Ten reviews reported economic outcomes of workplace interventions. Because one review refers to musculoskeletal disorders as well as to mental disorders, the total number of reviews is 74. Table 1 shows the distribution of reviews by quality rating and main outcome category. High and moderate-quality reviews were taken into account in the assessment of intervention efficacy. Low quality was due to the lack of information on interventions, confounders, dropout rates, and data analysis techniques.
Several systematic reviews of mental health and musculoskeletal disorders identified the same primary studies, depending on the search strategy, inclusion criteria and execution period. We will discuss in more detail below (see Section 4). Findings are presented according to quality of reviews and then according to interventions.

3.3. Mental Health

38 reviews on workplace interventions for the prevention and improvement of mental disorders were identified [2,4,6,7,12,13,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49,50,51,52,53,54,55,56]. In these reviews, 1191 individual studies evaluated the effectiveness of resilience training programs, mindfulness training, cognitive-behavioral therapy, relaxation techniques and organizational-level workplace interventions. The focus of interventions varied, but those targeting specific individuals were outnumbered. Participants were predominantly white-collar workers, teachers and health care providers.
Seven high-quality reviews and one moderate-quality review found intervention effects on well-being, burn-out-symptoms and employees’ performance. Mindfulness and cognitive-behavioral training as well as peer supervision appeared to help reduce stress. Additionally, organizational interventions including reduction of work impact and flexible work-time seemed to lower stress and burn-out-symptoms. Overall, multi-component programs were more effective than single-component interventions. No reviews derived general recommendations. Few reviews recommended special interventions or intervention components with caution [7,42,44,46,50,54,56]. The authors found cognitive-behavioral effective to reduce depression, anxiety, and burnout as well as to improve well-being.
One moderate-quality review evaluated evidence for physical training and yoga-interventions, in which especially Yoga was found to be especially effective in the prevention of stress and anxiety [40].
Two moderate-quality reviews reported effectiveness of web-based health promotion programs for the prevention of job-stress related mental disorders [47,48]. Carolan, Harris and Cavanagh made a clear recommendation for implementation [47].
Cognitive-behavioral theories provided the main rationale for intervention programs in fourteen reviews [2,7,13,26,28,37,38,42,43,47,48,49,53,57]. Eight reviews addressed the prevention of mental disorders including depression, stress, and mental health [7,37,42,47,48,49,53,57]. Positive effects were shown for cognitive-behavioral interventions [2,7,26,28,37,42,47,49,57] and web-based cognitive-behavioral interventions [48]. Cognitive-behavioral interventions were effective to reduce depression, anxiety and burnout as well as to improve well-being [13,33,36]. Nevertheless, cognitive-behavioral interventions were not always superior to comparative interventions [7,26,47]. Results rarely reached statistical significance.
Mindfulness trainings was assessed in twenty reviews that found it to have beneficial effects on mental health including stress, anxiety, depression and burnout as well as well-being [4,12,13,28,30,31,35,36,39,43,44,45,46,47,48,50,53,54,55,56]. Results did not always reach statistical significance. Twelve reviews included mindfulness-based stress reduction (MBSR) interventions; ten reviews evaluated abbreviated MBSR interventions. Both MBSR and abbreviated MBSR were shown to have positive effects [12,35].
One moderate-quality review evaluated evidence for physical training and yoga-interventions, in which yoga was found to be especially effective in the prevention of stress and anxiety [40].
Two moderate-quality reviews reported effectiveness of web-based health promotion programs for the prevention of job-stress related mental disorders [47,48]. Carolan, Harris and Cavanagh made a clear recommendation for implementation [47].

3.4. Musculoskeletal System

23 reviews on workplace interventions for the prevention and improvement of musculoskeletal disorders were identified [3,5,8,9,10,11,34,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73]. In these reviews, 407 individual studies were summarized, predominantly evaluating behavioral preventive interventions, such as training and education, exercise programs, and ergonomic interventions. The evaluated outcome parameters mainly referred to the upper musculoskeletal system, especially the back, neck and shoulders. In total, six reviews were rated as high-quality and eight reviews as moderate-quality.
One moderate-quality review found ergonomic interventions such as adjustable Sit to Stand Desks associated with reduction of neck or back pain [65], while two high-quality reviews did not [8,70]. Follow-up beyond a year was not conducted. Job rotation interventions resulted in opposing or no effects [63,69], while workplace strength training significantly reduced pain and prevented disorders in the upper musculoskeletal system, especially back, neck and shoulders [64].
Two low-quality reviews showed limited evidence for the effectiveness of physical activity programs.
An unrestricted recommendation cannot be made due to the heterogeneity of the studies included regarding investigated interventions, study populations and study designs. Overall, there was insufficient evidence to support the sustainability of reported effects beyond one year.

3.5. Older Employees

Four moderate-quality reviews on workplace interventions targeting the improvement and retention of older employees, were identified [74,75,76,77]. They summarized 40 individual studies. Included studies differed regarding age; some studies included employees aged 40 years or 45 years and older whereas other studies did not define age-related inclusion criteria. Poscia et al. (2016) and Steenstra et al. (2017 recommended the implantation of multi-component organizational intervention programs involving changes of work-environment, physical training and psychosocial support to promote older employees working capacity, health and well-being [76,77]. However, Poscia et al. (2016) showed that learning in older employees in workplace intervention trainings differs from that in younger employees. Therefore, a multimodal approach is the method of choice [76].

3.6. Economic Effects

Economic analyses considered the following types of outcomes in ten reviews (77 single studies): absenteeism, productivity, net benefit and return on invest (ROI), compensated healthcare costs, other healthcare costs and intervention costs [24,78,79,80,81,82,83,84,85,86]. Low evidence levels are reported in four high-quality reviews and two moderate-quality reviews [24,80,81,82,83,84]. Furlan et al. (2012) reported economically successful interventions for the management of depression in the workplace [24]. The interventions consisted of cognitive-behavioral therapy and integrated supply management, as well as organizational components. Due to the heterogeneity of primary studies, Furlan et al. could not draw a general conclusion regarding economic effectiveness of mental health programs.
Hamberg-van Reenen, Proper and van den Berg (2012) [85] found a positive ROI of 302% of after two years. Carolan, Harris and Cavanagh (2017) [47] showed that web-based interventions resulted in increased productivity. Despite the low evidence levels, the authors of these reviews conclude that the evaluated interventions have great potential to be cost effective.
Opposing effects are reported for interventions to prevent musculoskeletal disorders on absenteeism and productivity by White et al. (2016) [84]. The economic impact of ergonomic interventions for caregivers was limited due to the small evidence base.
Overall, evidence to support sustainability of economic findings beyond one year was generally limited.

4. Discussion

4.1. Limitations and Strengths

The reviews included heterogeneous types of interventions which, again, varied across the studies. Variations in settings and study populations also limit the comparability. Therefore, the derivation of general recommendations for specific interventions or occupational groups is not possible.
Furthermore, publication bias was not addressed. Publication bias means that studies reporting positive effects are more likely to be published.
Some reviews focusing on the topic of mental health and musculoskeletal disorders identified the same primary studies, depending on the search strategy, inclusion criteria and execution period. If several reviews retrieved the same studies and reached the same conclusions, we evaluated information given on reported outcomes and populations to avoid over- or underestimating the strength of the evidence.
We found some opposing effects, for example regarding the impact of mental health programs combined with ergonomic programs. These opposing effects were not necessarily due to qualitative differences in the study designs. The ratio of studies reporting no effect to studies reporting statistically significant effects was rather equally distributed across the high-quality rated reviews.
Although this systematic review is relevant within the German context, it also has international meaning, as it is based on international research.

4.2. Findings

Using the same search strategy and considering the main focus on the musculoskeletal system and mental health as well as older employees and economic evaluation, we found 74 references in a six-year period (2012–2017) compared with approximately 15 in an earlier period (2006–2012). There was a higher proportion of relevant high-quality studies as compared with the earlier review. No reference included reported negative effects as increased symptoms. However, job stress management training and workstation adjustment as single-component interventions had no effect on musculoskeletal outcomes. While we found evidence for the positive effect of multicomponent worksite programs, the findings are quite consistent with the earlier review and in agreement with other recent reviews that include workplace-based interventions [87,88,89].
Overall, there is not enough evidence from the scientific literature to recommend specific intervention or program. To this end, more high-quality evidence is needed. There was some consistency in the results, suggesting that workplace interventions such as exercising, trainings and educational programs and ergonomic desks and chairs can decrease pain and symptoms for employees who experience musculoskeletal disorders. However, the evidence is at best, moderate and current research still is limited. Our evidence synthesis provides support that workplace interventions can reduce absenteeism and associated costs. There was moderate evidence that cognitive-behavioral therapy, MBSR, and job stress management trainings, can significantly reduce stress; evidence for sustainability of these effects was insufficient or limited.
To date, guidance for practice to deal with the increasing numbers of older employees and work-related chronic conditions cannot be provided from systematic reviews.

4.3. General Recommendations and Practical Messages

The authors recommend that organizations continue to deliver workplace interventions to employees, since several interventions have been found to positively impact employees’ health. The findings indicate, that high quality implementation, including systematic evaluation and ongoing monitoring procedures lead to a higher efficacy. Special attention should be paid to the evaluation of interventions using appropriate designs to document the process and outcomes.
➢
Practitioners should consider implementing stretching exercise programs, vibration feedback on mouse use or workstation forearm supports in practices to prevent musculoskeletal disorders, if applicable to the work context.
➢
We recommend implementing workplace-based cognitive-behavioral and job-stress management programs to prevent and manage stress and mental disorders.
➢
Multi-component programs are to be preferred to single-component programs.
➢
When adopting interventions across diverse occupational groups and workplace settings, it is important to take into account both generic principles and to those principles that are specific to the given setting.
➢
A participative approach that engages employees, employers and management structures in communication and joint participation, appears to be an important success factor for the development and implementation of interventions for disease prevention and health promotion in the workplace.
➢
Prevention and health promotion interventions in the workplace often involve new approaches. Therefore, it can be necessary to make organizational changes.
➢
Still, this systematic review mainly identified individual focused interventions. Employers should significantly expand their programs on the organizational level.

5. Conclusions

The future development of workplace interventions needs to be based on sound knowledge and evidence. Therefore, appropriate evaluation frameworks and research methods capable of reflecting the complexity of the interventions have to be applied. This includes the evaluation of intermediary variables which refer to the implementation process and compliance aspects.
Economic analyses were conducted from a workplace perspective, as they primarily focused on wage replacement and healthcare costs. Future studies should address the societal and insurer perspective, including costs to the worker such as lost income, and lost time at work of family members due to caregiving activities. At the same time, additional structured activities focusing on epidemiology, surveillance and research can help to understand and improve employee health and derive recommendations for workplace health programs.

Author Contributions

C.P. and A.-L.E. conceived of the presented idea. C.P. supervised the project. A.-L.E. designed the search model and the computational framework and analyzed the data. S.S. supervised the work, aided in the analysis and in interpreting the results. All authors discussed the results and contributed to the final manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Quick, J.C.; Henderson, D.F. Occupational stress: Preventing suffering, enhancing wellbeing. Int. J. Environ. Res. Public Health 2016, 13, 459. [Google Scholar] [CrossRef]
  2. Bhui, K.S.; Dinos, S.; Stansfeld, S.A.; White, P.D. A synthesis of the evidence for managing stress at work: A review of the reviews reporting on anxiety, depression, and absenteeism. J. Environ. Public Health 2012, 1–21. [Google Scholar] [CrossRef]
  3. Goodman, G.; Kovach, L.; Fisher, A.; Elsesser, E.; Bobinski, D.; Hansen, J. Effective interventions for cumulative trauma disorders of the upper extremity in computer users: Practice models based on systematic review. Work 2012, 42, 153–172. [Google Scholar] [CrossRef]
  4. Regehr, C.; Glancy, D.; Pitts, A.; LeBlanc, V.R. Interventions to reduce the consequences of stress in physicians: A review and meta-analysis. J. Nerv. Ment. Dis. 2014, 202, 353–359. [Google Scholar] [CrossRef]
  5. Aslam, I.; Davis, S.A.; Feldman, S.R.; Martin, W.E. A review of patient lifting interventions to reduce health care worker injuries. Workplace Health Saf. 2015, 63, 267–275. [Google Scholar] [CrossRef]
  6. Naghieh, A.; Montgomery, P.; Bonell, C.P.; Thompson, M.; Aber, J.L. Organisational interventions for improving wellbeing and reducing work-related stress in teachers. Cochrane Database Syst. Rev. 2015, 4. [Google Scholar] [CrossRef]
  7. Ruotsalainen, J.H.; Verbeek, J.H.; Mariné, A.; Serra, C. Preventing occupational stress in healthcare workers. Cochrane Database Syst. Rev. 2015. [Google Scholar] [CrossRef]
  8. Tew, G.A.; Posso, M.C.; Arundel, C.E.; McDaid, C.M. Systematic review: Height-adjustable workstations to reduce sedentary behaviour in office-based workers. Occup. Med. 2015, 65, 357–366. [Google Scholar] [CrossRef]
  9. Moreira-Silva, I.; Teixeira, P.M.; Santos, R.; Abreu, S.; Moreira, C.; Mota, J. The effects of workplace physical activity programs on musculoskeletal pain: A systematic review and meta-analysis. Workplace Health Saf. 2016, 64, 210–222. [Google Scholar] [CrossRef]
  10. Freiberg, A.; Euler, U.; Girbig, M.; Nienhaus, A.; Freitag, S.; Seidler, A. Does the use of small aids during patient handling activities lead to a decreased occurrence of musculoskeletal complaints and diseases? A systematic review. Int. Arch. Occup. Environ. Health 2016, 89, 547–559. [Google Scholar] [CrossRef]
  11. Freiberg, A.; Girbig, M.; Euler, U.; Scharfe, J.; Nienhaus, A.; Freitag, S.; Seidler, A. Influence of the Kinaesthetics care conception during patient handling on the development of musculoskeletal complaints and diseases: A scoping review. J. Occup. Med. Toxicol. 2016, 11, 24. [Google Scholar] [CrossRef]
  12. Burton, A.; Burgess, C.; Dean, S.; Koutsopoulou, G.Z.; Hugh-Jones, S. How effective are mindfulness-based interventions for reducing stress among healthcare professionals? A systematic review and meta-analyse. Stress Health 2017, 33, 3–13. [Google Scholar] [CrossRef]
  13. Ryan, C.; Bergin, M.; Chalder, T.; Wells, J.S. Web-based interventions for the management of stress in the workplace: Focus, form, and efficacy. J. Occup. Health 2017, 59, 215–236. [Google Scholar] [CrossRef]
  14. Costa, G. Shift work and health: Current problems and preventive actions. Saf. Health Work 2010, 1, 112–123. [Google Scholar] [CrossRef]
  15. Theorell, T.; Hammarström, A.; Aronsson, G.; Träskman Bendz, L.T.; Grape, T.; Hogstedt, C.; Marteinsdottir, I.; Skoog, I.; Hall, C. A systematic review including meta-analysis of work environment and depressive symptoms. BMC Public Health 2015, 15, 738–752. [Google Scholar] [CrossRef]
  16. Bryson, A.; Forth, J.; Stokes, L. Does Worker Wellbeing Affect Workplace Performance? Department of Business Innovation and Skills: London, UK, 2014.
  17. Bundesanstalt für Arbeitsschutz und Arbeitsmedizin (BAuA). Volkswirtschaftliche Kosten durch Arbeitsunfähigkeit 2016; Bundesanstalt für Arbeitsschutz und Arbeitsmedizin (BAuA): Dortmund, Germany, 2018.
  18. Pieper, C.; Schröer, S.; Haupt, J.; Kramer, I. Wirksamkeit und Nutzen betrieblicher Gesundheitsförderung und Prävention. Zusammenstellung der wissenschaftlichen Evidenz 2006 bis 2012. In Wirksamkeit und Nutzen betrieblicher Prävention iga.Report 28; AOK-Bundesverband, BKK-Dachverband, e.V. Deutsche Gesetzliche Unfallversicherung, Verband der Ersatzkassen, e.V. Initiative Gesundheit und Arbeit: Berlin, Germany, 2015; ISBN 1612-1996. [Google Scholar]
  19. Schröer, S.; Haupt, J.; Pieper, C. Evidence-based lifestyle interventions in the workplace—An overview. Occup. Med. 2014, 64, 8–12. [Google Scholar] [CrossRef]
  20. Grobe, T.G.; Steinmann, S.; Gerr, J. (Eds.) Gesundheitsreport 2017. Schwerpunkt. Determinanten der psychischen und somatischen Gesundheit. 2017; Barmer: Berlin, Germany, 2017. [Google Scholar]
  21. Marschall, J.; Hildebrand, S.; Zich, K.; Tisch, T.; Sörensen, J.; Nolting, H.-D.; Burgart, E.; Woköck, T. (Eds.) DAK-Gesundheitsreport 2018; DAK Forschung: Hamburg, Germany, 2018. [Google Scholar]
  22. Statistisches Bundesamt. Bevölkerung, Erwerbstätige, Erwerbslose, Erwerbspersonen, Nichterwerbspersonen. Deutschland, Jahre, Altersgruppen, 1991–2018. Available online: https://www-genesis.destatis.de/genesis/online/link/tabelleErgebnis/12211-0002 (accessed on 29 August 2019).
  23. Grobe, T.; Steinmann, S.; Gerr, J. (Eds.) Gesundheitsreport 2018: Arbeitsunfähigkeiten; Techniker Krankenkasse: Hamburg, Germany, 2018. [Google Scholar]
  24. Furlan, A.D.; Gnam, W.H.; Carnide, N.; Irvin, E.; Amick, B.C.; DeRango, K.; McMaster, R.; Cullen, K.; Slack, T.; Brouwer, S.; et al. Systematic review of intervention practices for depression in the workplace. J. Occup. Rehabil. 2012, 22, 312–321. [Google Scholar] [CrossRef]
  25. Shea, B.J.; Reeves, B.C.; Wells, G.; Thuku, M.; Hamel, C.; Moran, J.; Moher, D.; Tugwell, P.; Welch, V.; Kristjansson, E.; et al. AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 2017, 358, j4008. [Google Scholar] [CrossRef]
  26. Maricuţoiu, L.P.; Sava, F.A.; Butta, O. The effectiveness of controlled interventions on employees’ burnout: A meta-analysis. J. Occup. Organ. Psychol. 2016, 89, 1–27. [Google Scholar] [CrossRef]
  27. Vanhove, A.J.; Herian, M.N.; Perez, A.L.U.; Harms, P.D.; Lester, P.B. Can resilience be developed at work? A meta-analytic review of resilience-building programme effectiveness. J. Occup. Organ. Psychol. 2016, 89, 278–307. [Google Scholar] [CrossRef]
  28. Lau, R.W.M.; Mak, W.H. Effectiveness of workplace interventions for depression in Asia: A meta-analysis. Sage Open 2017, 7, 2158244017710293. [Google Scholar] [CrossRef]
  29. Stewart, W.; Terry, L. Reducing burnout in nurses and care workers in secure settings. Nurs. Stand. 2014, 28, 37–45. [Google Scholar] [CrossRef]
  30. Nowrouzi, B.; Lightfoot, N.; Larivière, M.; Carter, L.; Rukholm, E.; Schinke, R.; Belanger-Gardner, D. Occupational stress management and burnout interventions in nursing and their implications for healthy work environments: A literature review. Workplace Health Saf. 2015, 63, 308–315. [Google Scholar] [CrossRef]
  31. Luken, M.; Sammons, A. Systematic review of mindfulness practice for reducing job burnout. Am. J. Occup. Ther. 2016, 70, 7002250020p1–7002250020p10. [Google Scholar] [CrossRef]
  32. de Jesus, S.N.; Miguel-Tobal, J.J.; Rus, C.L.; Viseu, J.; Gamboa, V. Evaluating the effectiveness of a stress management training on teachers and physicians’ stress related outcomes. Clínica y Salud 2014, 25, 111–115. [Google Scholar] [CrossRef]
  33. Meyers, M.C.; van Woerkom, M.; Bakker, A.B. The added value of the positive: A literature review of positive psychology interventions in organizations. Eur. J. Work Organ. Psychol. 2013, 22, 618–632. [Google Scholar] [CrossRef]
  34. Montano, D.; Hoven, H.; Siegrist, J. Effects of organisational-level interventions at work on employees’ health: A systematic review. BMC Public Health 2014, 14, 135. [Google Scholar] [CrossRef]
  35. Virgili, M. Mindfulness-based interventions reduce psychological distress in working adults: A meta-analysis of intervention studies. Mindfulness 2015, 6, 326–337. [Google Scholar] [CrossRef]
  36. Westermann, C.; Kozak, A.; Harling, M.; Nienhaus, A. Burnout intervention studies for inpatient elderly care nursing staff: Systematic literature review. Int. J. Nurs. Stud. 2014, 51, 63–71. [Google Scholar] [CrossRef]
  37. Romppanen, J.; Häggman-Laitila, A. Interventions for nurses’ well-being at work: A quantitative systematic review. J. Adv. Nurs. 2017, 73, 1555–1569. [Google Scholar] [CrossRef]
  38. Ahola, K.; Toppinen-Tanner, S.; Seppänen, J. Interventions to alleviate burnout symptoms and to support return to work among employees with burnout: Systematic review and meta-analysis. Burn. Res. 2017, 4, 1–11. [Google Scholar] [CrossRef]
  39. Cocker, F.; Joss, N. Compassion fatigue among healthcare, emergency and community service workers: A systematic review. Int. J. Environ. Res. Public Health 2016, 13, 618. [Google Scholar] [CrossRef]
  40. Chu, A.H.Y.; Koh, D.; Moy, F.M.; Müller-Riemenschneider, F. Do workplace physical activity interventions improve mental health outcomes? Occup. Med. 2014, 64, 235–245. [Google Scholar] [CrossRef] [Green Version]
  41. Lee, N.K.; Roche, A.; Duraisingam, V.; Fischer, J.A.; Cameron, J. Effective interventions for mental health in male-dominated workplaces. Ment. Health Rev. J. 2014, 19, 237–250. [Google Scholar] [CrossRef]
  42. Tan, L.; Wang, M.-J.; Modini, M.; Joyce, S.; Mykletun, A.; Christensen, H.; Harvey, S.B. Preventing the development of depression at work: A systematic review and meta-analysis of universal interventions in the workplace. BMC Med. 2014, 12, 74. [Google Scholar] [CrossRef]
  43. Robertson, I.T.; Cooper, C.L.; Sarkar, M.; Curran, T. Resilience training in the workplace from 2003 to 2014: A systematic review. J. Occup. Organ. Psychol. 2015, 88, 533–562. [Google Scholar] [CrossRef] [Green Version]
  44. Ivandic, I.; Freeman, A.; Birner, U.; Nowak, D.; Sabariego, C. A systematic review of brief mental health and well-being interventions in organizational settings. Scand J. Work Environ. Health 2017, 43, 99–108. [Google Scholar] [CrossRef] [Green Version]
  45. Lomas, T.; Medina, J.C.; Ivtzan, I.; Rupprecht, S.; Hart, R.; Eiroa-Orosa, F.J. The impact of mindfulness on well-being and performance in the workplace: An inclusive systematic review of the empirical literature. Eur. J. Work Organ. Psychol. 2017, 26, 492–513. [Google Scholar] [CrossRef]
  46. Lomas, T.; Medina, J.C.; Ivtzan, I.; Rupprecht, S.; Eiroa-Orosa, F.J. The impact of mindfulness on the wellbeing and performance of educators: A systematic review of the empirical literature. Teach. Teach. Educ. 2017, 61, 132–141. [Google Scholar] [CrossRef] [Green Version]
  47. Carolan, S.; Harris, P.R.; Cavanagh, K. Improving employee well-being and effectiveness: Systematic review and meta-analysis of web-based psychological interventions delivered in the workplace. J. Med. Internet Res. 2017, 19, e271. [Google Scholar] [CrossRef]
  48. von Hofe, I.; Latza, U.; Lönnfors, S.; Muckelbauer, R. Online-Gesundheitsangebote zur Vorbeugung von stressassoziierten psychischen Beeinträchtigungen innerhalb betrieblicher Lebenswelten. Gesundheitswesen 2017, 79, 144–152. [Google Scholar] [CrossRef] [PubMed]
  49. Pomaki, G.; Franche, R.-L.; Murray, E.; Khushrushahi, N.; Lampinen, T.M. Workplace-based work disability prevention interventions for workers with common mental health conditions: A review of the literature. J. Occup. Rehabil. 2012, 22, 182–195. [Google Scholar] [CrossRef] [PubMed]
  50. Guillaumie, L.; Boiral, O.; Champagne, J. A mixed-methods systematic review of the effects of mindfulness on nurses. J. Adv. Nurs. 2017, 73, 1017–1034. [Google Scholar] [CrossRef] [PubMed]
  51. Fernandez, A.; Howse, E.; Rubio-Valera, M.; Thorncraft, K.; Noone, J.; Luu, X.; Veness, B.; Leech, M.; Llewellyn, G.; Salvador-Carulla, L. Setting-based interventions to promote mental health at the university: A systematic review. Int. J. Public Health 2016, 61, 797–807. [Google Scholar] [CrossRef] [PubMed]
  52. Francke, A.L.; de Graaff, F.M. The effects of group supervision of nurses: A systematic literature review. Int. J. Nurs. Stud. 2012, 49, 1165–1179. [Google Scholar] [CrossRef] [PubMed]
  53. Murray, M.; Murray, L.; Donnelly, M. Systematic review of interventions to improve the psychological well-being of general practitioners. BMC Fam. Pract. 2016, 17, 36. [Google Scholar] [CrossRef] [PubMed]
  54. West, C.P.; Dyrbye, L.N.; Erwin, P.J.; Shanafelt, T.D. Interventions to prevent and reduce physician burnout: A systematic review and meta-analysis. Lancet 2016, 388, 2272–2281. [Google Scholar] [CrossRef]
  55. Panagioti, M.; Panagopoulou, E.; Bower, P.; Lewith, G.; Kontopantelis, E.; Chew-Graham, C.; Dawson, S.; van Marwijk, H.; Geraghty, K.; Esmail, A. Controlled interventions to reduce burnout in physicians: A systematic review and meta-analysis. JAMA Intern. Med. 2017, 177, 195–205. [Google Scholar] [CrossRef] [PubMed]
  56. Gilmartin, H.; Goyal, A.; Hamati, M.C.; Mann, J.; Saint, S.; Chopra, V. Brief mindfulness practices for healthcare providers: A Systematic Literature Review. Am. J. Med. 2017, 130, 1219.e1–1219.e17. [Google Scholar] [CrossRef] [PubMed]
  57. Joyce, S.; Modini, M.; Christensen, H.; Mykletun, A.; Bryant, R.; Mitchell, P.B.; Harvey, S.B. Workplace interventions for common mental disorders: A systematic meta-review. Psychol. Med. 2016, 46, 683–697. [Google Scholar] [CrossRef]
  58. Karol, S.; Robertson, M.M. Implications of sit-stand and active workstations to counteract the adverse effects of sedentary work: A comprehensive review. Work 2015, 52, 255–267. [Google Scholar] [CrossRef] [PubMed]
  59. Karakolis, T.; Callaghan, J.P. The impact of sit-stand office workstations on worker discomfort and productivity: A review. Appl. Ergon. 2014, 45, 799–806. [Google Scholar] [CrossRef] [PubMed]
  60. Lowe, B.D.; Dick, R.B. Workplace exercise for control of occupational neck/shoulder disorders: A review of prospective studies. Environ. Health Insights 2014, 8, 75–95. [Google Scholar] [CrossRef] [PubMed]
  61. van Holland, B.J.; Soer, R.; de Boer, M.R.; Reneman, M.F.; Brouwer, S. Preventive occupational health interventions in the meat processing industry in upper-middle and high-income countries: A systematic review on their effectiveness. Int. Arch. Occup. Environ. Health 2015, 88, 389–402. [Google Scholar] [CrossRef] [PubMed]
  62. Robson, L.S.; Stephenson, C.M.; Schulte, P.A.; Amick, B.C.; Irvin, E.L.; Eggerth, D.E.; Chan, S.; Bielecky, A.R.; Wang, A.M.; Heidotting, T.L.; et al. A systematic review of the effectiveness of occupational health and safety training. Scand J. Work Environ. Health 2012, 38, 193–208. [Google Scholar] [CrossRef] [PubMed]
  63. Leider, P.C.; Boschman, J.S.; Frings-Dresen, M.H.W.; van der Molen, H.F. Effects of job rotation on musculoskeletal complaints and related work exposures: A systematic literature review. Ergonomics 2015, 58, 18–32. [Google Scholar] [CrossRef] [PubMed]
  64. van Eerd, D.; Munhall, C.; Irvin, E.; Rempel, D.; Brewer, S.; van der Beek, A.J.; Dennerlein, J.T.; Tullar, J.; Skivington, K.; Pinion, C.; et al. Effectiveness of workplace interventions in the prevention of upper extremity musculoskeletal disorders and symptoms: An update of the evidence. Occup. Environ. Med. 2016, 73, 62–70. [Google Scholar] [CrossRef] [PubMed]
  65. van Niekerk, S.-M.; Louw, Q.A.; Hillier, S. The effectiveness of a chair intervention in the workplace to reduce musculoskeletal symptoms: A systematic review. BMC Musculoskelet. Dis. 2012, 13, 145. [Google Scholar] [CrossRef] [PubMed]
  66. Neuhaus, M.; Eakin, E.G.; Straker, L.; Owen, N.; Dunstan, D.W.; Reid, N.; Healy, G.N. Reducing occupational sedentary time: A systematic review and meta-analysis of evidence on activity-permissive workstations. Obes. Rev. 2014, 15, 822–838. [Google Scholar] [CrossRef] [PubMed]
  67. Hogan, D.A.M.; Greiner, B.A.; O’Sullivan, L. The effect of manual handling training on achieving training transfer, employee’s behaviour change and subsequent reduction of work-related musculoskeletal disorders: A systematic review. Ergonomics 2014, 57, 93–107. [Google Scholar] [CrossRef] [PubMed]
  68. Dalager, T.; Søgaard, K.; Bech, K.T.; Mogensen, O.; Jensen, P.T. Musculoskeletal pain among surgeons performing minimally invasive surgery: A systematic review. Surg. Endosc. 2017, 31, 516–526. [Google Scholar] [CrossRef] [PubMed]
  69. Padula, R.S.; Comper, M.L.C.; Sparer, E.H.; Dennerlein, J.T. Job rotation designed to prevent musculoskeletal disorders and control risk in manufacturing industries: A systematic review. Appl. Ergon. 2017, 58, 386–397. [Google Scholar] [CrossRef] [PubMed]
  70. Shrestha, N.; Ijaz, S.; Kukkonen-Harjula, K.T.; Kumar, S.; Nwankwo, C.P. Workplace interventions for reducing sitting at work. Cochrane Database Syst. Rev. 2015, 1–86. [Google Scholar] [CrossRef]
  71. Verhagen, A.P.; Bierma-Zeinstra, S.M.A.; Burdorf, A.; Stynes, S.M.; de Vet, H.C.; Koes, B.W. Conservative interventions for treating work-related complaints of the arm, neck or shoulder in adults. Cochrane Database Syst. Rev. 2013, 12, 1–116. [Google Scholar] [CrossRef] [PubMed]
  72. Varatharajan, S.; Côté, P.; Shearer, H.M.; Loisel, P.; Wong, J.J.; Southerst, D.; Yu, H.; Randhawa, K.; Sutton, D.; van der Velde, G.; et al. Are work disability prevention interventions effective for the management of neck pain or upper extremity disorders? A systematic review by the Ontario Protocol for Traffic Injury Management (OPTIMa) collaboration. J. Occup. Rehabil. 2014, 24, 692–708. [Google Scholar] [CrossRef] [PubMed]
  73. Thomas, D.R.; Thomas, Y.L.N. Interventions to reduce injuries when transferring patients: A critical appraisal of reviews and a realist synthesis. Int. J. Nurs. Stud. 2014, 51, 1381–1394. [Google Scholar] [CrossRef] [PubMed]
  74. Cloostermans, L.; Bekkers, M.B.; Uiters, E.; Proper, K.I. The effectiveness of interventions for ageing workers on (early) retirement, work ability and productivity: A systematic review. Int. Arch. Occup. Environ. Health 2015, 88, 521–532. [Google Scholar] [CrossRef] [PubMed]
  75. Nexø, M.A.; Meng, A.; Borg, V. Can psychosocial work conditions protect against age-related cognitive decline? Results from a systematic review. Occup. Environ. Med. 2016, 73, 487–496. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  76. Poscia, A.; Moscato, U.; La Milia, D.I.; Milovanovic, S.; Stojanovic, J.; Borghini, A.; Collamati, A.; Ricciardi, W.; Magnavita, N. Workplace health promotion for older workers: A systematic literature review. BMC Health Serv. Res. 2016, 16, 416–428. [Google Scholar] [CrossRef] [PubMed]
  77. Steenstra, I.; Cullen, K.; Irvin, E.; van Eerd, D. A systematic review of interventions to promote work participation in older workers. J. Saf. Res. 2017, 60, 93–102. [Google Scholar] [CrossRef] [PubMed]
  78. Martínez-Lemos, R.I. Economic impact of corporate wellness programs in Europe: A literature review. J. Occup. Health 2015, 57, 201–211. [Google Scholar] [CrossRef] [PubMed]
  79. Sultan-Taïeb, H.; Parent-Lamarche, A.; Gaillard, A.; Stock, S.; Nicolakakis, N.; Hong, Q.N.; Vezina, M.; Coulibaly, Y.; Vézina, N.; Berthelette, D. Economic evaluations of ergonomic interventions preventing work-related musculoskeletal disorders: A systematic review of organizational-level interventions. BMC Public Health 2017, 17, 935. [Google Scholar] [CrossRef] [PubMed]
  80. Rothmore, P.; Aylward, P.; Karnon, J. Ergonomics and musculoskeletal injury prevention interventions in healthcare. Are they worth it? Ergon. Aust. 2014, 8, 1–5. [Google Scholar]
  81. Torbeyns, T.; Bailey, S.; Bos, I.; Meeusen, R. Active workstations to fight sedentary behaviour. Sports Med. 2014, 44, 1261–1273. [Google Scholar] [CrossRef] [PubMed]
  82. Odeen, M.; Magnussen, L.H.; Maeland, S.; Larun, L.; Eriksen, H.R.; Tveito, T.H. Systematic review of active workplace interventions to reduce sickness absence. Occup. Med. 2013, 63, 7–16. [Google Scholar] [CrossRef]
  83. Pereira, M.J.; Coombes, B.K.; Comans, T.A.; Johnston, V. The impact of onsite workplace health-enhancing physical activity interventions on worker productivity: A systematic review. Occup. Environ. Med. 2015, 72, 401–412. [Google Scholar] [CrossRef] [PubMed]
  84. White, M.I.; Dionne, C.E.; Wärje, O.; Koehoorn, M.; Wagner, S.L.; Schultz, I.Z.; Koehn, C.; Williams-Whitt, K.; Harder, H.G.; Pasca, R.; et al. Physical activity and exercise interventions in the workplace impacting work outcomes: A stakeholder-centered best evidence synthesis of systematic reviews. Int. J. Occup. Environ. Med. 2016, 7, 61–74. [Google Scholar] [CrossRef]
  85. Hamberg-van Reenen, H.H.; Proper, K.I.; van den Berg, M. Worksite mental health interventions: A systematic review of economic evaluations. Occup. Environ. Med. 2012, 69, 837–845. [Google Scholar] [CrossRef] [PubMed]
  86. Wagner, S.L.; Koehn, C.; White, M.I.; Harder, H.G.; Schultz, I.Z.; Williams-Whitt, K.; Warje, O.; Dionne, C.E.; Koehoorn, M.; Pasca, R.; et al. Mental health interventions in the workplace and work outcomes: A best-evidence synthesis of systematic reviews. Int. J. Occup. Environ. Med. 2016, 7, 607. [Google Scholar] [CrossRef]
  87. van Vilsteren, M.; van Oostrom, S.H.; de Vet, H.C.; Franche, R.L.; Boot, C.R.; Anema, J.R. Workplace interventions to prevent work disability in workers on sick leave. Cochrane Database Syst. Rev. 2015. [Google Scholar] [CrossRef]
  88. Oakman, J.; Neupane, S.; Proper, K.I.; Kinsman, N.; Nygård, C.H. Workplace interventions to improve work ability: A systematic review and meta-analysis of their effectiveness. Scand J. Work Environ. Health 2018, 44, 134–146. [Google Scholar] [CrossRef] [PubMed]
  89. Skamagki, G.; King, A.; Duncan, M.; Wåhlin, C. A systematic review on workplace interventions to manage chronic musculoskeletal conditions. Physiother. Res. Int. 2018, 23, e1738. [Google Scholar] [CrossRef] [PubMed]
Ijerph 16 03553 g001 550
Figure 1. Flow chart of reviews included.
Figure 1. Flow chart of reviews included.
Ijerph 16 03553 g001
Table
Table 1. Distribution of reviews by quality rating and aims/outcome.
Table 1. Distribution of reviews by quality rating and aims/outcome.
Aims/OutcomeQuality Rating
High
n (%) 		Moderate
n (%) 		Low & Very Low n (%) N.A.
n (%)
Mental disorders
(n = 38) 		712172
(18%)(32%)(45%)(5%)
Musculosceletal disorders (n = 23) 6971
(26%)(39%)(30%)(4%)
Older employees
(n = 4) 		0400
(0%)(100%)(0%)(0%)
Economic impact
(n = 10) 		4222
(40%)(20%)(20%)(20%)

Share and Cite

MDPI and ACS Style

Pieper, C.; Schröer, S.; Eilerts, A.-L. Evidence of Workplace Interventions—A Systematic Review of Systematic Reviews. Int. J. Environ. Res. Public Health 2019, 16, 3553. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16193553

AMA Style

Pieper C, Schröer S, Eilerts A-L. Evidence of Workplace Interventions—A Systematic Review of Systematic Reviews. International Journal of Environmental Research and Public Health. 2019; 16(19):3553. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16193553

Chicago/Turabian Style

Pieper, Claudia, Sarah Schröer, and Anna-Lisa Eilerts. 2019. "Evidence of Workplace Interventions—A Systematic Review of Systematic Reviews" International Journal of Environmental Research and Public Health 16, no. 19: 3553. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16193553

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop