Next Article in Journal
Analysis of Factors Influencing Hospitals’ Implementation of a Green E-Procurement System Using a Cloud Model
Previous Article in Journal
Implementation of Financial Incentives for Successful Smoking Cessation in Real-Life Company Settings: A Qualitative Needs Assessment among Employers
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJERPH
Volume 16
Issue 24
10.3390/ijerph16245136
ijerph-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Device-Measured Sedentary Behavior, Physical Activity and Aerobic Fitness Are Independent Correlates of Cognitive Performance in Healthy Middle-Aged Adults—Results from the SCAPIS Pilot Study

by
Maria M. Ekblom
1,2,*,
Örjan B. Ekblom
2,
Mats Börjesson
3,4,5,
Göran Bergström
6,7,
Christina Jern
8,9 and
Anders Wallin
3,10
1
The Swedish School of Sport and Health Sciences, 11486 Stockholm, Sweden
2
Department of Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden
3
Department of Neuroscience and Physiology, the Sahlgrenska Academy, University of Gothenburg, 40530 Gothenburgh, Sweden
4
Center for Health and Performance, Department of Food, Nutrition and Sports Science, 40530 Gothenburgh, Sweden
5
Sahlgrenska University Hospital/Ostra, University of Gothenburg, 41345 Gothenburgh, Sweden
6
Department of Molecular and Clinical Medicine, University of Gothenburg, 40530 Gothenburgh, Sweden
7
Department of Clinical Physiology, Sahlgrenska University Hospital, 41345 Gothenburgh, Sweden
8
Department of Laboratory Medicine, Institute of Biomedicine, the Sahlgrenska Academy, University of Gothenburg, 41345 Gothenburg, Sweden
9
Department of Clinical genetics and genomics, Sahlgrenska University Hospital, 41345 Gothenburgh, Sweden
10
The Memory Clinic, Sahlgrenska University Hospital, 40530 Gothenburgh, Sweden
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2019, 16(24), 5136; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16245136
Submission received: 5 November 2019 / Revised: 11 December 2019 / Accepted: 12 December 2019 / Published: 16 December 2019
(This article belongs to the Section Health Behavior, Chronic Disease and Health Promotion)
Review Reports Versions Notes

Abstract

:
High aerobic fitness, more moderate to vigorous physical activity (MVPA) and less sedentary behavior (SED) have all been suggested to promote cognitive functions, but it is unclear whether they are independent predictors of specific cognitive domains. This study aimed to investigate to what extent aerobic fitness MVPA and SED are independently associated with cognitive performance among middle-aged Swedish adults. We acquired device-based measures of aerobic fitness, cognitive performance and percent daily time spent in MVPA and SED in Swedish adults (n = 216; 54–66 years old). Aerobic fitness was associated with better performance at one out of two tests of speed/attention and one out of four tests of executive attention, and with worse performance at one of seven tests of memory. Increasing %MVPA was associated with better performance at one out of seven tests of memory and two out of three tests of verbal ability, whereas increasing %SED was associated with better performance at all four tests of executive attention and four out of seven tests of memory. These findings suggest that aerobic fitness, %MVPA and %SED are partly independent correlates of cognitive performance. To fully understand the association between SED and performance at several tests of cognitive function, future investigations might attempt to investigate intellectually engaging SED (such as reading books) separately from mentally undemanding SED (such as watching TV).

1. Introduction

Individuals with higher aerobic fitness have been shown to present with better academic performance [1], higher cognitive function [2,3,4], lower risks for early onset dementia [5], mild cognitive impairment [5] and stroke [6]. While animal studies generally show robust effects of exercise interventions, the effect sizes in human intervention studies have been more modest, with executive functions being the most responsive to aerobic exercise [7].
Although it is typically assumed that physical activity mainly promotes cognitive functions via its effect on aerobic fitness [8], which in turn improves cerebrovascular function [2], other mechanisms have also been suggested [9,10]. For example, both higher fit and more physically active individuals show greater hippocampal, prefrontal cortex and basal ganglia volume [11,12] than less fit and inactive controls, which together with extensive evidence from animal studies suggests that physical activity triggers the release and action of neurotrophic growth factors that promote neural tissues of importance for cognitive functions [10].
Aerobic fitness is partly genetically determined [13], although the magnitude of the genetic impact has been disputed [14]. However, studies report a high variability in habitual physical activity levels among individuals with the same fitness level [15]. There is also a large variability in sedentary behaviors (SED), such as sitting or lying among individuals with similar levels of physical activity [16]. There is now evidence to suggest that aerobic fitness, physical activity and SED are interdependent correlates of many health outcomes, but there is a paucity of studies investigating the relative importance of physical activity behavior (such as moderate to vigorous physical activity (MVPA) or SED and aerobic fitness for promoting brain health and cognitive function). Gill et al. (2015) [2] recently suggested that the association between aerobic fitness and cognitive function is partly mediated via (improved) cerebrovascular function (such as better cortical circulation, cerebral vascular-motor reactivity, less atherosclerosis, better endothelial functions etc.), whereas the association between self-reported, retrospective lifetime physical activity and cognitive function is not. Although this is very interesting, a major limitation to that study was the subjective assessment of physical activity.
SED has been defined as any awake behavior spent in sitting or lying (at <1.5 metabolic equivalents) [17]. A recent review summarized that self-reported SED is associated with worse cognitive functions [18], while a recent investigation using device-based measures of SED was not able to replicate such associations [19]. These findings underline the importance of assessment methods. Some preliminary evidence suggests that having more non screen SED is directly associated with a higher grade point average, but at the same time indirectly related to lower grade point average, with the latter being mediated via aerobic capacity [20].
Increased knowledge on the relative importance of aerobic fitness and device-measured physical activity behavior, including sedentary time, for cognitive function, is important, and may aid PA-implementation and intervention.
The aim of the current study was to investigate to what extent aerobic fitness and device-based measures of daily time spent in MVPA and SED are independently associated with performance at various cognitive tests, controlling for age, education, tobacco smoking status and being born in or outside of Sweden. We hypothesized that aerobic fitness would primarily be associated with the cognitive tests, where performance relies on processing speed and executive attention, and that %SED and %MVPA, while in the long run influencing aerobic fitness, would also be independent correlates of cognitive performance.

2. Materials and Methods

2.1. Participants

This study was performed on a subpopulation of the Swedish CArdioPulmonary bioImage Study (SCAPIS) pilot study, which was conducted at the Sahlgrenska University Hospital in Gothenburg, Sweden in 2012 [21]. Men and women participating in the SCAPIS pilot study (n = 1089) were invited to participate in one additional test session of cognitive function. Out of these, 326 performed all cognitive tests.
A total of 85 were excluded because they did not have fitness data, and a further 25 because they did not have accelerometry data. In total, 96 men and 120 women were included in the analyses. The study was approved by the Regional Ethics Committee in Gothenburg (Approval numbers 638-16 and 734-13) and was carried out in accordance with the Declaration of Helsinki of 1975 and 1983.

2.2. Questionaire

As part of the SCAPIS pilot study, all participants filled in a detailed questionnaire [21]. For the purpose of this study, we used the questions on education, current smoking status and information on whether they were born in or outside of Sweden, in addition to simple, basic data (age and gender).
For education, a self-reported number of years of education was used. Self-reported active smoking was dichotomized into smokers or non-smokers, where non-smokers included former smokers. Participants also filled out where they were born. Using this information, they were then classified as “Born in Sweden” or “Born outside of Sweden”.

2.3. Cognitive Test Battery

A battery of cognitive tests designed to adequately investigate the domains simple speed/attention, executive attention, learning/memory and verbal ability, was used. The tests used for these domains are specified under each heading below.

2.3.1. Simple Speed/Attention (n = 2)

The tests tapping simple speed/attention were Trail Making Test (TMT) A, consisting of a timed pencil-tracing of a numbered path (Partington and Leiter, 1949, from [22]) and Stroop Test Victoria version, part 1, consisting of a timed verbal naming of 24 colored dots.

2.3.2. Executive Attention (n = 4)

The tests tapping executive attention were Stroop Test Victoria version part 2, consisting of a timed naming of words’ print color, part 3, consisting of naming of the print color of color words [22]; TMT B, consisting of a timed pencil-tracing of numbers and letters, 1-A-2-B, etc. [22]; and a Symbol Digit Modalities Test (SDMT), pencil in numbers in rows of blank squares, guided by nine corresponding symbols (Cognitive Assessment Battery (CAB) version [23]), same symbols but different numbers cf. the original [22]).

2.3.3. Learning/Memory (n = 7)

The tests tapping learning/memory were short story memory test, CAB [23] but now revised (CAB-R) to score both per verbatim and synonym, for both immediate and delayed recall; and Rey Complex Figure (RCF) immediate, delayed recall, and recognition [22].

2.3.4. Verbal Ability (n = 3)

The tests tapping verbal ability was a Controlled Oral Word Association Test, letters F-A-S, which consisted of naming as many words as you can for a given letter in one minute (COWAT-FAS, [22]) Category Fluency Test (CFT); Animal Naming, consisting of verbally naming as many animals as you can in one minute [22]; and a modified 30 item Boston Naming Test [23], featuring redrawn images from the original Boston Naming Test [24].
All tests were administered in Swedish under the supervision of a licensed psychologist, by a psychologist in training, a trained researcher, or a health coach. All scores were re-checked by a licensed psychologist. Patients used their normal glasses and/or hearing aids. No formal assessment of hearing or eyesight was performed. One participant reported impaired color perception, but as the tests depending on color (Stroop) indicated a normal result, data from the participant was not excluded from the analysis. Insufficient knowledge of Swedish was the sole exclusion criteria.
All patients presenting a cognitive complaint were offered further medical attention, should they so desire.

2.4. Aerobic Fitness

All participants in the SCAPIS pilot study were invited to undertake a submaximal ergometer aerobic fitness test. After a period of rest, participants were fitted with a heart rate monitor (Polar, Kempele, Finland), seated on an individually-adjusted bicycle ergometer (Monark model 828E, Varberg, Sweden) and instructed to pedal at an intensity resulting in a sub-maximal heart rate at a cadence of 60 rpm. Aerobic fitness (VO2max, expressed as mL·min−1·kg−1) was estimated using the Ekblom Bak method [25,26], which is based on a linear relationship between change in heart rate in response to a change in work rate. Participants with a diagnosed heart condition or taking beta-adrenergic blockers constituted a majority of excluded participants. Other reasons for non-participation in fitness testing included pain (hips, back, knees), obesity and perceived inability to perform the test. For analyses, participants were divided into five equally large groups (pentiles) based on fitness values.

2.5. Physical Activity and Sedentary Behavior

Physical Activity (PA) data was collected using an accelerometer (ActiGraph model GT3X/GT3X+, Actigraph LCC, Pensacola, FL, USA) carried in an elastic belt over the right hip. Participants were instructed to wear the accelerometer during waking hours for seven consecutive days from the first study visit. After the seven days, the accelerometer was returned to the laboratory by prepaid mail. The accelerometer was initialized and downloaded using ActiLife v.6.10.1 software (Actigraph LCC, Pensacola, FL, USA). Raw data sampling frequency was set to 30 Hz, and triaxial data were extracted in 60-s epochs with a low frequency extension filter. The accelerometers measure acceleration with the arbitrary unit counts per minute (cpm). Non-wear time was defined as 0 cpm for more than 60 min, while allowing a maximum of 2 min between 0 and 200. Wear time was defined as the non-wear time subtracted from 24 h. The wear time was then further analyzed, defining epochs with cpm < 200 as being spent in SED [27], epochs between 200 and 2089 cpm as low intensity physical activity (LIPA), and epochs > 2089 cpm as MVPA [28]. Average percent time per day spent in intensity-specific categories (%SED, %LIPA and %MVPA), was calculated over the entire studied period. For use in the regression analysis, %MVPA and %SED were further categorized into pentiles.

2.6. Statistics

Data were tested for normality using the Shapiro-Wilk test. Non-normal data was transformed to assume normality, using log (Lg) or square root (sqr). Linear regression modeling was then performed to investigate the associations between each cognitive function variable and aerobic fitness, %SED and %MVPA, controlling for age, gender, smoking, education and being born in or outside of Sweden. We chose not to adjust for the components of the metabolic syndrome, as these factors are associated with both aerobic fitness and PA-patterns [29] and thus, are not independent regarding effects on cognition. The strength of the associations were described using the standardized regression coefficients (β). Sensitivity analyses were performed to ensure that the direction of the associations was not changed when only participants reporting being born in Sweden were included in the analyses.

3. Results

The sample used for analyses consisted of 216 individuals, (120 women and 96 males, aged 54–66 years), having data on all aerobic fitness and physical activity variables and participating in the well-validated neuropsychological tests, assessing a broad spectrum of cognitive functions. There were no significant differences between men and women in age, education, physical activity measures, smoking habits or the proportion of participants born outside of Sweden, while women were less fit and spent less time in SED and vigorous physical activity, and men were more likely to have high levels of triglycerides (Table 1).
Among the tests tapping speed and attention, %MVPA and %SED were not related to any of the outcomes, whereas a higher aerobic fitness tended to be associated with better performance at Stroop 1, but not TMT A (Table 2). It is of note that individuals born in Sweden (n = 165) had higher performance at both tests (Table 2). We therefore performed sensitivity analyses using this subset of the study population. In these analyses, the direction of the associations remained. Still, the association between aerobic fitness and Stroop 1 was attenuated (β = −0.099, p = 0.287) and the association between %SED and TMT A strengthened (β = −0.189, p < 0.05).
Among the tests tapping executive attention, higher %SED was related to better performance at all tests, while %MVPA was not related to any of the tests, and higher aerobic fitness was related to better performance at Stroop 3 (Table 3). Sensitivity analyses showed that when using only the part of the sample born in Sweden, the direction of these associations remained. Still, in this subsample, aerobic performance also tended to be related to better performance at Stroop 2 (β = −0.159, p = 0.079) and the association between %SED and Stroop 3 was attenuated (β = −0.131, p = 0.123).
Among the tests tapping learning and memory, higher %SED was related to better performance in four verbal memory tasks, but was not related to the three visuospatial memory tests (Table 4). Higher %MVPA was related to better performance only in RCF recognition (Table 4), whereas better aerobic fitness was related to worse performance at RCF recognition. Sensitivity analyses showed that when using only the part of the sample born in Sweden, the direction of these associations remained. %SED was an even stronger correlate of memory in this subsample with the association between %SED and delayed verbatim memory now reaching significance (β = 0.210, p < 0.05).
Among the tests tapping verbal ability, more %MVPA was related to better abilities at two of the three tests (Table 5), while neither %SED nor aerobic fitness was significantly associated with any of these tests. Sensitivity analyses showed that when using only the part of the sample born in Sweden, the direction of these associations remained. Still, in this subsample more %SED tended to be associated with better performance at animal naming (β = 0.141, p = 0.098) and category naming (β = 0.144, p = 0.086), the association between %MVPA and category naming was attenuated (β = 0.128, p = 0.126) and a tendency for better aerobic capacity to be related to better performance at BNT appeared (β = −0.171, p = 0.054).
In summary, higher aerobic fitness was associated with better performance at some, but not all, tests of speed, attention and divided (executive) attention, but to worse performance at RCF recognition. High %MVPA was related to better RCF recognition and better verbal ability, while %SED was not associated with speed, but more %SED was related to better performance at all tests of divided (executive) attention and all verbal, but not the visuospatial, memory tests. Although being born in Sweden was a strong correlate of better performance at most cognitive tests, sensitivity analyses showed that when using only the part of the sample born in Sweden, the direction of associations remained the same between on the one hand %MVPA, %SED and aerobic fitness, and the cognitive variables on the other.

4. Discussion

The main findings of the current study were that aerobic fitness, %MVPA and %SED were associated with different cognitive domains, in unselected middle-aged subjects. In line with previous investigations in primarily elderly populations [30], aerobic fitness was associated with better performance at some of the tests of speed and executive attention, while controlling for age, education, smoking, being born in or outside of Sweden and device-measured %MVPA and %SED. When controlling for the same variables, higher %MVPA was not associated with any of the tests of executive attention, but was instead associated with better verbal ability. Interestingly, more %SED (i.e., sitting more) was associated with higher scores at all but one test of executive attention and at all verbal memory tests.

4.1. Why Ivestigate Independent Association?

Rather often, aerobic fitness is used as a proxy for physical activity and vice versa, physical activity as a proxy of aerobic fitness. In the same way, meeting the physical activity recommendations is often interpreted as being equivalent to not having a sedentary lifestyle. This is unfortunate, since the same individual can have both high %SED and high %MVPA [31]. Further, there is strong empirical evidence in favor of a genetic component of aerobic fitness.
As a consequence of this, there is a large variation in fitness between individuals with similar levels of MVPA and/or SED and reversely there are large variations in habitual physical activity and sedentary behaviors among individuals with the same fitness level. The current study attempted to enhance the understanding of how physical activity patterns and aerobic fitness, in more detail, are associated with cognitive function. Independent associations of each of these variables to individual cognitive tests were identified. The associations differed across cognitive outcome variables, sometimes even within the same cognitive domain. In this study, it is possible that this signifies that some of the cognitive tests are designed to identify difficulties rather than to measure abilities.

4.2. Independent Correlates of Speed and Executive Attention

The association between aerobic fitness and high performance at tests of speed and executive attention was expected, since this finding has been described in the literature, for a working age population [4], and in elderly populations [30]. There was however no independent association between %MVPA and executive attention. While the sample size of this study was small, these findings are consistent with the notion that %MVPA does not enhance executive attention independently of aerobic fitness [32]. The independent association between higher %SED and better performance at all tests of executive attention was somewhat unexpected, since %SED has been associated with increased risk for metabolic syndrome [29], which leads to increased vulnerability to vascular disease including atherosclerosis. This association could also mean that a large proportion of the SED was spent in cognitively engaging tasks. That is, while sitting is potentially detrimental for cognition abilities, this could possibly be outweighed by activities stimulating cognition, such as reading. As such, in regards to effects on cognition, the metabolic effects of inactivity seem to be subordinate to the cognitive activity undertaken during the activity. It is unknown if the same relation is true for MVPA. While this study was limited by its sample size, future studies should attempt to investigate whether aerobic fitness or MVPA moderates the association between %SED and cognition. Sandbakk et al. [33] recently showed that self-rated sedentary behavior was associated with cardiovascular disease and mortality, only among individuals with an age specific low fitness level. In line with this Katzmarzyk et al. [34] also showed that self-rated sedentary behavior was a weaker predictor of mortality in physically active as compared to physically inactive individuals.

4.3. Independent Correlates of Memory and Learning

Apart from being important for executive attention, higher %SED was also associated with better performance at all verbal memory tests. This appears to be consistent with the idea that intellectual activities of importance for vocabularies, such as reading [35], can make up an influential part of time spent in sedentary behavior. The visuospatial memory and learning tests were only associated with education, except for the RCF recognition, which was positively associated with %MVPA and negatively associated with aerobic fitness. The latter finding gives some support to the notion that %MVPA supports RCF recognition through mechanisms other than by aerobic fitness. Such mechanisms could include enhanced neuroplasticity from increased exercise-induced bioavailability of neurotrophic factors such as brain-derived neurotrophic factor [36].

4.4. Independent Correlates of Verbal Ability

While not of importance for performance on tests tapping speed and executive attention, higher %MVPA was instead independently associated with better performance at two out of three tests of verbal ability. This has previously been reported using self-rated estimates of physical activity in a mixed middle age and elderly population [37], but has to our knowledge not been demonstrated in a middle aged population using devise-based measures of physical activity. The tests of verbal ability were, as expected, strongly influenced by whether the individuals were born in or outside of Sweden. The directions of the associations did not change when we considered only the part of the sample born in Sweden, but the strength of the associations did. Care should therefore be taken when interpreting these findings.

4.5. Methodological Considerations

The current study has some weaknesses. The sample consisted of more females than males. Gender differences are sometimes found in cognitive functions. A recent meta-analysis of randomized controlled trials (RCTs) concluded that RCTs with a larger proportion of women show larger effect sizes for executive function and global cognition [38]. The cross-sectional nature of this study also makes it impossible to investigate causality. Alongside the idea of a positive effect of physical activity on cognitive function is the idea of the reversed causality by which executive functions are important components in the self-regulation needed to sustain positive lifestyle behaviors. It has been suggested that the association between aerobic fitness and cognition may be reciprocal, and that individuals with better executive functions achieve a better aerobic fitness through a healthier, more active lifestyle [39,40]. Additional data on context, for example type of sedentary activities (reading, screen time, etc.), would have been an asset, to support the proposed importance of this on cognitive functioning.
The current study also has several strengths. The inclusion of a multiple cognitive test for each cognitive domain and the inclusion of both device-based physical activity behavior and aerobic fitness instead of self-reported physical activity are the most important strengths. Another strength is the careful control for confounders, including information on whether the participants were born in Sweden or not [41], which has recently been shown to influence performance at cognitive tests, most likely due to the tests being performed in the non-native language [41]. Being born in Sweden was associated with higher performance at many of the cognitive tests, but our sensitivity analyses showed that when using only the part of the sample born in Sweden, the direction of the associations between %MVPA, %SED and aerobic fitness to performance at the cognitive tests, remained.

4.6. Implications

Sedentary time can work both ways regarding effects on cognition. The consistent finding of more %SED as a correlate of better cognitive functions is in contrast with previous investigations using subjective ratings of sedentary behaviors, but in line with some recently published investigations using device-based measures. Watching TV is sometimes used as a proxy for SED. SED as measured by extensive TV watching has previously been reported to be associated with poorer executive performance and processing speed [42]. However, subjective assessments of sedentary behavior in one domain may not be a valid measure of the total amount of daytime SED [43]. SED has been shown to be a risk factor for metabolic health, that is partly independent of aerobic fitness and MVPA [32] (but see also [44,45]). It would therefore be expected that higher %SED would be associated with worse rather than better cognitive functions, especially among low fit individuals. At the same time, engaging in intellectually challenging activities has also been shown to positively predict cognitive function [46], and since intellectual activities are often sedentary, this may counteract effects of metabolic risk factors on cognitive functions. In line with this, Hallgren et al. [47] recently observed that self-rated time spent in “mentally passive” SED was related to increased rates of depression, while “mentally active” SED was related to decreased rates of depression. To fully understand the interactive effects of cognitive engagement and physical activity patterns on cognitive functions, we suggest that future investigations use combinations of device-based measures of SED and subjective classifications of context.

5. Conclusions

The findings of the current study strengthen the evidence of low values of aerobic fitness being an independent correlate of lower performance at some, but not all, tests of executive attention in middle-aged adults. Such associations have also been shown in elderly populations [30]. In addition, %MVPA showed an independent association to verbal fluency, and one out of seven measures of memory, while higher %SED was independently associated with better performance at several cognitive tests tapping executive attention and verbal memory.
These findings are only partly in line with previous investigations relying on self-reported estimates of physical activity and sedentary behavior. Lack of exercise and too much sedentary time are both major causes of chronic disease [48], and aerobic fitness is a strong predictor of cardiovascular morbidity and all-cause mortality [49]. Still, the results of the present study emphasize that aerobic fitness and physical activity behaviors are partly independent correlates of cognitive functions. Further investigations are needed to understand these associations in populations of different ages, and using different measures of physical fitness and cognitive functions. Our findings reinforce that care should be taken when interpreting associations between subjectively rated activity patterns and health outcomes. To fully understand the associations observed between %SED and several of the cognitive functions in this study and others, future investigations should attempt to separate effects of cognitively engaged SED (for example reading) from less cognitively engaging SED. Also, future studies should attempt to investigate whether aerobic fitness moderates the association between SED and cognition.

Author Contributions

G.B. and A.W. were responsible for study design. G.B., Ö.B.E., M.B., A.W. and C.J. were responsible for data acquisition and analyses. M.M.E. was responsible for data cleaning and analyses. M.M.E. drafted the manuscript. All authors provided input and revised the manuscript for intellectual content. All authors read and approved the final manuscript.

Funding

This work was supported by the Swedish Heart and Lung Foundation (2015-0438 2012-0325), the Swedish Research Council (2013-4236, 2013-5187), and the Swedish Council for Working Life and Social Research (Epilife). The SCAPIS pilot study also received funding from the Sahlgrenska Academy at Gothenburg University. M.M.E. and Ö.B.E. were funded by a grant from the Swedish Armed Forces (AF9220915). Ö.B.E. was further funded by Skandia.

Acknowledgments

The authors are grateful to all the participants in this study. A special thanks goes to all test personnel at the SCAPIS test center in Gothenburg and to the test team at the memory clinic in Moelndal. We also wish to acknowledge the work performed by Jacob Ståhlhammar with both data management and constructive criticism of the manuscript. Arto Nordlund contributed to initial work on this material but died before completion. He is greatly missed.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Aberg, M.A.; Pedersen, N.L.; Toren, K.; Svartengren, M.; Backstrand, B.; Johnsson, T.; Cooper-Kuhn, C.M.; Aberg, N.D.; Nilsson, M.; Kuhn, H.G. Cardiovascular fitness is associated with cognition in young adulthood. Proc. Natl. Acad. Sci. USA 2009, 106, 20906–20911. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Gill, S.J.; Friedenreich, C.M.; Sajobi, T.T.; Longman, R.S.; Drogos, L.L.; Davenport, M.H.; Tyndall, A.V.; Eskes, G.A.; Hogan, D.B.; Hill, M.D.; et al. Association between Lifetime Physical Activity and Cognitive Functioning in Middle-Aged and Older Community Dwelling Adults: Results from the Brain in Motion Study. J. Int. Neuropsychol. Soc. JINS 2015, 21, 816–830. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Scott, S.P.; MJ, D.E.S.; Koehler, K.; Petkus, D.L.; Murray-Kolb, L.E. Cardiorespiratory Fitness is Associated with Better Executive Function in Young Women. Med. Sci. Sports Exerc. 2016, 48, 1994–2002. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Pantzar, A.; Jonasson, L.S.; Ekblom, O.; Boraxbekk, C.J.; Ekblom, M.M. Relationships Between Aerobic Fitness Levels and Cognitive Performance in Swedish Office Workers. Front. Psychol. 2018, 9, 2612. [Google Scholar] [CrossRef] [Green Version]
  5. Nyberg, J.; Aberg, M.A.; Schioler, L.; Nilsson, M.; Wallin, A.; Toren, K.; Kuhn, H.G. Cardiovascular and cognitive fitness at age 18 and risk of early-onset dementia. Brain J. Neurol. 2014, 137, 1514–1523. [Google Scholar] [CrossRef]
  6. Aberg, N.D.; Kuhn, H.G.; Nyberg, J.; Waern, M.; Friberg, P.; Svensson, J.; Toren, K.; Rosengren, A.; Aberg, M.A.; Nilsson, M. Influence of Cardiovascular Fitness and Muscle Strength in Early Adulthood on Long-Term Risk of Stroke in Swedish Men. Stroke 2015, 46, 1769–1776. [Google Scholar] [CrossRef] [Green Version]
  7. Khan, N.A.; Hillman, C.H. The relation of childhood physical activity and aerobic fitness to brain function and cognition: A review. Pediatr. Exerc. Sci. 2014, 26, 138–146. [Google Scholar] [CrossRef]
  8. Voss, M.W.; Heo, S.; Prakash, R.S.; Erickson, K.I.; Alves, H.; Chaddock, L.; Szabo, A.N.; Mailey, E.L.; Wojcicki, T.R.; White, S.M.; et al. The influence of aerobic fitness on cerebral white matter integrity and cognitive function in older adults: Results of a one-year exercise intervention. Hum. Brain Mapp. 2013, 34, 2972–2985. [Google Scholar] [CrossRef] [Green Version]
  9. Jackson, P.A.; Pialoux, V.; Corbett, D.; Drogos, L.; Erickson, K.I.; Eskes, G.A.; Poulin, M.J. Promoting brain health through exercise and diet in older adults: A physiological perspective. J. Physiol. 2016, 594, 4485–4498. [Google Scholar] [CrossRef]
  10. Stillman, C.M.; Cohen, J.; Lehman, M.E.; Erickson, K.I. Mediators of Physical Activity on Neurocognitive Function: A Review at Multiple Levels of Analysis. Front. Hum. Neurosci. 2016, 10, 626. [Google Scholar] [CrossRef] [Green Version]
  11. Prakash, R.S.; Voss, M.W.; Erickson, K.I.; Kramer, A.F. Physical activity and cognitive vitality. Annu. Rev. Psychol. 2015, 66, 769–797. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Erickson, K.I.; Leckie, R.L.; Weinstein, A.M. Physical activity, fitness, and gray matter volume. Neurobiol. Aging 2014, 35 (Suppl. 2), S20–S28. [Google Scholar] [CrossRef] [Green Version]
  13. Fagard, R.; Bielen, E.; Amery, A. Heritability of aerobic power and anaerobic energy generation during exercise. J. Appl. Physiol. 1991, 70, 357–362. [Google Scholar] [CrossRef] [PubMed]
  14. Ross, R.; de Lannoy, L.; Stotz, P.J. Separate Effects of Intensity and Amount of Exercise on Interindividual Cardiorespiratory Fitness Response. Mayo Clin. Proc. 2015, 90, 1506–1514. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Zeiher, J.; Ombrellaro, K.J.; Perumal, N.; Keil, T.; Mensink, G.B.M.; Finger, J.D. Correlates and Determinants of Cardiorespiratory Fitness in Adults: A Systematic Review. Sports Med. Open 2019, 5, 39. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Baumann, S.; Guertler, D.; Weymar, F.; Bahls, M.; Dorr, M.; van den Berg, N.; John, U.; Ulbricht, S. Do accelerometer-based physical activity patterns differentially affect cardiorespiratory fitness? A growth mixture modeling approach. J. Behav. Med. 2019. [Google Scholar] [CrossRef]
  17. Tremblay, M.S.; Aubert, S.; Barnes, J.D.; Saunders, T.J.; Carson, V.; Latimer-Cheung, A.E.; Chastin, S.F.M.; Altenburg, T.M.; Chinapaw, M.J.M.; Participants, S.T.C.P. Sedentary Behavior Research Network (SBRN)—Terminology Consensus Project process and outcome. Int. J. Behav. Nutr. Phys. Act. 2017, 14, 75. [Google Scholar] [CrossRef] [Green Version]
  18. Falck, R.S.; Davis, J.C.; Liu-Ambrose, T. What is the association between sedentary behaviour and cognitive function? A systematic review. Br. J. Sports Med. 2017, 51, 800–811. [Google Scholar] [CrossRef] [Green Version]
  19. Rosenberg, D.E.; Bellettiere, J.; Gardiner, P.A.; Villarreal, V.N.; Crist, K.; Kerr, J. Independent Associations between Sedentary Behaviors and Mental, Cognitive, Physical, and Functional Health among Older Adults in Retirement Communities. J. Gerontol. Ser. A Biol. Sci. Med Sci. 2016, 71, 78–83. [Google Scholar] [CrossRef] [Green Version]
  20. Syvaoja, H.J.; Kankaanpaa, A.; Kallio, J.; Hakonen, H.; Kulmala, J.; Hillman, C.H.; Pesonen, A.K.; Tammelin, T.H. The Relation of Physical Activity, Sedentary Behaviors, and Academic Achievement is Mediated by Fitness and Bedtime. J. Phys. Act. Health 2018, 15, 135–143. [Google Scholar] [CrossRef] [Green Version]
  21. Bergstrom, G.; Berglund, G.; Blomberg, A.; Brandberg, J.; Engstrom, G.; Engvall, J.; Eriksson, M.; de Faire, U.; Flinck, A.; Hansson, M.G.; et al. The Swedish CArdioPulmonary BioImage Study: Objectives and design. J. Intern. Med. 2015, 278, 645–659. [Google Scholar] [CrossRef] [PubMed]
  22. Strauss, E.; Sherman, E.M.S.; Spreen, O. A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary, 3rd ed.; Oxford University Press: Oxford, UK, 2006. [Google Scholar]
  23. Nordlund, A.; Pahlsson, L.; Holmberg, C.; Lind, K.; Wallin, A. The Cognitive Assessment Battery (CAB): A rapid test of cognitive domains. Int. Psychogeriatr. 2011, 23, 1144–1151. [Google Scholar] [CrossRef] [PubMed]
  24. Kaplan, E.F.; Goodglass, H.; Weintraub, S. The Boston Naming Test; Pro-Ed: Austin, TX, USA, 2001. [Google Scholar]
  25. Bjorkman, F.; Ekblom-Bak, E.; Ekblom, O.; Ekblom, B. Validity of the revised Ekblom Bak cycle ergometer test in adults. Eur. J. Appl. Physiol. 2016, 116, 1627–1638. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Ekblom-Bak, E.; Bjorkman, F.; Hellenius, M.L.; Ekblom, B. A new submaximal cycle ergometer test for prediction of VO2max. Scand. J. Med. Sci. Sports 2014, 24, 319–326. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Aguilar-Farias, N.; Brown, W.J.; Peeters, G.M. ActiGraph GT3X+ cut-points for identifying sedentary behaviour in older adults in free-living environments. J. Sci. Med. Sport 2014, 17, 293–299. [Google Scholar] [CrossRef]
  28. Sasaki, J.E.; John, D.; Freedson, P.S. Validation and comparison of ActiGraph activity monitors. J. Sci. Med. Sport 2011, 14, 411–416. [Google Scholar] [CrossRef]
  29. Ekblom, O.; Ekblom-Bak, E.; Rosengren, A.; Hallsten, M.; Bergstrom, G.; Borjesson, M. Cardiorespiratory Fitness, Sedentary Behaviour and Physical Activity Are Independently Associated with the Metabolic Syndrome, Results from the SCAPIS Pilot Study. PLoS ONE 2015, 10, e0131586. [Google Scholar] [CrossRef] [Green Version]
  30. Kirk-Sanchez, N.J.; McGough, E.L. Physical exercise and cognitive performance in the elderly: Current perspectives. Clin. Interv. Aging 2014, 9, 51–62. [Google Scholar] [CrossRef] [Green Version]
  31. Ussery, E.N.; Fulton, J.E.; Galuska, D.A.; Katzmarzyk, P.T.; Carlson, S.A. Joint Prevalence of Sitting Time and Leisure-Time Physical Activity among U.S. Adults, 2015–2016. JAMA 2018, 320, 2036–2038. [Google Scholar] [CrossRef]
  32. Etnier, J.L.; Nowell, P.M.; Landers, D.M.; Sibley, B.A. A meta-regression to examine the relationship between aerobic fitness and cognitive performance. Brain Res. Rev. 2006, 52, 119–130. [Google Scholar] [CrossRef] [Green Version]
  33. Sandbakk, S.B.; Nauman, J.; Zisko, N.; Sandbakk, O.; Aspvik, N.P.; Stensvold, D.; Wisloff, U. Sedentary Time, Cardiorespiratory Fitness, and Cardiovascular Risk Factor Clustering in Older Adults—the Generation 100 Study. Mayo Clin. Proc. 2016, 91, 1525–1534. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Katzmarzyk, P.T.; Church, T.S.; Craig, C.L.; Bouchard, C. Sitting time and mortality from all causes, cardiovascular disease, and cancer. Med. Sci. Sports Exerc. 2009, 41, 998–1005. [Google Scholar] [CrossRef] [PubMed]
  35. Duff, D.; Tomblin, J.B.; Catts, H. The Influence of Reading on Vocabulary Growth: A Case for a Matthew Effect. J. Speech Lang. Hear. Res. JSLHR 2015, 58, 853–864. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Vaynman, S.; Ying, Z.; Gomez-Pinilla, F. Hippocampal BDNF mediates the efficacy of exercise on synaptic plasticity and cognition. Eur. J. Neurosci. 2004, 20, 2580–2590. [Google Scholar] [CrossRef]
  37. Kobayashi, L.C.; Wardle, J.; Wolf, M.S.; von Wagner, C. Health Literacy and Moderate to Vigorous Physical Activity During Aging, 2004–2013. Am. J. Prev. Med. 2016, 51, 463–472. [Google Scholar] [CrossRef]
  38. Barha, C.K.; Davis, J.C.; Falck, R.S.; Nagamatsu, L.S.; Liu-Ambrose, T. Sex differences in exercise efficacy to improve cognition: A systematic review and meta-analysis of randomized controlled trials in older humans. Front. Neuroendocrinol. 2017, 46, 71–85. [Google Scholar] [CrossRef]
  39. Allan, J.L.; McMinn, D.; Daly, M. A Bidirectional Relationship between Executive Function and Health Behavior: Evidence, Implications, and Future Directions. Front. Neurosci. 2016, 10, 386. [Google Scholar] [CrossRef]
  40. Daly, M.; McMinn, D.; Allan, J.L. A bidirectional relationship between physical activity and executive function in older adults. Front. Hum. Neurosci. 2014, 8, 1044. [Google Scholar] [CrossRef] [Green Version]
  41. Stålhammar, J. Precision in Neuropsychology. Four Challenges When Using Simplified Assumptions. Ph.D. Thesis, University of Gothenburg, Gothenburg, Sweden, 2019. [Google Scholar]
  42. Hoang, T.D.; Reis, J.; Zhu, N.; Jacobs, D.R., Jr.; Launer, L.J.; Whitmer, R.A.; Sidney, S.; Yaffe, K. Effect of Early Adult Patterns of Physical Activity and Television Viewing on Midlife Cognitive Function. JAMA Psychiatry 2016, 73, 73–79. [Google Scholar] [CrossRef]
  43. Dall, P.M.; Coulter, E.H.; Fitzsimons, C.F.; Skelton, D.A.; Chastin, S.; Seniors, U.S.P.T. TAxonomy of Self-reported Sedentary behaviour Tools (TASST) framework for development, comparison and evaluation of self-report tools: Content analysis and systematic review. BMJ Open 2017, 7, e013844. [Google Scholar] [CrossRef]
  44. Stamatakis, E.; Ekelund, U.; Ding, D.; Hamer, M.; Bauman, A.E.; Lee, I.M. Is the time right for quantitative public health guidelines on sitting? A narrative review of sedentary behaviour research paradigms and findings. Br. J. Sports Med. 2019, 53, 377–382. [Google Scholar] [CrossRef] [PubMed]
  45. Katzmarzyk, P.T.; Powell, K.E.; Jakicic, J.M.; Troiano, R.P.; Piercy, K.; Tennant, B.; Physical Activity Guidelines Advisory Committee. Sedentary Behavior and Health: Update from the 2018 Physical Activity Guidelines Advisory Committee. Med. Sci. Sports Exerc. 2019, 51, 1227–1241. [Google Scholar] [CrossRef] [PubMed]
  46. Carlson, M.C.; Saczynski, J.S.; Rebok, G.W.; Seeman, T.; Glass, T.A.; McGill, S.; Tielsch, J.; Frick, K.D.; Hill, J.; Fried, L.P. Exploring the effects of an “everyday” activity program on executive function and memory in older adults: Experience Corps. Gerontologist 2008, 48, 793–801. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Hallgren, M.; Owen, N.; Stubbs, B.; Zeebari, Z.; Vancampfort, D.; Schuch, F.; Bellocco, R.; Dunstan, D.; Trolle Lagerros, Y. Passive and mentally-active sedentary behaviors and incident major depressive disorder: A 13-year cohort study. J. Affect. Disord. 2018, 241, 579–585. [Google Scholar] [CrossRef]
  48. Booth, F.W.; Roberts, C.K.; Laye, M.J. Lack of exercise is a major cause of chronic diseases. Compr. Physiol. 2012, 2, 1143–1211. [Google Scholar]
  49. Ekblom-Bak, E.; Ekblom, B.; Soderling, J.; Borjesson, M.; Blom, V.; Kallings, L.V.; Hemmingsson, E.; Andersson, G.; Wallin, P.; Ekblom, O. Sex- and age-specific associations between cardiorespiratory fitness, CVD morbidity and all-cause mortality in 266.109 adults. Prev. Med. 2019, 127, 105799. [Google Scholar] [CrossRef]
Table
Table 1. Subject characteristics. Displaying descriptive statistics and comparisons of the participating men and women.
Table 1. Subject characteristics. Displaying descriptive statistics and comparisons of the participating men and women.
Descriptive VariablesWomen (n = 120)Men (n = (96))Sex Difference
MedianQuartile 1–3MedianQuartile 1-3
Age (years)60.059.0–63.860.058.0–64.0p > 0.05
Aerobic fitness (mL min−1 kg−1)28.624.1–34.235.031.0–39.2p < 0.001
Sedentary time (%)49.744.5–58.754.347.9–61.4p < 0.05
Moderate PA (%)5.23.7–6.65.03.7–7.3p > 0.05
Vigorous PA (%)0.10.0–0.40.20.0–1.1p < 0.05
Education (years)13.712.0–15.413.012.0–16.0p > 0.05
Current smokers (%)11.510.0p > 0.05
Born outside of Sweden (%)19.128.1p > 0.05
Hypertension (%)20.019.8p > 0.05
Known diabetes (%)1.72.1p > 0.05
High triglycerides (%)5.013.5p < 0.05
High Triglycerides were defined as above 2 mmol/L. PA = Physical activity.
Table
Table 2. Standardized Beta-coefficients for linear regressions with neuropsychological tests tapping simple speed/attention.
Table 2. Standardized Beta-coefficients for linear regressions with neuropsychological tests tapping simple speed/attention.
Independent VariablesLgStroop 1
Adj. R2 = 0.343		LgTMT A
Adj. R2 = 0.112
%MVPAn.s.n.s.
%SEDn.s.n.s.
Aerobic fitness−0.108 *n.s.
Agen.s.0.135 **
Educationn.s.n.s.
Smokingn.s.n.s.
Sex−0.276 ***n.s.
Born in Sweden−0.506 ***−0.285 ***
* p ≤ 0.1, ** p ≤ 0.05, *** p ≤ 0.001. Average time spent in moderate to vigorous physical activity (%MVPA) and sedentary behavior (%SED) and aerobic fitness are expressed in pentiles. A higher value is represented as being a current smoker, being female and being born in Sweden. The standardized beta-coefficients of the associations are in bold where p ≤ 0.1 for %MVPA, %SED or aerobic fitness. Adj. = Adjusted.
Table
Table 3. Standardized beta-coefficients for linear regressions with neuropsychological tests tapping executive attention.
Table 3. Standardized beta-coefficients for linear regressions with neuropsychological tests tapping executive attention.
Independent VariablesSqrStroop 2
Adj. R2 = 0.362		LgStroop 3
Adj. R2 = 0.225		SDMT
Adj. R2 = 0.177		LgTMT B
Adj. R2 = 0.273
%MVPAn.s.n.s.n.s.n.s.
%SED−0.141 **−0.127 *0.126 *−0.113 *
Aerobic fitnessn.s−0.203 **n.s.n.s.
Agen.s.n.s.−0.148 **0.188 **
Educationn.s.n.s.0.161 **−0.171 **
Smokingn.s.n.s.n.s.n.s.
Sex−0.146 **−0.251 **0.135 *n.s.
Born in Sweden−0.552 ***−0.357 **0.301 ***−0.448 ***
* p ≤ 0.1, ** p ≤ 0.05, *** p ≤ 0.001. Average time spent in moderate to vigorous physical activity (%MVPA) and sedentary behavior (%SED) and aerobic fitness are expressed in pentiles. A higher value is represented as being a current smoker, being female and being born in Sweden. The standardized beta-coefficients of the associations are in bold where p ≤ 0.1 for %MVPA, %SED or aerobic fitness. Adj. = Adjusted.
Table
Table 4. Standardized beta-coefficients for linear regressions with neuropsychological tests tapping learning/memory.
Table 4. Standardized beta-coefficients for linear regressions with neuropsychological tests tapping learning/memory.
Independent VariablesMemory Verbatim
Adj. R2 = 0.161		Memory Direct Synonym
Adj. R2 = 0.196		Memory Delayed Verbatim
Adj. R2 = 0.127		Memory Delayed Synonym
Adj. R2 = 0.144		RCF Immediate
Adj. R2 = 0.045		RCF Delayed
Adj. R2 = 0.038		RCF Recognition
Adj. R2 = 0.055
%MVPAn.s.n.s.n.s.n.s.n.s.n.s.0.143 **
%SED0.136 **0.137 **0.119 *0.134 *n.s.n.s.n.s.
Aerobic fitnessn.sn.s.n.s.n.s.n.s.n.s.−0.183 **
Agen.s.n.s.n.s.0.132 *n.s.n.s.n.s.
Education0.310 ***0.309 ***0.255 ***0.281 ***0.209 **0.205 **0.116 *
Smokingn.s.n.s.n.s.n.s.n.s.n.s.n.s.
Sexn.s.n.s.n.s.n.s.n.s.n.s.−0.154 **
Born in Sweden0.201 **0.266 ***0.198 **0.209 **n.s.n.s.0.212 **
* p ≤ 0.1, ** p ≤ 0.05, *** p ≤ 0.001. Average time spent in moderate to vigorous physical activity (%MVPA) and sedentary behavior (%SED) and aerobic fitness are expressed in pentiles. A higher value is represented as being a current smoker, being female and being born in Sweden. The standardized beta-coefficients of the associations are in bold where p ≤ 0.1 for %MVPA, %SED or aerobic fitness. RCF = Rey Complex Figure. Adj. = Adjusted.
Table
Table 5. Standardized Beta-coefficients for linear regressions with neuropsychological tests tapping verbal ability.
Table 5. Standardized Beta-coefficients for linear regressions with neuropsychological tests tapping verbal ability.
Independent VariablesAnimal Naming
Adj. R2 = 0.220		Category Fluency FAS
Adj. R2 = 0.237		Boston Naming Test
Adj. R2 = 0.480
%MVPAn.s.0.115 *0.114 **
%SEDn.s.n.s.n.s.
Aerobic fitnessn.s.n.s.n.s.
Agen.s.n.s.0.180 ***
Educationn.s.0.224 ***0.170 **
Smokingn.s.n.s.n.s.
Sexn.s.n.s.n.s.
Born in Sweden0.419 ***0.413 ***0.532 ***
* p ≤ 0.1, ** p ≤ 0.05, *** p ≤ 0.001. Average time spent in moderate to vigorous physical activity (%MVPA) and sedentary behavior (%SED) and aerobic fitness are expressed in pentiles. A higher value is represented as being a current smoker, being female and being born in Sweden. The standardized beta-coefficients of the associations are in bold where p ≤ 0.1 for %MVPA, %SED or aerobic fitness.

Share and Cite

MDPI and ACS Style

Ekblom, M.M.; Ekblom, Ö.B.; Börjesson, M.; Bergström, G.; Jern, C.; Wallin, A. Device-Measured Sedentary Behavior, Physical Activity and Aerobic Fitness Are Independent Correlates of Cognitive Performance in Healthy Middle-Aged Adults—Results from the SCAPIS Pilot Study. Int. J. Environ. Res. Public Health 2019, 16, 5136. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16245136

AMA Style

Ekblom MM, Ekblom ÖB, Börjesson M, Bergström G, Jern C, Wallin A. Device-Measured Sedentary Behavior, Physical Activity and Aerobic Fitness Are Independent Correlates of Cognitive Performance in Healthy Middle-Aged Adults—Results from the SCAPIS Pilot Study. International Journal of Environmental Research and Public Health. 2019; 16(24):5136. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16245136

Chicago/Turabian Style

Ekblom, Maria M., Örjan B. Ekblom, Mats Börjesson, Göran Bergström, Christina Jern, and Anders Wallin. 2019. "Device-Measured Sedentary Behavior, Physical Activity and Aerobic Fitness Are Independent Correlates of Cognitive Performance in Healthy Middle-Aged Adults—Results from the SCAPIS Pilot Study" International Journal of Environmental Research and Public Health 16, no. 24: 5136. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph16245136

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop