Next Article in Journal
Longitudinal Effects of Parental Academic Support on Academic Achievement in Korea: Will You Be a Companion or a Manager in Your Children’s Academic Support?
Next Article in Special Issue
Diagnostic Value of the TpTe Interval in Children with Ventricular Arrhythmias
Previous Article in Journal
Multi-Task Learning-Based Immunofluorescence Classification of Kidney Disease
Previous Article in Special Issue
Modifiable Factors for the Trajectory of Health-Related Quality of Life among Youth Growing Up in Poverty: A Prospective Cohort Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Children with Secondary Care Episodes for Otitis Media Have Poor Literacy and Numeracy Outcomes: A Data Linkage Study

by
Megan F. Bell
1,*,
Fernando Lima
1,
Deborah Lehmann
2,
Rebecca Glauert
1,
Hannah C. Moore
2 and
Christopher G. Brennan-Jones
2,3,4,5
1
Telethon Kids Institute, University of Western Australia, P.O. Box 855, West Perth, WA 6872, Australia
2
Wesfarmers Centre of Vaccines and Infectious Diseases, Telethon Kids Institute, University of Western Australia, P.O. Box 855, West Perth, WA 6872, Australia
3
Division of Paediatrics, Faculty of Health and Medical Sciences (M561), University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia
4
Perth Children’s Hospital, Child and Adolescent Health Service, Nedlands, WA 6009, Australia
5
Faculty of Health Sciences, Curtin University, Bentley, WA 6102, Australia
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(20), 10822; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph182010822
Submission received: 13 September 2021 / Revised: 8 October 2021 / Accepted: 12 October 2021 / Published: 15 October 2021
(This article belongs to the Collection Feature Papers in Children's Health)

Abstract

:
We examined the association between otitis media (OM) and educational attainment in a retrospective population cohort of Western Australian children who participated in the grade 3 National Assessment Program—Literacy and Numeracy in 2012 (N = 19,262). Literacy and numeracy scores were linked to administrative hospital and emergency department data to identify secondary care episodes for OM. Results of multivariate multilevel models showed that children with OM episodes had increased odds of poor performance on literacy and numeracy tests, compared to children without OM episodes (46–79% increase in odds for Aboriginal children; 20–31% increase in odds for non-Aboriginal children). There were no significant effects found for age at the first episode, nor for OM episode frequency (all ps > 0.05). Regardless of the timing or frequency of episodes, children with OM episodes are at risk of poor literacy and numeracy attainment. Aboriginal children with OM appeared to be particularly at risk of poor literacy and numeracy achievement. Intervention to reduce the prevalence of otitis media in young children, and early treatment of OM, are important for limiting the negative effects on academic outcomes.

1. Introduction

Otitis media (OM), a spectrum of inflammatory conditions involving the middle ear, is one of the most common conditions affecting young children [1]. Australian Aboriginal and/or Torres Strait Islander children (hereafter, respectfully referred to as Aboriginal) are particularly susceptible to OM [2,3], with the highest reported rates of OM globally [4]. Australian Aboriginal children are five times more likely to be diagnosed with OM in primary care settings than non-Aboriginal children [5], and 10 times more likely to be hospitalized for OM [3]. OM is the most common cause of temporary mild-moderate conductive unilateral or bilateral hearing loss in children [1]. Recurrent or persistent episodes of OM often result in long periods of poor hearing (hearing loss of 15–40 dB) or complications that may result in permanent hearing loss [6]. This hearing loss results in an inconsistent auditory stimulus, which may negatively affect early development of speech and language [7,8,9], and thus have adverse consequences for children’s learning and social development [10].
The peak prevalence of OM occurs between 6 to 18 months of age [1], which coincides with a period of rapid development for children. Recurrent or persistent OM occurring in the first years of life may thus be particularly detrimental to long-term outcomes. Previous research has found an association between OM and poor school readiness [11]; academic, speech, and language difficulties [12,13,14,15]; and emotional, attention, and behavior problems [12,16,17]. However, some researchers argue that these associations are explained by confounding variables common to both OM incidence and poor academic attainment [18], including preterm birth, socioeconomic disadvantage, and poor school attendance. The contradiction in the literature is related to methodological limitations. Many studies do not control for probable confounding variables, utilize small samples, have high attrition rates, and primarily rely on retrospective parent reports, which can be associated with recall and reporting bias. Few studies utilize linked administrative data; this methodology is prospective, provides large samples, captures clinical health information, and has minimal loss to follow-up.
We use linked data to examine the association between secondary care episodes for OM in childhood (0–9 years) and performance on standardized tests of literacy and numeracy in grade 3, controlling for multiple potential confounding factors. We hypothesize that children who have secondary care episodes for OM will have low attainment on grade 3 literacy and numeracy tests, and that this association will be stronger for children with a first episode prior to 3 years of age, and those who have repeated OM episodes.

2. Materials and Methods

2.1. Setting and Study Population

This is a cohort study in which we examined the association between secondary care episodes for OM and scores on standardized numeracy and literacy assessments for children in grade 3. The study was conducted in Western Australia (WA), which has an area of 2.5 million km2 and a population of 2.6 million, 79% of whom reside in the capital of Perth. Health services in WA are managed by public and private healthcare providers and there are >80 hospitals. All WA residents are eligible for free care at public hospitals.
The study population included children born in WA during July 2003 to June 2004 who subsequently participated in the grade 3 National Assessment Program—Literacy and Numeracy (NAPLAN) in 2012 (N = 20,479). Exclusion criteria were (1) missing all NAPLAN scores (n = 847); (2) multiple births, with one child from each birth retained by random selection (excluded n = 296); and (3) diagnosed with intellectual disability as recorded in the IDEA (Intellectual Disabilities Exploring Answers) database (n = 74). The final sample included 19,262 children who were aged 7–9 years at the end of the study period (May 2012). Prospectively collected hospital and emergency department records for all study children were extracted (see details below) for identification of children with secondary care episodes for OM.

2.2. Data Sources

Data were provided by the WA Departments of Health and Education, the Commonwealth Department of Education, and the WA Register of Developmental Anomalies (WARDA). Datasets were linked by the WA Data Linkage Branch by probabilistic matching of identifiers common to the sets of records (e.g., name, address) and clerical review [19]. Only de-identified records were provided to researchers.

2.3. Otitis Media Episodes

Data from secondary care episodes were used to identify children with diagnoses of OM. Secondary care episodes were defined as admissions to hospital or presentations to an emergency department, sourced from the Hospital Morbidity Data Collection (HMDC; records all WA public and private hospital separations), and the Emergency Department Data Collection (EDDC; records presentations to WA public emergency departments), respectively. Secondary care episodes where a child received a diagnosis of OM or where symptoms indicative of OM were recorded were classified as ‘OM episodes.’ Children who did not have a secondary care OM episode were included in the ‘no OM episodes’ group (noting that these children may have been diagnosed with OM in a primary care setting).
In this study, OM refers to a broad range of presentations for middle ear infections and their sequelae, including acute OM, OM with effusion, conductive hearing loss, chronically discharging perforations, cholesteatoma, and mastoiditis. Diagnoses were coded by trained coders using the International Classification of Diseases Tenth Revision, Australian Modification (ICD-10-AM) [20]. As per Westphal et al. [3], ICD-10-AM codes H65-67, H70-75, H90.0-H90.2, H90.6-H90.8, H92, and/or H95 were used to identify OM episodes in any of the HMDC primary or additional diagnosis fields.
In the EDDC, the same ICD-10-AM codes were used to identify all principal diagnoses of OM. As per Barnes et al. [21], other EDDC variables were used to identify OM episodes when principal diagnosis was not recorded. First, symptom codes for ‘ear discharge’ (FC000 and FGB00) were considered to indicate OM presentations. If both principal diagnosis and symptom codes were missing, ‘diagnosis at discharge’ and ‘presenting complaints’ free text variables were used. Free text of, for example, ‘left otitis media’, was considered an OM episode. OM episodes were identified for all children from month of birth until the end of the study period (May 2012). Appendix A details the number of OM episodes identified from each data source and for each ICD-10-AM code.

2.4. Academic Outcomes

Academic test scores were obtained from the 2012 NAPLAN, when the cohort children were in grade 3. The NAPLAN is an annual national assessment of children’s academic performance in numeracy, reading, writing, spelling, and grammar and punctuation. This study focused on the numeracy, reading, and writing tests. All Australian students are expected to undertake the NAPLAN. In 2012, approximately 95% of WA students enrolled in grade 3 participated [22]. Tests are conducted in schools over three consecutive days in May. Children are given 40–45 min for each testing session. Questions are multiple-choice or short answer and are curriculum-based. Children’s scores on each test are compared against national benchmarks according to the age at which they complete the test. A child scoring at or above the ‘national minimum standards’ has demonstrated the basic literacy and numeracy skills expected of their year level [22]. For this study, NAPLAN scores were converted into binary variables indicating whether children were at/above (0) or below (1) the national minimum standards for their grade level on each test.

2.5. Covariates

Covariates (Table 1) were obtained from the linked data, with variables selected a priori based on evidence of an association with OM and/or academic outcomes. Child sex, Aboriginality, birth month/year, percentage of optimum birthweight [23], and gestational age were obtained from the Midwives Notification System (MNS) and Birth Registrations data collections. The WA Genealogical System [24] identified all children born to the same mother between 1974–2012; from this, the number of siblings for each child was calculated. Children with mental health contacts (categorized as yes/no) were identified from the Mental Health Information System (public outpatient contacts) and from HMDC (public and private inpatient contacts) and EDDC (emergency presentations), when a primary mental illness diagnosis (ICD-10-AM ‘F’ codes) was recorded. Birth defects (categorized as present/absent) were identified from the WARDA, which captures details of all birth defects in WA-born children. School readiness scores were obtained from the 2009 Australian Early Development Census (AEDC), a national teacher-reported assessment of children’s performance against 104 items assessing physical, social, emotional, cognitive, and communicative development. Children who score below the 25th percentile (based on national classifications) on any of the five developmental domains are considered developmentally vulnerable or at risk of vulnerability in that area [25]. Child English language status (i.e., whether primary language or not) was also obtained from the AEDC dataset.
Parent age and maternal marital status (both recorded at the time of the child’s birth) were obtained from the MNS and Birth Registrations. The NAPLAN dataset records the highest education level of each parent separately; this information was combined to indicate overall highest education level for both parents.
Area-level socioeconomic and geographic remoteness indices were calculated for the child’s neighborhood of residence at birth. The Index of Relative Socioeconomic Disadvantage (IRSD) [26] was used as the measure of area-level socioeconomic disadvantage. The IRSD is derived from census information capturing factors including income, educational attainment, and unemployment. Neighborhoods are given a score which is categorized into quintiles with 1 representing most disadvantaged and 5 representing least disadvantaged. Under the Australian Statistical Geography Standard [27], geographical areas are classified as metropolitan, inner/outer regional, or remote/very remote based on access to goods and services in an area; for this study, these five categories were collapsed into three (metropolitan, regional, remote).

2.6. Statistical Methods

Due to clustering of the data (students within schools), multilevel modelling was conducted. The intra-class correlation coefficient showed that 31%, 37% and 46% of the variance in numeracy, reading, and writing tests, respectively, was explained by unobserved differences between schools, thus indicating the suitability of multilevel modelling. Models grouped children by grade 3 schools (N = 830 schools; M = 18 students per school, range 1–99). Some children were missing one (N = 435) or two (N = 171) of the three NAPLAN test scores; these missing values were imputed with mean school level scores for the corresponding missing test. Missing records for covariates (see counts in Table 1) were handled using multiple imputation (MI). Analyses were conducted using SAS software version 9.4 (SAS Institute Inc., Cary, NC, USA) of the SAS System for Windows [28].
Univariate and multivariate multilevel logistic regressions estimated the odds of children with OM episodes scoring below the national minimum standards on reading, writing, and numeracy tests. Multivariate models included the covariates in Table 1, with the category representing lower risk on each variable coded as the reference group. Analyses were conducted separately for Aboriginal and non-Aboriginal children because of evidence of higher rates of OM incidence and greater severity of disease in Aboriginal populations [2].
Additional models analyzed the effect of (1) age at first OM episode and (2) number of OM episodes on literacy and numeracy scores. Children were categorized into mutually exclusive groups based on age at first OM episode: ≤1 year, 2–3 years, or ≥4 years. For models examining OM episode frequency, all discrete OM episodes were summed for each child. Only month and year of admission/presentation were provided by data custodians; thus, all OM episodes occurring within the same calendar month were combined into a single episode. The additional models were run only for children with at least one OM episode, and with Aboriginal and non-Aboriginal children combined (to achieve statistical power).

3. Results

3.1. Descriptive Statistics

There were 2666 (13.8%) children with at least one OM episode during the study period. A higher proportion of Aboriginal children had OM episodes (n = 256, 17.2%) than non-Aboriginal children (n = 2410, 13.6%); this difference was statistically significant, Χ2 (1, N = 19,262) = 14.9, p < 0.001. Children had an average of 1.52 OM episodes during the study period (SD = 1.00; range 1–13; Aboriginal M = 1.62; non-Aboriginal M = 1.50). The median age at first OM episode was 3 years (Aboriginal Mdn = 2 years; non-Aboriginal Mdn = 3 years).
The proportion of children scoring below the benchmark on reading, numeracy, or writing tests was higher for children who had at least one OM episode compared to children with no OM episodes (Table 2). Almost 60% of Aboriginal children with OM episodes scored below the national benchmark on at least one test compared to 11% of non-Aboriginal children with OM episodes.

3.2. Logistic Regressions

3.2.1. Any OM Episode

In the unadjusted models, children with at least one OM episode had increased odds of poor performance on all three tests (Table 3). These associations remained statistically significant after adjustment (Table 3). Children with OM episodes had 33%, 35%, and 43% increased odds of scoring below the benchmark on numeracy, reading, and writing, respectively, compared to children without OM episodes. Complete tables of univariate and multivariate models are provided in Supplementary Tables S1 and S2, respectively.
When models were run separately for Aboriginal and non-Aboriginal children, results differed (Table 3). For non-Aboriginal children with OM episodes, there was no statistically significant increase in the odds of poor numeracy or writing performance. However, there was a 31% increase in odds of non-Aboriginal children with an OM episode scoring below the national benchmark on reading, compared to non-Aboriginal children with no OM episodes. Aboriginal children with OM episodes had 70%, 46%, and 79% increased odds of scoring below the benchmark on numeracy, reading, and writing, respectively, when compared to Aboriginal children without OM episodes. A complete table of results is provided in Supplementary Table S3.

3.2.2. Age at First OM Episode and Frequency of OM Episodes

These models were restricted to children with at least one OM episode and combined both Aboriginal and non-Aboriginal children. In the univariate and multivariate models, age at first OM episode and frequency of OM episodes were not significantly associated with scoring below the national benchmark on any NAPLAN test (Table 4).

4. Discussion

We found an association between OM secondary care episodes and poorer performance on reading, writing, and numeracy tests, even after adjusting for a range of potential confounding variables. Our findings support previous literature showing an association between OM and poorer educational outcomes [13,14]. Contrary to expectations, however, there was no increased risk associated with earlier age at first OM episode when compared to older age groups. This contrasts with other research [13], and may be related to the use of hospital data, as first secondary care episode may not correlate well with onset of disease. We also did not find that children with repeated OM episodes performed more poorly on literacy and numeracy tests. One other study similarly found no greater risk of poor school performance after multiple OM episodes [29], but at least three other studies did find an association between repeated OM episodes and poorer academic skills [12,30,31]. Further research to clarify these associations are therefore needed. In summary, the results of our study suggest that children who are diagnosed with OM during a secondary care episode may be at risk of poorer academic outcomes, regardless of the timing or frequency of the episodes.
Our results also suggest that OM may be a specific health risk factor for the educational attainment of Aboriginal children. When compared to other Aboriginal children, Aboriginal children with OM episodes had increased odds of up to 79% of not meeting national minimum standards in literacy and numeracy. This is in contrast to an earlier study of 46 Aboriginal children, which found no difference in literacy and reading outcomes among Aboriginal children with and without OM and hearing loss [32]. In our study, Aboriginal children tended to have their first OM episode at a younger age than non-Aboriginal children, and to have more frequent OM episodes. Early onset of OM is one of the strongest predictors of persistent disease [33], and thus an important focus of interventions. Compared to non-Aboriginal children, Aboriginal children with OM have, on average, greater longevity of disease (and thus episodes of poor hearing: 3 months versus 32 months) [34] and may therefore experience greater impacts on speech and language development. OM and its associated hearing loss are treatable conditions, and it is critical that we reduce the prevalence and impact of OM in Aboriginal populations by addressing social and environmental factors that increase OM risk.
In this one-year birth cohort, OM secondary care episodes were relatively common and frequently first experienced prior to age 3. This is concerning, given the potential impact on the development of skills that underlie academic success. Early and effective treatment of conditions that affect hearing and speech, such as OM, is imperative for prevention and/or mitigation of academic issues [34]. Several interventions are suggested. Pneumococcal vaccination is effective at reducing the rates and onset of OM in young populations [35,36], although there is evidence that vaccination is less effective for Aboriginal populations [37]. Tympanostomy tube insertion is effective in preventing repeated episodes of OM [38], which is important due to the association of repeated or persistent OM with hearing loss [6]. However, surgical treatment of OM is less frequently performed for Aboriginal children, despite higher prevalence rates [3]. Antibiotic over-prescription for OM is an issue, but prophylaxis is beneficial for high risk populations, including Aboriginal children [39]. Importantly, preventative measures should address key social determinants that drive the gap in OM rates between Aboriginal and non-Aboriginal populations, and the associated environmental risk factors, including tobacco smoke, poor sanitation, and high-occupancy housing [40]. Such endeavors must include Aboriginal community members in research, intervention design, and service delivery in order to be effective [40,41].
In a pedagogical context, interventions could include: improving teacher awareness of the fluctuating nature of hearing impairment and the impact it can have on learning; protocols to identify students with current or past hearing impairment; improvements to the classroom listening environment; supporting learning through use of non-verbal cues, repetition of instructions, and implementation of predictable routines; and education programs that focus on the development of written and verbal language skills [42]. In regions with high rates of OM, whole-school approaches will likely be needed. Special consideration should be given to children with co-existing special needs (e.g., vision impairment) that may make the impact of hearing loss associated with OM more pronounced [43]. When OM-related hearing problems are detected, educational support plans should involve an interdisciplinary approach involving school nurses, teachers, speech-language therapists, and audiologists [44].
Strengths of this study include the use of linked administrative data, allowing the prospective capture of clinical diagnoses of OM within a large population sample. Use of a standardized test of literacy and numeracy limits bias. Hospital records require clinical diagnoses and are thus less likely than self-report measures to contain reporting bias. However, hospital data can contain selection bias, as members of disadvantaged groups may prefer to attend hospital due to issues with affordability, accessibility, and availability of primary care services [45]. It is possible that some ICD-10-AM codes used to identify OM may be indicative of other disease (e.g., perforation of the tympanic membrane), which may have biased our measure. However, the codes we used are consistent with other published research, the authors of which consulted with ear specialists in defining their inclusion criteria [3]. In addition, OM is primarily managed in the community by general practitioners. As we did not have primary care data our findings represent the more severe end of the clinical spectrum of OM, which may have resulted in larger effect estimates than would be seen if all OM diagnoses were captured. We also did not have data on OM procedures. Tympanostomy tube insertion is conducted to treat persistent OM and to potentially prevent negative developmental consequences [43]; investigations into whether the association between OM and academic attainment is mediated by tympanostomy tube insertion should be conducted. Finally, we did not have information on which children had hearing loss or speech and language difficulties, so a causal link between OM and literacy and numeracy scores cannot be established. Future research should investigate the association between OM-related hearing loss and/or speech and language difficulties and disruptions to learning.

5. Conclusions

This study has provided further evidence of an association between OM episodes and literacy and numeracy difficulties in young children. The association was evident even after controlling for a wide range of socio-demographic characteristics and early developmental difficulties. Higher odds of poor literacy and numeracy scores were found regardless of the timing of the first OM episode or the number of OM episodes. Aboriginal children are particularly at risk of both early and repeated episodes of OM, and lower educational attainment associated with OM. Measures to address the social determinants of the high prevalence of OM in Aboriginal populations are urgently needed, in addition to vaccination, surgical treatment, and prophylaxis. Early detection of OM-related hearing problems is also important in order to mitigate impacts on learning.

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/article/10.3390/ijerph182010822/s1, Table S1: Univariate odds of children scoring below the national benchmarks on grade 3 numeracy, reading and writing tests associated with OM episodes and covariates, Table S2: Multivariate odds of children scoring below the national benchmarks on grade 3 numeracy, reading and writing tests associated with OM episodes and covariates, Table S3: Multivariate odds of children scoring below the national benchmarks on grade 3 numeracy, reading and writing tests. Separate models for Aboriginal and non-Aboriginal children.

Author Contributions

Conceptualization, R.G., M.F.B. and C.G.B.-J.; methodology, all authors; formal analysis, F.L.; data curation, M.F.B. and F.L.; writing—original draft preparation, M.F.B. and F.L.; writing—review and editing, R.G., C.G.B.-J., D.L., H.C.M.; funding acquisition, R.G. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by an Australian Research Council Linkage grant (grant number LP100200507). C.G.B-J was supported by an NHMRC Fellowship (grant number 1142897) and a WA Department of Health Emerging Leader Fellowship.

Institutional Review Board Statement

Ethics approval for this study was granted by the Western Australian (WA) Department of Health Human Research Ethics Committee (2013/65; 13 February 2014), the University of Western Australia Human Research Ethics Committee (RA/4/1/6651; 17 February 2014), and the WA Aboriginal Health Ethics Committee (551; 14 February 2014).

Informed Consent Statement

Patient consent was waived due to the use of de-identified administrative data; there was no direct contact with any of the participants. Personal identifying information was removed from the records prior to data being provided to the researchers. Secondary analysis of de-identified administrative data without obtaining individual patient consent is permitted under the Australian National Health and Medical Research Council’s National Statement on Ethical Conduct in Human Research.

Data Availability Statement

Data used in this project are not publicly available due to ethical and privacy reasons. Other researchers may access the data through the usual application process to the Western Australian Data Linkage Branch and the Western Australian Department of Health Human Research Ethics Committee. Parameters for the data request can be made available on request.

Acknowledgments

This article does not necessarily reflect the views of the government departments involved in the research. Thank you to the people of Western Australia for the use of their administrative data. The authors also wish to thank the staff at the Western Australian Data Linkage Branch and the data custodians of the Hospital Morbidity Data Collection, Emergency Department Data Collection, Midwives Notification System, Birth Registrations, Mental Health Information System, WA Register of Developmental Anomalies (Birth Defects and Cerebral Palsy), Intellectual Disabilities Exploring Answers, and the National Assessment Program—Literacy and Numeracy. Thank you to the Social Research Centre, custodians of the Australian Early Development Census. We acknowledge the excellent partnership between the custodians of the WA Department of Health and the Commonwealth Department of Education.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

Appendix A

Details of OM hospitalizations; number of cases identified from different data sources (Table A1) and number of records identified using different ICD-10-AM or symptom codes, or free text (Table A2).
Table A1. Count of children with OM hospitalizations identified from each linked data source.
Table A1. Count of children with OM hospitalizations identified from each linked data source.
Data SourceUnique Cases Identified (N)
HMDC principal diagnosis1320
HMDC additional diagnosis465
EDDC881
Total2666
OM = Otitis media, HMDC = Hospital Morbidity Data Collection, EDDC = Emergency Department Data Collection.
Table A2. Total counts of records identified using different ICD-10-AM codes, symptom codes, and free text variables.
Table A2. Total counts of records identified using different ICD-10-AM codes, symptom codes, and free text variables.
N%
ICD-10-AM code
H65, Non-suppurative otitis media178344.1%
H66, Suppurative and unspecified otitis media177844.0%
H67, Otitis media in diseases classified elsewhere00.0%
H70, Mastoiditis and related conditions160.4%
H71, Cholesteatoma of middle ear110.3%
H72, Perforation of tympanic membrane1654.1%
H73, Other disorders of tympanic membrane130.3%
H74, Other disorders of middle ear and mastoid60.1%
H75, Other disorders of middle ear and mastoid in diseases classified elsewhere00.0%
H90.1, Conductive hearing loss, unilateral with unrestricted hearing on the contralateral side60.1%
H90.2, Conductive hearing loss, unspecified10.0%
H90.6, Mixed conductive and sensorineural hearing loss, bilateral00.0%
H90.7, Mixed conductive and sensorineural hearing loss, unilateral with unrestricted hearing on the contralateral side00.0%
H90.8, Mixed conductive and sensorineural hearing loss, unspecified00.0%
H92, Otalgia and effusion of ear1423.5%
H95, Postprocedural disorders of ear and mastoid process, not elsewhere classified00.0%
Symptom codes indicating ear discharge30.1%
Free text indicating otitis media and/or ear discharge1172.9%
Total4041100.0%
ICD-10-AM = International Classification of Diseases, 10th Edition, Australian Modification.

References

  1. Klein, J.O. The burden of otitis media. Vaccine 2001, 19, S2–S8. [Google Scholar] [CrossRef]
  2. Jervis-Bardy, J.; Sanchez, L.; Carney, A.S. Otitis media in Indigenous Australian children: Review of epidemiology and risk factors. J. Laryngol. Otol. 2014, 128, S16–S27. [Google Scholar] [CrossRef]
  3. Westphal, D.W.; Lehmann, D.; Williams, S.A.; Richmond, P.C.; Lannigan, F.J.; Fathima, P.; Blyth, C.C.; Moore, H.C. Australian Aboriginal children have higher hospitalization rates for otitis media but lower surgical procedures than non-Aboriginal children: A record linkage population-based cohort study. PLoS ONE 2019, 14, e0215483. [Google Scholar] [CrossRef]
  4. Graydon, K.; Waterworth, C.; Miller, H.; Gunasekera, H. Global burden of hearing impairment and ear disease. J. Laryngol. Otol. 2019, 133, 18–25. [Google Scholar] [CrossRef] [Green Version]
  5. Gunasekera, H.; Knox, S.; Morris, P.; Britt, H.; McIntyre, P.; Craig, J.C. The spectrum and management of otitis media in Australian Indigenous and non-Indigenous children: A national study. Pediatr. Infect. Dis. J. 2007, 26, 689–692. [Google Scholar] [CrossRef] [PubMed]
  6. Yiengprugsawan, V.; Hogan, A.; Strazdins, L. Longitudinal analysis of ear infection and hearing impairment: Findings from 6-year prospective cohorts of Australian children. BMC Pediatr. 2013, 13, 28. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Pereira, M.B.; Befi-Lopes, D.M.; Samelli, A.G. Association between audiological profile and primary language impairment in children. Int. J. Pediatr. Otorhinolaryngol. 2015, 79, 53–57. [Google Scholar] [CrossRef]
  8. Shriberg, L.D.; Friel-Patti, S.; Flipsen, P., Jr.; Brown, R.L. Otitis Media, fluctuant hearing loss, and speech-language outcomes: A preliminary structural equation model. J. Speech Lang. Hear. Res. 2000, 43, 100–120. [Google Scholar] [CrossRef] [Green Version]
  9. Sagr, A.A.L.; Sagr, N.A.L. The effect of Otitis media on the language acquisition among children: Findings from a systematic review. J. Health Inform. Dev. Ctries. 2021, 15, 1–17. [Google Scholar]
  10. Snowling, M.J.; Adams, J.W.; Bishop, D.V.M.; Stothard, S.E. Educational attainments of school leavers with a preschool history of speech-language impairments. Int. J. Lang. Commun. Disord. 2001, 36, 173–183. [Google Scholar] [CrossRef] [PubMed]
  11. Bell, M.F.; Bayliss, D.M.; Glauert, R.; Harrison, A.; Ohan, J.L. Chronic illness and developmental vulnerability at school entry. Pediatrics 2016, 137, e20152475. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Niclasen, J.; Obel, C.; Homøe, P.; Kørvel-Hanquist, A.; Dammeyer, J. Associations between otitis media and child behavioural and learning difficulties: Results from a Danish cohort. Int. J. Pediatr. Otorhinolaryngol. 2016, 84, 12–20. [Google Scholar] [CrossRef]
  13. Luotonen, M.; Uhari, M.; Aitola, L.; Lukkaroinen, A.-M.; Luotonen, J.; Uhari, M. A nation-wide, population-based survey of otitis media and school achievement. Int. J. Pediatr. Otorhinolaryngol. 1998, 43, 41–51. [Google Scholar] [CrossRef]
  14. Winskel, H. The effects of an early history of otitis media on children’s language and literacy skill development. Br. J. Educ. Psychol. 2006, 76, 727–744. [Google Scholar] [CrossRef] [Green Version]
  15. Teele, D.W.; Klein, J.O.; Chase, C.; Menyuk, P.R.B. Otitis media in infancy and intellectual ability, school achievement, speech, and language at age 7 years. Greater Boston Otitis Media Study Group. J. Infect. Dis. 1990, 162, 685–694. [Google Scholar] [CrossRef] [PubMed]
  16. Da Costa, C.; Eikelboom, R.H.; Jacques, A.; Swanepoel, D.W.; Whitehouse, A.J.O.; Jamieson, S.E.; Brennan-Jones, C.G. Does otitis media in early childhood affect later behavioural development? Results from the Western Australian Pregnancy Cohort (Raine) Study. Clin. Otolaryngol. 2018, 43, 1036–1042. [Google Scholar] [CrossRef] [Green Version]
  17. Hogan, A.; Phillips, R.L.; Howard, D.; Yiengprugsawan, V. Psychosocial outcomes of children with ear infections and hearing problems: A longitudinal study. BMC Pediatr. 2014, 14, 65. [Google Scholar] [CrossRef] [Green Version]
  18. Roberts, J.E.; Rosenfeld, R.M.; Zeisel, S.A. Otitis media and speech and language: A meta-analysis of prospective studies. Pediatrics 2004, 113, e238–e248. [Google Scholar] [CrossRef] [Green Version]
  19. Holman, C.D.J.; Bass, J.A.; Rosman, D.L.; Smith, M.B.; Semmens, J.B.; Glasson, E.J.; Brook, E.L.; Trutwein, B.; Rouse, I.L.; Watson, C.R.; et al. A decade of data linkage in Western Australia: Strategic design, applications and benefits of the WA data linkage system. Aust. Health Rev. 2008, 32, 766–777. [Google Scholar] [CrossRef]
  20. National Centre for Classification in Health. The International Statistical Classification of Diseases and Related Health Problems, Tenth Revision, Australian Modification (ICD-10-AM); Faculty of Health Sciences, The University of Sydney: Sydney, Austrilia, 2004. [Google Scholar]
  21. Barnes, R.; Blyth, C.C.; De Klerk, N.; Lee, W.H.; Borland, M.L.; Richmond, P.; Lim, F.J.; Fathima, P.; Moore, H.C. Geographical disparities in emergency department presentations for acute respiratory infections and risk factors for presenting: A population-based cohort study of Western Australian children. BMJ Open. 2019, 9, e025360. [Google Scholar] [CrossRef] [Green Version]
  22. Australian Curriculum Assessment and Reporting Authority. 2012 National Assessment Program–Literacy and Numeracy. Sydney, New South Wales. 2012. Available online: https://www.nap.edu.au/results-and-reports/national-reports (accessed on 15 October 2020).
  23. Blair, E.M.; Liu, Y.; de Klerk, N.H.; Lawrence, D.M. Optimal fetal growth for the Caucasian singleton and assessment of appropriateness of fetal growth: An analysis of a total population perinatal database. BMC Pediatr. 2005, 5, 1–12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Glasson, E.J.; de Klerk, N.H.; Bass, A.J.; Rosman, D.L.; Palmer, L.J.; Holman, C.D.J. Cohort profile: The Western Australian Family Connections Genealogical Project. Int. J. Epidemiol. 2008, 37, 30–35. [Google Scholar] [CrossRef] [Green Version]
  25. Brinkman, S.; Gregory, T.; Goldfeld, S.; Lynch, J.; Hardy, M. Data resource profile: The Australian Early Development Index (AEDI). Int. J. Epidemiol. 2014, 43, 1089–1096. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Australian Bureau of Statistics. Index of Relative Socio-economic Disadvantage. 2011. Available online: http://www.abs.gov.au/ausstats/[email protected]/Lookup/2033.0.55.001main+features100052011 (accessed on 15 October 2020).
  27. Australian Bureau of Statistics. Australian Statistical Geography Standard: Volume 3–Non ABS Structures. 2011. Available online: http://www.abs.gov.au/ausstats/[email protected]/0/2C6132C0B332C336CA2578D40012CF76 (accessed on 15 October 2020).
  28. SAS. SAS System for Windows; SAS Institute Inc.: Cary, NC, USA, 2016. [Google Scholar]
  29. Fougner, V.; Kørvel-Hanquist, A.; Koch, A.; Dammeyer, J.; Niclasen, J.; Lous, J.; Homøeb, P. Early childhood otitis media and later school performance–A prospective cohort study of associations. Int. J. Pediatr. Otorhinolaryngol. 2017, 94, 87–94. [Google Scholar] [CrossRef]
  30. Roberts, J.E.; Burchinal, M.R.; Jackson, S.C.; Hooper, S.R.; Roush, J.; Mundy, M.; Neebe, E.C.; Zeisel, S.A. Otitis media in childhood in relation to preschool language and school readiness skills among black children. Pediatrics 2000, 106, 725–735. [Google Scholar] [CrossRef] [PubMed]
  31. Wang, J.; Quach, J.; Sung, V.; Carew, P.; Wake, M. Ear infection trajectories and academic, behavioral, and quality-of-life outcomes. J. Dev. Behav. Pediatr. 2021, 42, 588–596. [Google Scholar] [CrossRef]
  32. Timms, L.; Williams, C.; Stokes, S.F.; Kane, R. Literacy skills of Australian Indigenous school children with and without otitis media and hearing loss. Int. J. Speech Lang. Pathol. 2014, 16, 327–334. [Google Scholar] [CrossRef] [PubMed]
  33. Morris, P.S.; Leach, A.J.; Halpin, S.; Mellon, G.; Gadil, G.; Wigger, C.; Mackenzie, G.; Wilson, C.; Gadil, E.; Torzillo, P. An overview of acute otitis media in Australian Aboriginal children living in remote communities. Vaccine 2007, 25, 2389–2393. [Google Scholar] [CrossRef] [PubMed]
  34. Kong, K.; Coates, H.L.C. Natual history, definitions, risk factors and burden of otitis media. Med. J. Aust. 2009, 191, S39–S43. [Google Scholar] [CrossRef]
  35. Gisselsson-Solen, M. Trends in otitis media incidence after conjugate pneumococcal vaccination. Pediatr. Infect. Dis. J. 2017, 36, 1027–1031. [Google Scholar] [CrossRef]
  36. Edmondson-Jones, M.; Dibbern, T.; Hultberg, M.; Anell, B.; Medin, E.; Feng, Y.; Talarico, C. The effect of pneumococcal conjugate vaccines on otitis media from 2005 to 2013 in children aged ≤5 years: A retrospective cohort study in two Swedish regions. Hum. Vaccin. Immunother. 2021, 17, 517–526. [Google Scholar] [CrossRef] [PubMed]
  37. Mackenzie, G.A.; Carapetis, J.R.; Leach, A.J.; Morris, P.S. Pneumococcal vaccination and otitis media in Australian Aboriginal infants: Comparison of two birth cohorts before and after introduction of vaccination. BMC Pediatr. 2009, 9, 14. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  38. Kujala, T.; Alho, O.; Luotonen, J.; Kristo, A.; Uhari, M.; Renko, M.; Kontiokari, T.; Pokka, T.; Koivunen, P. Tympanostomy with and without adeniodectomy for the prevention of recurrences of acute otitis media: A randomized controlled trial. Pediatr. Infect. Dis. J. 2012, 31, 565–569. [Google Scholar] [CrossRef] [PubMed]
  39. Massa, H.M.; Cripps, A.W.; Lehmann, D.; Journal, M. Otitis media: Viruses, bacteria, biofilms and vaccines. Med. J. Aust. 2009, 191, 4–9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Delacy, J.; Dune, T.; MacDonald, J.J. The social determinants of otitis media in Aboriginal children in Australia: Are we addressing the primary causes? A systematic content review. BMC Public Health 2020, 20, 492. [Google Scholar] [CrossRef] [Green Version]
  41. Gotis-Graham, A.; MacNiven, R.; Kong, K.; Gwynne, K. Effectiveness of ear, nose and throat outreach programmes for Aboriginal and Torres Strait Islander Australians: A systematic review. BMJ Open. 2020, 10, e038273. [Google Scholar] [CrossRef]
  42. Burrow, S.; Galloway, A.; Weissofner, N. Review of educational and other approaches to hearing loss among Indigenous people. Aust. Indig. Health Bull. 2009, 2, 1–37. Available online: https://ro.ecu.edu.au/ecuworks/238 (accessed on 6 October 2020).
  43. Rosenfeld, R.M.; Shin, J.J.; Schwartz, S.R.; Coggins, R.; Gagnon, L.; Hackell, J.M.; Hoelting, D.; Hunter, L.L.; Kummer, A.W.; Payne, S.C.; et al. Clinical practice guideline: Otitis media with effusion (update). Otolaryngol.-Head Neck Surg. 2016, 154, S1–S41. [Google Scholar] [CrossRef] [PubMed]
  44. Neville, K.; Foley, M.; Gertner, A. Understanding and identifying the child at risk for auditory processing disorders: A case method approach in examining the interdisciplinary role of the school nurse. J. Sch. Nurs. 2011, 27, 22–33. [Google Scholar] [CrossRef]
  45. Bywood, P.; Katterl, R.; Lunnary, B. Disparities in Primary Health Care Utilisation: Who Are the Disadvantaged Groups? How Are They Disadvantaged? What Interventions Work? PHCRIS Policy Issue Review. Adelaide, South Australia. 2011. Available online: http://hdl.handle.net/2328/26598 (accessed on 5 November 2020).
Table 1. Characteristics of the cohort.
Table 1. Characteristics of the cohort.
No OM
Episodes, % (n = 16,596)
≥1 OM Episode 1
CharacteristicWhole Cohort, % (N = 19,262)Overall, % (n = 2666)Aboriginal, % (n = 256)Non-Aboriginal, % (n = 2410)
Child sex
  Female 49.049.843.546.143.2
  Male51.050.256.553.956.8
Child Indigenous status
  Aboriginal7.77.49.6100-
  Non-Aboriginal 92.392.690.4-100
Child speaks English as second language
  Yes6.16.25.822.34.1
  No 91.091.289.972.391.7
  missing2.92.64.35.54.2
Maternal age at cohort member’s birth, y
  <205.45.45.723.03.8
  20–2943.343.044.956.643.7
  30–39 48.448.646.818.449.8
  40+2.93.02.72.02.7
Paternal age at cohort member’s birth, y
  <201.91.91.87.01.2
  20–2930.129.832.035.531.6
  30–39 52.853.051.422.754.4
  40+11.111.49.65.510.0
  missing4.03.85.329.32.7
Maternal marital status at cohort member’s birth
  Married 90.891.089.667.292.0
  Never married7.57.38.425.46.6
  Divorced/separated/widowed1.21.21.34.31.0
  missing0.50.50.73.10.5
Parental highest education level
  University 28.428.527.66.629.9
  Vocational35.635.635.617.237.6
  High-school22.522.622.137.920.4
  missing13.513.314.738.312.2
Total siblings
  010.910.911.19.011.3
  1 43.343.244.022.346.3
  228.828.828.924.229.4
  3 or more17.017.116.044.513.0
Percentage of optimum birthweight 2
  Normal (85–114) 73.273.372.768.073.2
  Low (< 85)17.717.618.225.017.5
  High (< 85)9.19.19.07.09.3
Gestational age
  ≥ 37 weeks 92.792.991.182.092.1
  33–36 weeks6.16.07.014.56.2
  29–32 weeks0.80.71.22.71.0
  ≤ 28 weeks0.40.40.70.80.7
Season of birth
  Spring24.524.624.323.824.3
  Summer 25.024.826.130.525.7
  Autumn26.426.526.025.826.0
  Winter24.024.123.619.924.0
Any mental health contact
  Yes1.51.32.66.32.2
  No 98.598.797.493.897.8
Birth defects
  Yes5.14.68.45.98.6
  No 94.995.491.694.191.4
Developmentally vulnerable/at risk (Australian Early Development Census)
  Physical health & wellbeing9.59.112.325.011.0
  Social competence6.86.68.315.67.6
  Emotional maturity8.17.710.317.69.5
  Communication skills & general knowledge7.16.79.726.67.9
  Language & cognitive skills (school-based)10.310.012.234.89.8
Area-level socioeconomic disadvantage (Index of Relative Socioeconomic Disadvantage)
  Most disadvantaged20.621.018.139.815.8
  218.118.317.417.617.3
  318.818.719.813.320.5
  419.619.420.79.821.9
  Least disadvantaged 17.117.216.42.317.9
  missing5.75.47.617.26.6
Geographic remoteness (Australian Statistical Geography Standard)
  Metropolitan 67.166.669.937.973.3
  Regional19.619.818.324.617.7
  Remote5.45.64.320.32.6
  missing8.08.17.517.26.5
Note. OM = Otitis Media. Reference group for Australian Early Development Census is ‘on-track’. 1 OM episodes defined as presentations to emergency departments or admissions to hospital where an ICD-10-AM or symptom code indicative of OM was recorded. 2 Optimum birthweight is defined by Blair et al. [23] and is based on gestational duration, fetal gender, maternal height, age, and parity. Reference group for logistic regressions.
Table 2. Proportions of children scoring below the national minimum standards on Grade 3 reading, writing, and numeracy tests.
Table 2. Proportions of children scoring below the national minimum standards on Grade 3 reading, writing, and numeracy tests.
NAPLAN Test
GroupReading, %Writing, %Numeracy, %
Whole Cohort (N = 19,262)6.63.56.6
 No OM episodes (n = 16,596)6.23.26.3
 ≥1 OM episode 1 (n = 2666)8.85.18.9
Aboriginal (N = 1492)25.721.329.2
 No OM episodes (n = 1236)24.119.427.2
 ≥1 OM episode 1 (n = 256)33.230.539.1
Non-Aboriginal (N = 17,770)5.02.04.7
 No OM episodes (n = 15,360)4.81.94.6
 ≥1 OM episode 1 (n = 2410)6.22.45.6
Note. OM = Otitis Media, NAPLAN = National Assessment Program, Literacy and Numeracy. 1 OM episodes defined as presentations to emergency departments or admissions to hospital where an ICD-10-AM or symptom code indicative of OM was recorded.
Table 3. Univariate and multivariate odds of children scoring below the national benchmarks on grade 3 numeracy, reading and writing tests associated with OM episodes.
Table 3. Univariate and multivariate odds of children scoring below the national benchmarks on grade 3 numeracy, reading and writing tests associated with OM episodes.
Univariate
ReadingWritingNumeracy
≥1 OM Episode 2OR (95% CI)pOR (95% CI)pOR (95% CI)p
Overall sample1.48 (1.26 to 1.73)0.0011.66 (1.34 to 2.06)0.0011.44 (1.23 to 1.70)0.001
Aboriginal children1.72 (1.23 to 2.41)0.0012.00 (1.42 to 2.82)0.0011.82 (1.33 to 2.49)0.001
Non-Aboriginal children1.34 (1.11 to 1.61)0.0031.31 (0.98 to 1.76)0.071.25 (1.03 to 1.53)0.030
Multivariate 1
ReadingWritingNumeracy
≥1 OM Episode 2OR (95% CI)pOR (95% CI)pOR (95% CI)p
Overall sample1.35 (1.14 to 1.59)0.0011.43 (1.13 to 1.81)0.0011.33 (1.12 to 1.58)0.001
Aboriginal children1.46 (1.02 to 2.09)0.0401.79 (1.23 to 2.60)0.0021.70 (1.22 to 2.37)0.002
Non-Aboriginal children1.31 (1.08 to 1.59)0.0071.21 (0.89 to 1.66)0.221.20 (0.98 to 1.47)0.08
Note. OM = Otitis Media, OR = Odds Ratio, CI = Confidence Interval. 1 Adjusted for child sex, English-speaking status, maternal age, paternal age, maternal marital status, parent highest education level, number of siblings, percentage of optimum birthweight, gestational age, season of birth, child mental health contacts, birth defects, developmental vulnerability/risk, neighborhood socioeconomic disadvantage, and neighborhood geographic remoteness. 2 OM episodes defined as presentations to emergency departments or admissions to hospital where an ICD-10-AM or symptom code indicative of OM was recorded.
Table 4. Univariate and multivariate odds of children scoring below the national benchmarks on Grade 3 numeracy, reading and writing tests associated with age at first OM episode and frequency of OM episodes.
Table 4. Univariate and multivariate odds of children scoring below the national benchmarks on Grade 3 numeracy, reading and writing tests associated with age at first OM episode and frequency of OM episodes.
Univariate
ReadingWritingNumeracy
≥1 OM Episode 2OR (95% CI)pOR (95% CI)pOR (95% CI)p
Age at first OM episode
  ≤1 years0.83 (0.58 to 1.20)0.320.85 (0.52 to 1.38)0.510.99 (0.70 to 1.41)0.97
  2–3 years0.97 (0.66 to 1.43)0.891.21 (0.74 to 1.98)0.450.84 (0.57 to 1.23)0.38
  ≥ 4 yearsREF REF REF
Frequency of OM episodes
  SingleREF REF REF
  Multiple1.26 (0.92 to 1.75)0.151.34 (0.88 to 2.06)0.171.09 (0.79 to 1.50)0.61
Multivariate 1
ReadingWritingNumeracy
≥1 OM episode2OR (95% CI)pOR (95% CI)pOR (95% CI)p
Age at first OM episode
  ≤1 years0.87 (0.59 to 1.27)0.460.97 (0.56 to 1.68)0.901.02 (0.70 to 1.49)0.92
  2–3 years1.09 (0.74 to 1.61)0.651.55 (0.89 to 2.68)0.120.94 (0.63 to 1.42)0.77
  ≥ 4 yearsREF REF REF
Frequency of OM episodes
  SingleREF REF REF
  Multiple1.23 (0.89 to 1.71)0.211.13 (0.70 to 1.80)0.621.01 (0.72 to 1.43)0.95
Note. Models only include children with OM episodes. OM = Otitis Media, OR = Odds Ratio, CI = Confidence Interval. 1 Adjusted for child sex, English-speaking status, maternal age, paternal age, maternal marital status, parent highest education level, number of siblings, percentage of optimum birthweight, gestational age, season of birth, child mental health contacts, birth defects, developmental vulnerability/risk, neighborhood socioeconomic disadvantage, and neighborhood geographic remoteness. 2 OM episodes defined as presentations to emergency departments or admissions to hospital where an ICD-10-AM or symptom code indicative of OM was recorded.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bell, M.F.; Lima, F.; Lehmann, D.; Glauert, R.; Moore, H.C.; Brennan-Jones, C.G. Children with Secondary Care Episodes for Otitis Media Have Poor Literacy and Numeracy Outcomes: A Data Linkage Study. Int. J. Environ. Res. Public Health 2021, 18, 10822. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph182010822

AMA Style

Bell MF, Lima F, Lehmann D, Glauert R, Moore HC, Brennan-Jones CG. Children with Secondary Care Episodes for Otitis Media Have Poor Literacy and Numeracy Outcomes: A Data Linkage Study. International Journal of Environmental Research and Public Health. 2021; 18(20):10822. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph182010822

Chicago/Turabian Style

Bell, Megan F., Fernando Lima, Deborah Lehmann, Rebecca Glauert, Hannah C. Moore, and Christopher G. Brennan-Jones. 2021. "Children with Secondary Care Episodes for Otitis Media Have Poor Literacy and Numeracy Outcomes: A Data Linkage Study" International Journal of Environmental Research and Public Health 18, no. 20: 10822. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph182010822

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop