Next Article in Journal
Making Nautical Tourism Greener in the Mediterranean
Next Article in Special Issue
Social Networks Consumption and Addiction in College Students during the COVID-19 Pandemic: Educational Approach to Responsible Use
Previous Article in Journal
The Effects of Morus alba L. Fortification on the Quality, Functional Properties and Sensory Attributes of Bread Stored under Refrigerated Conditions
Previous Article in Special Issue
Citizenship and Pluriculturalism Approaches of Teachers in the Hispanic and Japanese Contexts: Higher Education Research
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Influence of ICTs on Math Teaching–Learning Processes and Their Connection to the Digital Gender Gap

by
Ascensión Palomares-Ruiz
*,
Antonio Cebrián
,
Emilio López-Parra
and
Eduardo García-Toledano
Department of Pedagogy, Universidad de Castilla-La Mancha, Plaza de la Universidad, 3, 02071 Albacete, Spain
*
Author to whom correspondence should be addressed.
Sustainability 2020, 12(16), 6692; https://0-doi-org.brum.beds.ac.uk/10.3390/su12166692
Submission received: 19 July 2020 / Revised: 8 August 2020 / Accepted: 11 August 2020 / Published: 18 August 2020
(This article belongs to the Collection Sustainable Citizenship and Education)

Abstract

:
This study presents research aimed at analyzing whether, in contrast with traditional methodologies, the usage of information and communication technologies (ICTs) in the process of learning mathematics affects gender distinctions by affecting the low rate of matriculation of women into technological studies. The research was carried out by utilizing a quasi-experimental pretest–posttest procedure using a non-equivalent control group with traditional teaching methodology (textbook and usual drawing tools), and an experimental group, in which a classroom wiki and its digital equivalents were used in the Cabri, Geogebra, and Descartes programs. A quantifiable comparison of the effects on teaching was performed by assessing the strengths and weaknesses of employing ICTs. The results show a higher motivation in the experimental group, evident in their learning and their better marks compared to those of the control group. In addition, in the pretest and posttest, women’s marks were better than those of men. In conclusion, the transformation of the teaching–learning methodologies in mathematics is demanded with the use of programs such as Dynamic Geometry or Geogebra, which enable greater student involvement and more meaningful and relevant learning.

Graphical Abstract

1. Introduction

In 2015, the United Nations General Assembly approved the 2030 Agenda for Sustainable Development, developing 17 Goals (SDGs), also known as the Global Goals, aiming to end poverty, protect the planet, and ensure that all people enjoy prosperity, universal peace, and access to justice. They also stress that the world’s greatest challenge is poverty eradication, seeing it as a primary requirement for achieving sustainable development. Achieving these goals anywhere in the world requires creativity, knowledge, technology, and financial resources. In addition, it must be recognized that interventions in one area will affect the results of others and that development must balance environmental, economic, and social sustainability.
The importance and power of education are unquestionable, making it crucial for improving life and sustainable development [1]. It is unquestionable that quality, committed, and inclusive education is needed to form and promote a critical, conscious, and participatory educational movement that addresses the current unsustainable economic model and the serious environmental crisis from the perspective of personal responsibility and community co-responsibility [2].
Today, we are facing a global crisis caused by Covid-19, generating significant social, political, and economic changes. Unfortunately, the global health emergency has made the discrimination suffered by the most vulnerable groups visible. Therefore, more than ever, compliance with the SDGs is urgently needed, driving the commitment of the international community to building a better world. Among these goals, in this research, we focus in a coordinated and complementary way specifically on Objectives 4 and 5. Indeed, Objective 4—“ensuring inclusive and equitable quality education, and promoting lifelong learning opportunities for all”—shapes education as a key element in ensuring the future of humanity, as it is essential in promoting awareness of sustainability, critical participation, socio-environmental awareness, the transformation of the economy and society to achieve greater well-being of citizens, the sustainability of human activities, and the stability of the environment [3].
Objective 5—“achieving gender equality and empowering all women and girls”—compels us to work to eliminate inequalities between women and men, to make gender parity cross-cutting, and to make the empowerment of all girls and women an actuality [3]. Women’s access to the scientific world and, in particular, that of mathematics has not been easy. As is known, the presence of women in professions linked to the areas of science, technology, engineering, and mathematics (STEM) continues to be significantly lower than that of men [4]. This gender gap begins to be generated in the early educational stages and is consolidated in the university stage, in view of the number of women who choose STEM careers [5], which is only 35% [6], producing the most pronounced decrease in mathematics with a drop of 12% in female students between the academic years of 2005–2006 and 2015–2016 [7]. This inequality in the proportion of women studying for STEM careers is determined by the confluence of various factors, such as the maternal wall, the glass ceiling, the action in the evaluation criteria, the lack of recognition and support, and a persistent gender bias with which society remains unconsciously infected [8].
This persists in spite of the implementation of policies, programs, and funding for the promotion of gender equality in research in recent decades, which has not prevented any barriers and gender gaps in the field of scientific research from continuing to exist [8].
Climate change, social conflict, and migration affect women even more. Rationally, it is imperative to guarantee women equal rights, fostering their entrepreneurship and leadership in order to make them leaders and achieve real gender equality. It must be acknowledged that, although the number of women in the labor market is rising, we are faced with many labor and social inequalities. In this sense, it can be pointed out that, in Spain, in the field of science and research, there are still obvious gender inequalities in research careers, in the governing bodies, and even in the calls for R&D&I grants, which is a situation for women far removed from that which is really desirable [9]. Violence and sexual exploitation, inequality at work, and discrimination in decision-making must also be overcome.
Consistently with the situation analyzed, investigating and making great women scientists and mathematicians would be not an easy task, since science and history have made their names and contributions invisible; this lack of recognition has generated the misconception that women cannot engage in science or, at best, as efficiently as men do [8]. The concealment of women scientists is permanent in our society and in text manuals, hiding many women who have contributed significant knowledge; they are relegated to being silenced and discriminated against. However, thanks to new research, such as that presented in this article, the need to eliminate sexist stereotypes and to work for equality as a basic objective is claimed, as demanded in SDG No. 5.
In the educational field, in the face of the challenging situation caused by the health alert, rapid and innovative responses have emerged, such as the program designed by the Chinese administration, “School’s Out, But Class’s On”, carrying out a transformation of its educational model that has affected some 270 million non-university students [10]. Likewise, in all countries and at various educational levels, surprising innovation has been made in teaching–learning processes with the transformation of face-to-face education into connected education, promoting the individualization and personalization of teaching by adapting to and coordinating the particularities of digital tools with the actual conditions and requirements of the students.
In this socio-educational context, our work aims to improve the use of technology and, especially, information and communications technologies to promote the empowerment and leadership of women and girls [2]. In the like, there has also been much research that shows the causes of cultural differences between genders to lead to lower enrolment of women in technical careers [11,12] as well as the decline of their presence, in the last two decades [13,14,15].
Various research concludes that technology and computers have historically been considered to be pre-eminently male tools [16,17,18,19,20]. Likewise, in their leisure, women and girls use video games less, despite their influence on the use of technology [17,21,22,23,24,25,26]. It is reasonably appreciated that the digital gender gap can be connected to the meager matriculation of women in technological studies. If we focus on Spain and the allotment of undergraduates in tertiary education by area of study and gender, it can be perceived that women choose mostly careers related to education, health, and the services sector. However, men are guided by technical, engineering, and computer careers where women barely reach 10% (Table 1 and Figure 1) [27].
As noted, this research was conducted with the aim of improving the use of technology and, in particular, information and communications technologies to promote the empowerment and leadership of women and girls, focusing on the teaching–learning processes of Mathematics, versus more traditional methods. So as to confirm, using inferential statistical exploration, the aim of the investigation, a Didactic Unit (UD) of the Geometry block (Triangles) was created for the students of First Compulsory Secondary Education (ESO) of an high school (IES) of Albacete capital in the autonomous community of Castilla-La Mancha in Spain. In the control group, the UD was worked with the textbook and the usual drawing instruments such as a ruler, square, chart, and compass; while, in the experimental group, a classroom wiki with its digital equivalents was used in the Cabri, Geogebra, and Descartes programs.

2. Materials and Methods

Efforts were made to establish causative liaisons among the variables concerned in the research, so a quantitative approach with a quasi-experimental strategy was utilized, seeking to understand the magnitude to which the alterations logged in dependent variables were the result of handling on the independent variable, applying inferential statistical procedures. In addition, it was intended that the conditions in which the study was developed were similar to those noted in the usual leaning of the Mathematics course in First ESO of the Institute, in which the research was carried out. Similarly, considering that the decision could reduce the external validity of the research, participants were not assigned randomly, but two groups of students already constituted were selected. In addition, in order to guarantee the internal validity of the research and to ensure that there were no starting differences between the experimental group and control group that might alter the outcomes, a pretest was built to confirm that the averages between both groups were comparable. Another feature that was required to be controlled was the effect of teacher instruction involvement in the two groups, so it was decided that they would have the same teacher, in order to be able to diminish it.
The research was implemented applying a pretest–posttest quasi-experimental approach using a non-equivalent control group. Furthermore, since the interval of time between the termination of the posttest and pretest was 6 weeks, it was thought that the “learning effect” was not significant.

2.1. Variables Involved In the Study

The dichotomous qualitative independent variable was:
  • The working method, which took two values: S (UD-TIC) and N (traditional UD).
The other independent dichotomous variable that was incorporated in the study was:
  • Gender (GEN), which took two values: male (H) and female (M).
The continuous quantitative dependent variable was:
  • The academic achievement of students in the posttest (POS) and the pretest (PRE). A new variable named amelioration (MEJ) was defined to estimate each participant’s progress between the mark achieved in the posttest and the mark reached in the pretest.
Likewise, other potential external variables were considered that might disturb the investigation’s results and were minimized by the chosen strategy. Therefore, it was considered that the teacher of the experimental and control groups was identical and so the unique difference in the teaching between the groups was the usage of an ICT method in the Didactic Unit explained in the experimental group, whereas in the control group, a traditional methodology focused on the textbook and the usual drawing instruments such as a ruler, square, chart, and compass was used in the UD.

2.2. Population and Sample

The population of the investigation was composed of the students of first course of Compulsory Secondary Education (ESO) of an institute in the city of Albacete in the autonomous community of Castilla-La Mancha in Spain, which had a size of 148 participants. Of the 6 existing groups, in 5 of them (A, B, C, E, and F), the subject of Mathematics was taught by the same teacher and participated in the research, whereas in one of the groups (D), the subject was taught by another teacher and did not participate in the research. Two groups were selected randomly for the control group (B, C, and E), and the other A groups (A and F) were assigned to the experimental group.
As can be seen in Table 2, the sample contained 123 students, 52 in the experimental group and 71 in the control group. The students were already assigned in groups before the investigation, so they were not randomized, and consequently, the groups were not equivalent. However, these conditions were not significant since the main aim of the investigation was not to generalize the conclusions but to analyze and comprehend the possible relation between the study variables.

2.3. Measurement of Dependent Variables. Instruments Collected Data

This research developed its own instrument to measure the geometric competence of the students that constituted the sample. The test used as a pretest and posttest to measure dependent variables consisted of 25 items, 4 of them taken from the items from the international study TEDS-M (Teacher Education Study in Mathematics) On the other hand, the 8 items relating to Geometry were obtained from a study designed to measure mathematical competence and that is considered by the educational community as valid and reliable [28]. To systematize the results with the usual weights in the ESO from 0 to 10 points, it was determined that each of the 25 items in the test would be valued at 0.4 points. Link to the evaluation tool at Google Docs [29].

2.4. Test Reliability Analysis

The reliability of the items obtained from the TEDS-M study is already proven [30]. However, it is necessary to analyze the internal consistency of the test to which 21 own-made items have been added.
To analyze reliability in terms of the accuracy and stability of the data, it was decided to use the Cronbach’s Alpha method, estimated through the data obtained when the survey was carried out in the sample investigated. In Table 3 can be seen the results; in the pretest PRE (.77), they are very close to 0.80, and in the posttest POS (0.87), they are greater than 0.80, implying very high reliability; subsequently, the test can be assumed to be internally consistent. In addition, the homogeneity of the survey was examined by testing the item-total correlation, and it was found that the erasure of any of the items significantly increased the Cronbach’s Alpha.

2.5. Educational Intervention

The research intended that the educational intervention in the experimental group was analogous to that in the control group. As previously commented, it was contemplated that the teacher should be the identical in all the groups that participated in the investigation, with the intention that the teaching, in all groups, was as equivalent as achievable. It was managed that the only modification was the usage of an ICT method in the experimental group and a more traditional method centered basically on the textbook and the usual drawing instruments such as a ruler, square, chart, and compass, in the control group. The rest of the teaching methods were analogous in all groups: running comparable content, implementing equal teaching activities, and developing analogous assessment tests. An active strategy was utilized while sustaining the pedagogical principles of collaborative, cooperative, and self-directed work, increasing critical thinking through conversations and discussions that stimulated active involvement. The problem-solving method was also used by encouraging students to seek to resolve them and explain to their peers the resolution processes used, using appropriate and participatory language in the discussion of possible resolution procedures. The teacher, at all times, sought to guide, encourage, and motivate students, using various material and virtual resources, adequately considering attention to diversity with reinforcement and expansion activities.
It should be noted that, for the correct learning of Geometry, students must experience the properties and relationships of geometric objects regardless of the position they occupy in space or the plane. The static teaching of Geometry has, for many years, been the most applied traditional method with the use of the chalk or pencil and paper as unique teaching resources, reinforcing false beliefs of the students about the shapes of the figures linked to the position they occupy in space or the plane [31]. All this justifies, as have been chosen for the UD-ICT, materials that are digitally manageable, allowing the displacement of the figures, which allows students to check the properties that remain unchanged despite virtual translations and movement, avoiding the association between solids or flat figures and their positions in space or planes.

2.6. Description of the UD-TIC (Triangles)

It was decided to exploit the many possibilities offered by the Internet and ICT through the development of a wiki for the creation of a Didactic Unit (UD) based on the use of ICT (UD-TIC) of the Geometry block (Triangles) of First Secondary Education, in which the problems that the students had to work autonomously, both in class under the control of the teacher and at home for the activities of extension and reinforcement, were able to be completed with an exchange information between the students and the teacher through the internal mail of the wiki, for which most students opted, with the discussion forum being less used.
Importantly, the use of new technologies does not imply the abandonment of traditional paper drawing instruments that students should also have used in a complementary way and handed over to their teacher (digitally or by hand) as part of the process of the continuous evaluation of the unit. For some parts of the unit, it was necessary for the students to handle with ease the usual drawing instruments: a ruler, square, letter, and compass and their digital equivalents in the Cabri, Geogebra, and Descartes programs—computer applications with tools to perform geometric constructions and that allow the visualization of all the elements of the flat geometry, allowing the student to better strengthen the concepts learned in the UD-ICT.
As the UD-TIC was raised through a wiki on which students had to work and solve the proposed activities, the use of the Internet and some digital tools such as browsers and, in particular, minimal training in the use of applications designed with Geogebra became indispensable. In the UD-TIC, rectangle triangles had to be drawn, so it was necessary for the participants to be able to draw perpendicular lines and draw triangles knowing some data, with traditional drawing instruments and Geogebra tools, which required a previous first-session instruction process in the experimental group.
The UD-TIC was divided into 10 sessions, the first 7 sessions being dedicated to the students working on and discovering the properties of the triangles, through the proposal of a series of activities with computer applications taken from the repositories of the Institute of Educational Technology (ITE) through the Gauss, Descartes, and Geogebra projects. Session 8 was dedicated entirely to summarizing and synthesizing all the concepts learned. In Session 9, the evaluation of the unit was carried out; the first self-assessment activities were introduced and completed with a questionnaire that students had to complete and forward to the teacher. Session 10 was dedicated to the introduction of the integrated activity that was also being worked on in the other subjects involved. All sessions started with a motivating activity that was a 2 or 3-min video, getting the participants started with the activities they were going to engage in. For all the videos, the students had to summarize them and submit their summaries through GDocs/Moodle. All the activities raised in the wiki followed the model of the 5 learning phases of Van Hiele: information, targeted guidance, explicitation, free guidance, and integration [32].
For the evaluation of the Didactic Unit (UD), numerous self-assessment activities were included, throughout the first 7 sessions and especially in Review Session 8 and Evaluation 9. In addition, 4 forms were designed in Gdocs/Moodle—a generic one where students could summarize the main ideas of each of the videos with which each of the first 8 sessions began, another generic one where they could answer the questions that appeared in the activities posed by the Gauss Project, and two other evaluation activities included at the end of the UD by relating each question to the evaluation criteria. All forms had to be sent by the students to the teacher, who received them in the form of a table with the name of each student, the date of completion, and the answers to each question. Link to UD-TIC (Triangles): [33].

3. Results

Performing a descriptive analysis of the data provided by the test to measure geometric competences and an inferential analysis will allow us to be able to answer the question that had been established as the main hypothesis of the research.

3.1. Descriptive Analysis

Table 4 and Table 5, as well as Figure 2, Figure 3 and Figure 4, provide a descriptive analysis of the qualifications obtained by students in the geometric knowledge test with respect to the gender variable (GEN). This test was carried out both pretest and posttest, thus providing two measurements from each student: one in the month of March, when the educational intervention had not yet been developed, and the other corresponding to the month of May after the educational intervention. An amelioration variable (MEJ) was defined that measured the advances in each student’s mark in the geometric knowledge test, corresponding to the difference between the mark obtained in the posttest and the mark obtained in the pretest. The variable (MEJ) could take values between −10 and 10, since 10 was the maximum mark for that test. In the research, in fact, values between 0 and 5 were taken.
No data were lost from the initial sample of students who made up the control group and the experimental group because, in case of absence in any of the sessions where the tests were performed (pretest or posttest) in the reference group, a participant was tested another day in another group.
From the analysis of the data obtained, it can be observed that:
(a)
Women, in the pretest, obtain an average of 0.754 points more than men, with a greater dispersion and a median of 1 point more than men.
(b)
In posttest, women have an average of 0.878 points more than men, with a higher dispersion and a median of 1.45 points more than men.
(c)
Women, in the variable amelioration, achieve an average of 0.124 points more than men, with a similar dispersion and a median of 0.1 points more than men.
(d)
The two genders improve after the application of the UD; however, the average improvement for women is higher by 0.124 points than that for men with a similar dispersion.

3.2. Inferential Analysis

The inferential statistical techniques used included the Kolmogorov–Smirnov normality proof, with the Lilliefors correction, to guarantee the normality prerequisite in the application of parametric techniques. The Levene proof was additionally employed to confirm the homoscedasticity in the contrast of the variances. The normalization can be seen in the Q-Q charts in Figure 5, as the points in the normal Q-Q diagram conform to the diagonal and the points of the normal Q-Q diagram without trend are randomly distributed without showing a clear pattern.
To answer to the investigation inquiry, it was tested if the null hypothesis might be excluded. H0: Mc-Me = 0, where Me and Mc, were the corresponding sample averages of the marks achieved by the students in control and experimental groups. We verified by means of statistical proof that the null hypothesis could be excluded, showing that were verified significant dissimilarities between the groups compared [34]. Moreover, the grade of significance was established, which denotes the probability of error that would be expected in refuting the null hypothesis. As is common in educational investigation, a p-significance value of 0.05 was accepted. The ANOVA proof multivariate general linear model with the SPSS 24 statistical package was utilized for the comparison of averages between independent samples.
In the ANOVA proof for one independent sample factor with regard to the ICT-independent variable, such as can be appreciated in Table 6, the significance value in the pretest (0.152) is greater than 0.05, so those averages can be considered similar for the selected confidence tier of 95%, so the null hypothesis of the likeness of averages H0: Mc-Me = 0 is accepted and the H1 alternative hypothesis of dissimilarity of the averages between the experimental group and control group is rejected. However, both in the posttest (0.005) and with respect to the amelioration variable (0.000), at the significance level of less than 0.05, the null hypothesis of the likeness of the averages H0: Mc = Me must be rejected, and the alternative hypothesis H1 of a difference of the averages between the experimental group and control group is accepted. With regard to the variable gender (GEN) the significance values in both the pretest (0.012) and posttest (0.025) are less than 0.05; the marks of women are higher than men’s, both in pretest and posttest, and there are statistically significant gender differences. The same is not true of the amelioration variable (MEJ), which, with its significance value (0.226) being greater than 0.05, cannot be assumed to be statistically different.

4. Discussion

Similar averages were obtained, not factoring in this statistically significant dissimilarity, as was foreseeable, in the pretest in the experimental group (2.492) and the control group (2.887). In the posttest, the experimental group, consisting of class groups 1A and 1F, achieved an average of 4.956, better than that of the control group 3.807, comprising class groups 1B, 1C, and 1E; this dissimilarity is statistically significant, which makes it possible to positively answer the investigation question.
It is important to stress that women obtained, in the pretest, an average score of 3.106, higher than that of men at 2.352, and, in the posttest, an average score of 4.814, higher than that of men at 3.936—this being a statistically significant difference in academic performance; nevertheless, the improvement for women (1.708) was slightly higher than that of men (1.584), this difference not being statistically significant, which permits us to guess an incipient digital gender gap that is supported by Eurostat data [27] showing that girls have more difficulties than boys in expertly handling ICT, which is likely to be one of the reasons that will lead them to decline in the future for studies linked to health, education, and services.
Scenarios such as the global health emergency, COVID-19, have highlighted the need for a transformation from face-to-face education to connected education, highlighting the necessity for a transformation in the educational paradigm in which women overcome obstacles in the expert handling of ICT. Thus, it is essential and urgent, in line with the SDGs, that public administrations, with the implementation of the appropriate equity strategies, guarantee that any change in alarm situations does not involve a new handicap for students and women with difficulties in internet access.

5. Conclusions

Recent investigations show that the first digital gender gap is beginning to vanish, with a trend to equalization of the number of ICT handlers of the two genders [35,36]; nevertheless, in today’s society, the second digital gender gap [16,37,38] continues to be present, caused by gender differences in skills that facilitate the expert use of ICT, demonstrating some influence in that there are only 17% women enrolled in Computer Engineering in Europe [39,40].
The problem is esteemed to be the consequence of some social praxis that promotes a scarce inclination of females for technology, as well as male supremacy in the fields of work where innovative technologies are acquired [35,36,37].
The findings of the study suggest that it would be beneficial to design further encouraging backgrounds for girls and females by spreading feminine examples in the area of technology, in order to stimulate, among the teachers of the initial levels of education, the achievement of training activities designed at enhance the teaching–learning processes reinforced by new technologies [41,42,43,44,45].
In this regard, it should also be highlighted that, even though the management of devices as a communication tool and relation is actually adequate among girls and boys, according to the outcomes found in other research [46,47,48,49,50], it is not evolving similarly to the usage of technological leisureliness, as in the field of electronic games. It is therefore necessary to consider that abundant research connects the digital gender gap to girls’ unlikely usage of electronic games, leading to a reduction in females’ educational and professional chances [21,49,51].
It should be highlighted, given the misperception in this regard, that in order for an educational paradigm modification [52], the phase of the “incorporation” of emergent technologies with conventional schooling organizations must be carefully considered, as should innovative pedagogies supported by theories such as constructivism, cognitivism, meaningful learning, etc., as well as other newly developed ideas resulting from the arrival of the Internet and the web—such as rhizomatic learning, self-regulated learning, peer learning, connectivism, LaaN theory, etc.—that, on many occasions, have not finished transforming traditional educational practices and that, in the present condition, can expedite the renovation of the pattern of education in the schoolroom, focusing on learning instead of teaching and on the student as an alive subject of their learning [10,53,54].
The spread of girls and women in the use of new technologies and technological studies has been studied to ease the eradication of discrimination they have endured throughout history and satisfy the universalization of human rights and the aims of education for sustainability. Certainly, girls and women will have superior representation and participation in all political and social areas, with more comprehensive preparation, without gender inequity. Arguably, education for sustainable citizenship requires that gender inequalities are eradicated from all spheres of society, an essential prerequisite for progressing science, education, and political and social organizations. Consequently, we face a challenge to achieve sustainable citizenship, promoting the use of information and communications technologies, advancing the elimination of discriminations between males and females, and realizing gender-equal opportunity and the encouragement of all girls and women everywhere in the world.
More than one and a half million schoolchildren of all ages have suffered the devastating effects of the COVID-19 pandemic; the lack of planning in all countries will bring consequences of very difficult recovery in various areas such as education, nutrition, gender equality, etc. That is why we are facing a crucial moment at the global level, when no more time can be wasted on useless disquisitions and action must be taken immediately if decades of progress are not to be reversed.
As indicated by the health emergency, large inequalities in education and gender equality have been highlighted, aggravating the prolonged closure of nurseries and schools at all levels of education, including universities.
There is no doubt that we are faced with a worldwide problem so far imaginable, where respect and compliance with human rights, imagination, and creativity are not only needed but also necessitate a clear commitment by all administrations to education by substantially increasing budgetary allocations. Indeed, education must be the center and a basic pillar of solidarity and investment for development and continue on the right path to advance the SDGs. This requires the adoption of literacy and digital infrastructure, eliminating the digital gender gap and inequalities in access to inclusive, resilient, and quality education, without discrimination [55].
We agree with the research carried out on the need for an inclusive and ecological education that instills knowledge, attitudes, and competences based on the critical spirit, responsibility, and commitment to the construction of a better world, accepting the challenge of moving towards a culture from co-responsibility for sustainable development [2].
In this sense, we have focused on Article 4 and Article 5 of the Sustainable Development Goals (SDGs), proving that empowering women has a multiplier effect that promotes economic growth and development globally. It is therefore essential to undermine any form of discrimination against women and girls if the Sustainable Development Goals (SDGs) are really to become a fact around the world.
As a final conclusion, our concern must be highlighted in the face of the world’s involution in the implementation of the SDGs. Indeed, in 2020, there has been stagnation and a decline in some areas due to the COVID-19 pandemic, threatening many of the achievements and even decades of progress. With regard to SDG number 4, on which we have reflected in this work, it is highlighted that the pandemic has caused great damage—leading to the closure of many schools, leaving some 1500 million students (90%) out of school [56]—and evidenced a large digital gap between students from the most vulnerable and disadvantaged groups and societies. Logically, the digital gap has widened the differences in equality in education. However, focusing on objective number 5, there are significant improvements, especially in the world of work, with an increased representation of women in parliaments and a progressive increase in their presence in managerial positions. Similarly, despite being still about 7 points lower than that for men [56], women’s empowerment through mobile telephony has been shown to accelerate social and economic development, reinforcing our approach to the need to improve women’s training in the domain of information and communication technologies, reducing the digital gender gap.

6. Limitations and Future Lines of Research

As the most significant limitation of the investigation implemented, it is worth highlighting the small sample size. Aware of this and assessing the importance of the subject studied, new work has been initiated and the sample has been expanded with other groups and different contexts. Researchers who have participated in this study have adequately assessed the effects on gender equality of new changes in methodologies being introduced in face-to-face education, including online preparation courses, and the proliferation of uses and technological instruments.

Author Contributions

Methodology, A.P.-R. and A.C.; conceptualization, A.P.-R. and E.L.-P.; investigation, A.C. and E.L.-P.; validation, A.C., E.G.-T. and E.L.-P.; formal analysis, A.P.R., A.C. and E.G.-T.; supervision, A.P.-R. and E.G.-T; review and editing, A.P.-R. and E.L.-P.; data curation, E.G.-T., A.C. and E.L.-P.; funding acquisition, A.P.-R. and E.G.-T. All authors have read and agree to the published version of the manuscript.

Funding

Support was received from the Scientific Research and Technology Transfer Project (SBPLY/000149) funded by the Ministry of Education, Culture of JCCM and European Regional Development Funds (ERDF).

Acknowledgments

The authors express gratitude to the financial and educational organizations, and the students and teachers, for their voluntary participation in the research.

Conflicts of Interest

The authors declare that they have no conflict of interest.

Research with Human Participants

This study is part of the doctoral research of the second author, led by the first author.

Informed Consent

Informed consent was obtained from all individual participants included in the research.

References

  1. Delors, J. La Educación Encierra un Tesoro. Informe a la UNESCO de la Comisión Internacional Sobre la Educación Para el Siglo XXI; Santillana-UNESCO: Madrid, Spain, 1996. [Google Scholar]
  2. Palomares-Ruiz, A. Investigación y Respuestas Socioeducativas del Profesorado en el Siglo XXI; Síntesis: Madrid, Spain, 2020. [Google Scholar]
  3. UN General Assembly. Transforming our World: The 2030 Agenda for Sustainable Development. 2015. Available online: http://www.un.org/ga/search/view_doc.asp?symbol=A/RES/70/1&Lang=E (accessed on 22 September 2019).
  4. Organization for Economic Cooperation and Development. The ABC of Gender Equality in Education: Aptitude, Behaviour, Confidence; OECD Publishing: Paris, France, 2015. [Google Scholar] [CrossRef] [Green Version]
  5. García-Holgado, A.; Camacho, A.; García-Peñalvo, F.J. La brecha de género en el sector STEM en América Latina: Una propuesta europea. In Actas del V Congreso Internacional Sobre Aprendizaje, Innovación y Competitividad; CINAIC, [online], Madrid, Spain, 9–11 October 2019; Sein-Echaluce, M.L., Fidalgo, A., García-Peñalvo, F.J., Eds.; Servicio de Publicaciones Universidad de Zaragoza: Zaragoza, Spain, 2019; pp. 704–709. [Google Scholar] [CrossRef] [Green Version]
  6. United Nations Educational, Scientific and Cultural. Cracking the Code: Girls’ and Women’s Education in Science, Technology, Engineering and Mathematics (STEM); UNESCO: Paris, France, 2017; Available online: https://unesdoc.unesco.org/ark:/48223/pf0000253479 (accessed on 22 October 2019).
  7. Mateos, S.; Gómez, C. Libro Blanco de las Mujeres en el Ambito Tecnológico; Secretaría de Estado para el Avance Digital, Ministerio de Economía y Empresa: Madrid, Spain, 2019; Available online: https://www.mineco.gob.es/stfls/mineco/ministerio/ficheros/libreria/LibroBlancoFINAL.pdf (accessed on 22 October 2019).
  8. Huyer, S. Is the Gender Gap Narrowing in Science and Engineering? Unesco Science Report: Towards 2030; UNESCO Publishing: Paris, France, 2015. [Google Scholar]
  9. Unidad de Mujer y Ciencia de la Secretaría de Estado de Universidades, Investigación, Desarrollo e Innovación. Científicas en Cifras 2017. Estadísticas e Indicadores de la (Des)Igualdad de Género en la Formación y Profesión Científica; Ministerio de Ciencia, Innovación y Universidades: Madrid, Spain, 2018; Available online: https://www.ciencia.gob.es/stfls/MICINN/Ministerio/FICHEROS/UMYC/Cientificas_cifras_2017.pdf (accessed on 5 November 2019).
  10. Zhou, L.; Li, F.; Wu, S.; Zhou, M. “School’s Out, But Class’s On”, The largest online education in the world today: Taking China’s Practical Exploration During The COVID-19 epidemic prevention and control as an example. Best Evid. Chin. Edu. 2020, 4, 501–519. [Google Scholar] [CrossRef]
  11. Sáinz, M.; López-Sáez, M. Gender differences in computer attitudes and the choice of technology-related occupations in a sample of secondary students in Spain. Comput. Educ. 2010, 54, 578–587. [Google Scholar] [CrossRef]
  12. Sanz, V. Women and computer engineering: The case of the school of computer science at the technical university of Madrid. Arbor 2008, 184, 905–915. [Google Scholar] [CrossRef] [Green Version]
  13. Burrelli, J. Thirty-Three Years of Women in S&E Faculty Positions. National Science Foundation Positions (NSF 08-308); National Science Foundation: Washington, DC, USA, 2008. [Google Scholar]
  14. Carlson, S. Wanted: Female computer scientists. Chron. High. Ed. 2006, 52, 35–38. [Google Scholar]
  15. Porter, L.V.; Sallot, L.M. The internet and public relations: Investigating practitioners’ roles and world wide web use. J. Mass Commun. Q. 2003, 80, 603–622. [Google Scholar] [CrossRef]
  16. Castaño, C.; González, A.M. La disparidad entre la participación y la posición de las mujeres en la investigación TIC: El caso del Plan Nacional de I+D+i. Revista Madri+ d 2008, 21, 118–126. [Google Scholar]
  17. Gil-Juárez, A.; Feliu, J.; González, A.V. Performatividad tecnológica de género: Explorando la brecha digital en el mundo del videojuego. Quad. Psicol. 2010, 12, 209–226. [Google Scholar] [CrossRef]
  18. Gil-Juárez, A.; Vitores, A.; Feliu, J.; Vall-Llovera, M. Brecha digital de género: Una revisión y una propuesta. Ed. Knowl. Soc. 2011, 12, 25–53. [Google Scholar] [CrossRef]
  19. Gil-Juárez, A.; Feliu, J.; Vitores, A. Género y TIC: En torno a la brecha digital de género. Athenea Digit. 2012, 12, 3–9. [Google Scholar] [CrossRef] [Green Version]
  20. Kekelis, L.S.; Ancheta, R.W.; Heber, E. Hurdles in the pipeline: Girls and technology careers. Front. J. Women Stud. 2005, 26, 99–109. [Google Scholar] [CrossRef]
  21. Beavis, C.; Charles, C. Would the ‘real’ girl gamer please stand up? Gender, LAN cafés and the reformulation of the ‘girl’ gamer. Gend. Ed. 2007, 19, 691–705. [Google Scholar] [CrossRef]
  22. Margolis, J.; Fisher, A. Unlocking the Clubhouse. Women in Computing; MIT Press: Cambridge, UK, 2002. [Google Scholar]
  23. Royse, P.; Lee, J.; Undrahbuyan, B.; Hopson, M.; Consalvo, M. Women and games: Technologies of the gendered self. New Media Soc. 2007, 9, 555–576. [Google Scholar] [CrossRef]
  24. Schott, G.R.; Horrell, K.R. Girl gamers and their relationship with the gaming culture. Convergence 2000, 6, 36–53. [Google Scholar] [CrossRef]
  25. Thornham, H. “It’s a boy thing”: Gaming, gender and geeks. Fem. Media Stud. 2008, 8, 127–142. [Google Scholar] [CrossRef]
  26. Walkerdine, V. Playing the game: Young girls performing feminity in video game play. Fem. Media Stud. 2006, 6, 519–537. [Google Scholar] [CrossRef]
  27. Eurostat. Students Enrolled in Tertiary Education by Education Level, Programme Orientation, Sex and Field of Education. Available online: https://ec.europa.eu/eurostat/data/database?node_code=educ_uoe_enrt03 (accessed on 6 November 2019).
  28. Schimdt, W.H.; Tatto, M.T.; Bankov, K.; Blömeke, S.; Cedillo, T.; Cogan, L.; Han, S.; Houang, R.; Hsieh, F.J.; Paine, L.; et al. The Preparation Gap: Teacher Education for Middle School Mathematics in Six Countries; Center for Research in Mathematics and Science Education: Michigan, MI, USA, 2007. [Google Scholar]
  29. The Evaluation Tool at Google Docs. Available online: https://docs.google.com/forms/d/e/1FAIpQLSfLdi8hCrGoIUGKniMPUYNvT_QYZayEBnreMSRQo72y99psRg/viewform (accessed on 18 August 2020).
  30. Tatto, M.T. The Teacher Education and Development Study in Mathematics (TEDS-M): Policy, Practice, and Readiness to Teach Primary and Secondary Mathematics in 17 Countries; Technical Report; International Association for the Evaluation of Educational Achievement: Amsterdam, The Netherlands, 2013; TEDS-M Spain Is https://www.ugr.es/~tedsm/; Released Items Are Available online: http://www.ugr.es/~tedsm/resources/Informes/Result_Viejo/PrimariaItemsLiberados.pdf; (accessed on 18 August 2020). [Google Scholar]
  31. Ruiz, N. GeoGebra workshop for the initial teacher training in primary education. Int. J. Technol. Math. Educ. 2011, 18, 183–188. [Google Scholar]
  32. Corberán, R.; Gutiérrez, A.; Huerta, M.P.; Jaime, A.; Bautista, J.; Peñas, A.; Ruiz, E. Diseño y Evaluación de una Propuesta Curricular de Aprendizaje de la Geometría en Enseñanza Secundaria Basada en el Modelo de razonamiento de Van Hiele; Ministerio de Educación y Ciencia: Madrid, Spain, 1994. [Google Scholar]
  33. UD-TIC (Triangles). Available online: https://drive.google.com/file/d/1YtN0chJLq0fe3cv4EO9gtw376beuQ-Zu/view?usp=sharing (accessed on 18 August 2020).
  34. Bisquerra, R. Metodología de la Investigación Educativa; La Muralla: Madrid, Spain, 2004. [Google Scholar]
  35. Booth, S.; Goodman, S.; Kirkup, G. Gender Differences in Learning and Working with Technology: Social Constructs and Cultural Contexts; IGI Global: Hershey, PA, USA, 2010. [Google Scholar]
  36. Brynin, M. The Neutered Computer. In Computers, Phones and the Internet; Kraut, R., Brynin, M., Kiesler, S., Eds.; Oxford University Press US: Oxford, UK, 2006; pp. 84–96. [Google Scholar]
  37. Castaño, C. La Segunda Brecha Digital; Ediciones Càtedra: Madrid, Spain, 2008. [Google Scholar]
  38. Trauth, E.M.; Nielsen, S.H.; von Hellens, L.A. Explaining the IT gender gap: Australian stories for the new millennium. J. Res. Pract. Inf. Technol. 2003, 35, 7–20. [Google Scholar]
  39. Black, S.E.; Jameson, J.; Komoss, R.; Meehan, A.; Numerico, T. Women in computing: A European and international perspective. In Proceedings of the 3rd European Symposium on Gender & ICT: Working for Change, Manchester, UK, 1 February 2005. [Google Scholar]
  40. Turner, S.V.; Brent, P.W.; Pecora, N. Why Women Choose Information Technology Careers: Educational, Social, and Familial Influences; Annual Educational Research Association: New Orleans, WA, USA, 2002. [Google Scholar]
  41. Adya, M.; Kaiser, K.M. Early determinants of women in the IT workforce: A model of girls’ career choices. Inf. Technol. People 2005, 18, 230–259. [Google Scholar] [CrossRef] [Green Version]
  42. Ahuja, M.K. Women in the information technology profession: A literature review, synthesis, and research agenda. Eur. J. Inf. Syst. 2002, 11, 20–34. [Google Scholar] [CrossRef]
  43. Beise, C.; Myers, M.; VanBrackle, L.; Chevli-Saroq, N. An examination of age, race, and sex as predictors of success in the first programming course. J. Inform. Educ. Res. 2003, 5, 51–64. [Google Scholar]
  44. Chinn, D.; Vandegrift, T. Gender and diversity in hiring software professionals: What do students say? In Proceedings of the Fourth International Workshop on Computing Education Research, ICER’08, Sidney, Australia, 6–7 September 2008; Association for Computing Machinery: New York, NY, USA, 2008; pp. 39–50. [Google Scholar]
  45. Clegg, S.; Trayhurn, D. Gender and computing: Not the same old problem. Br. Educ. Res. J. 2000, 26, 75–89. [Google Scholar] [CrossRef]
  46. Cuny, J.; Aspray, W. Recruitment and Retention of Women Graduate Students in Computer Science and Engineering; Computing Research Association: Washington, DC, USA, 2000. [Google Scholar]
  47. Galpin, V. Women in computing around the world. ACM Sigcse Bull. 2002, 34, 94–100. [Google Scholar] [CrossRef]
  48. Hayes, E. Girls, gaming, and trajectories of technological expertise. In Beyond Barbie and Mortal Kombat: New Perspectives on Gender and Gaming; Kafai, Y., Heeter, C., Denner, J., Sun, J., Eds.; MIT Press: Cambridge, UK, 2008; pp. 217–229. [Google Scholar]
  49. Jenson, J.; De Castell, S. Her own boss: Gender and the pursuit of incompetent play. In Changing Views: Worlds in Play, Proceedings of Digital Games Research Association Conference, University of Vancouver, Vancouver, BC, Canada, 16–20 January 2005; University of Vancouver: Vancouver, BC, Canada, 2005. [Google Scholar]
  50. Roberts, D.F.; Foehr, U.G.; Rideout, V.J. Generation M: Media in the Lives of 8–18-Year Olds; Kaiser Family Foundation Study: Menlo Park, CA, USA, 2005. [Google Scholar]
  51. Jenson, J.; De Castell, S. Gender, simulation and gaming: Research review and redirections. Simul. Gaming 2010, 41, 51–71. [Google Scholar] [CrossRef] [Green Version]
  52. Wang, Z.; Wu, Y.; Liu, S. Online Learn-ing Promotes Teaching Model Reform. Chin. Edu. Dly. 2020, 2–22. Available online: http://www.chinadaily.com.cn/edu/index.html (accessed on 27 March 2020).
  53. Badia, A.; Meneses, J.; Sigalés, C. Percepción de los docentes sobre los factores que afectan al uso educativo de las TIC en el aula equipada de tecnología. Electron. J. Res. Educ. Psychol. 2013, 11, 787–808. [Google Scholar] [CrossRef] [Green Version]
  54. Guitert, M.; Romeu, T.; Pérez-Mateo, M. Competencias TIC y trabajo en equipo en entornos virtuales. RUSC 2007, 4, 1–12. [Google Scholar] [CrossRef]
  55. Sachs, J.; Schmidt-Traub, G.; Kroll, C.; Lafortune, G.; Fuller, G.; Woelm, F. The Sustainable Development Goals and COVID-19. Sustainable Development Report 2020; Cambridge University Press: Cambridge, UK, 2020; Available online: https://s3.amazonaws.com/sustainabledevelopment.report/2020/2020_sustainable_development_report.pdf (accessed on 12 August 2020).
  56. UN Economic and Social Council. Progress towards the Sustainable Development Goals. Report of the Secretary-General. 2020. Available online: https://unstats.un.org/sdgs/files/report/2020/secretary-general-sdg-report-2020--EN.pdf (accessed on 12 August 2020).
Figure 1. Students matriculated in Spain in tertiary education. Source: own elaboration adjusted from Eurostat [27].
Figure 1. Students matriculated in Spain in tertiary education. Source: own elaboration adjusted from Eurostat [27].
Sustainability 12 06692 g001
Figure 2. Trend chart of the amelioration variable MEJ over the gender variable GEN (results ordered from highest to lowest).
Figure 2. Trend chart of the amelioration variable MEJ over the gender variable GEN (results ordered from highest to lowest).
Sustainability 12 06692 g002
Figure 3. Histograms and interaction diagram of the amelioration variable MEJ over the gender variable GEN.
Figure 3. Histograms and interaction diagram of the amelioration variable MEJ over the gender variable GEN.
Sustainability 12 06692 g003
Figure 4. Diagrams of the variable amelioration MEJ over the gender variable GEN.
Figure 4. Diagrams of the variable amelioration MEJ over the gender variable GEN.
Sustainability 12 06692 g004
Figure 5. Q-Q quantile charts of amelioration variable MEJ.
Figure 5. Q-Q quantile charts of amelioration variable MEJ.
Sustainability 12 06692 g005
Table 1. Students matriculated in Spain in tertiary education.
Table 1. Students matriculated in Spain in tertiary education.
Acronym 201320132014201420152015201620162017201720182018
SpainMale
%
Female
%
Male
%
Female
%
Male
%
Female
%
Male
%
Female
%
Male
%
Female
%
Males
%
Females
%
EDUEducation20.6179.4120.9379.1121.4078.6322.3277.7222.3077.7322.577.5
HaWHealth and Welfare27.9472.1328.4171.6428.9471.1129.0471.0228.7371.3028.371.7
SJISocial Sciences, Journalism and Information38.3261.7238.4461.6238.3461.7038.5261.5238.4061.6438.161.9
AaHArts and Humanities40.9059.1141.4258.6441.6358.4141.9058.1242.2157.8042.257.8
BALBusiness, Administration and Law44.6455.4245.2454.8445.7054.3246.1053.9246.1153.9445.954.1
NMSNatural Sciences, Mathematics and Statistics49.0151.0250.7349.3251.5148.5052.0148.0452.1247.9152.247.8
AFVAgriculture, Forestry, Fisheries and Veterinary55.3444.7355.1144.9456.5443.5154.1045.9253.9446.1152.947.1
SERServices53.3046.7053.4346.6253.6246.4153.7146.3354.2445.8254.845.2
EMCEngineering, Manufacturing and Construction73.5426.5073.9426.1474.2325.8474.3125.7074.5225.5174.725.3
ICTInformation and Communication Technologies85.4314.6186.0414.0086.6113.4287.0413.0387.5012.5287.512.5
Source: own elaboration adjusted from Eurostat [27].
Table 2. Population and sample
Table 2. Population and sample
GroupCoursePopulationSample
Experimental1A2452
1F28
Control1B2471
1C24
1E23
Does not participate1D25
TOTAL 148123
Table 3. Cronbach’s Alpha in pretest PRE and posttest POS.
Table 3. Cronbach’s Alpha in pretest PRE and posttest POS.
Cronbach’s Alpha in Pretest PRECronbach’s Alpha at Posttest POS
Case processing summaryCasesN%N%
Valid123100123100
Excluded0000
Total123100123100
Reliability statisticsCronbach Alpha0.770.87
Number of items2525
Table 4. Descriptive statistics of the amelioration variable MEJ over the gender variable GEN
Table 4. Descriptive statistics of the amelioration variable MEJ over the gender variable GEN
GEN_F StatisticStandard Error
MEJ_DManMean 1.5840.0988
95% confidence interval for the meanLower limit1.387
Upper limit1.781
Mean trimmed to 5%1.553
Median 1.500
Variance 0.713
Standard deviation0.8441
Minimum 0.0
Maximum 4.1
Range 4.1
Interquartile range1.1
Asymmetry 0.5310.281
Kurtosis 0.9140.555
WomanMean 1.7080.1414
95% confidence interval for the mean Lower limit1.424
Upper limit1.992
Mean trimmed to 5%1.673
Median 1.600
Variance 1.000
Standard deviation1.0002
Minimum 0.0
Maximum 4.2
Range 4.2
Interquartile range1.0
Asymmetry 0.4560.337
Kurtosis 0.2970.662
Table 5. Two-dimensional variable frequency table amelioration variable MEJ over the gender variable GEN.
Table 5. Two-dimensional variable frequency table amelioration variable MEJ over the gender variable GEN.
MEJ_D = [−5,−4)MEJ_D = [−4,−3)MEJ_D = [−3,−2)MEJ_D = [−2,−1)MEJ_D = [−1,0)MEJ_D = [0,1)MEJ_D = [1,2)MEJ_D = [2,3)MEJ_D = [3,4)MEJ_D = [4,5)TOTAL
GEN_F = Man000001538154173
GEN_F = Woman000001120134250
TOTAL0000026582883123
Table 6. ANOVA gen-tic test multivariate general linear model.
Table 6. ANOVA gen-tic test multivariate general linear model.
Origin,Dependent VariableType III Sum of SquaresglQuadratic AverageFSig,Partial Eta Squared
Corrected ModelPRE_D22.570 a37.5232.7410.0460.065
POS_D67.605 b322.5354.230.0070.096
MEJ_D18.941 c36.3149.18100.188
IntersectionPRE_D881.4441881.444321.11500.730
POS_D2312.04812312.048434.02100.785
MEJ_D338.3631338.363492.02500.805
GEN_FPRE_D17.86117.866.5070.0120.017
POS_D27.402127.4025.1440.0250.066
MEJ_D1.01711.0171.4790.2260.184
TIC_FPRE_D5.69515.6952.0750.1520.052
POS_D44.606144.6068.3730.0050.041
MEJ_D18.424118.42426.79100.012
GEN_F * TIC_FPRE_D0.30810.3080.1120.7380.001
POS_D2.70912.7090.5080.4770.004
MEJ_D1.18911.1891.7290.1910.014
ErrorPRE_D326.6491192.745
POS_D633.9191195.327
MEJ_D81.8361190.688
TotalPRE_D1218.56123
POS_D2968.06123
MEJ_D429.24123
Corrected TotalPRE_D349.219122
POS_D701.523122
MEJ_D100.777122
* means interaction between the two variables; a R squared= 0.065 (R squared adjusted= 0.041); b. R squared= 0.096 (R squared adjusted= 0.074); c. R squared= 0.188 (R squared adjusted= 0.167).

Share and Cite

MDPI and ACS Style

Palomares-Ruiz, A.; Cebrián, A.; López-Parra, E.; García-Toledano, E. Influence of ICTs on Math Teaching–Learning Processes and Their Connection to the Digital Gender Gap. Sustainability 2020, 12, 6692. https://0-doi-org.brum.beds.ac.uk/10.3390/su12166692

AMA Style

Palomares-Ruiz A, Cebrián A, López-Parra E, García-Toledano E. Influence of ICTs on Math Teaching–Learning Processes and Their Connection to the Digital Gender Gap. Sustainability. 2020; 12(16):6692. https://0-doi-org.brum.beds.ac.uk/10.3390/su12166692

Chicago/Turabian Style

Palomares-Ruiz, Ascensión, Antonio Cebrián, Emilio López-Parra, and Eduardo García-Toledano. 2020. "Influence of ICTs on Math Teaching–Learning Processes and Their Connection to the Digital Gender Gap" Sustainability 12, no. 16: 6692. https://0-doi-org.brum.beds.ac.uk/10.3390/su12166692

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop