Systematic Review on Inclusive Education, Sustainability in Engineering: An Analysis with Mixed Methods and Data Mining Techniques

Round 1

Reviewer 1 Report

The paper is devoted to the analysis of a group of selected publications related to the sustainability domain.

The authors provided a comprehensive state of the art and investigated the objective from various points of view. I recommend also adding Problem-based learning between learning strategies.

From the methodological side, I recommend organizing the paper according to suitable research methodology related to data mining like e.g., CRISP-DM. This methodology contains six phases that clearly defined all necessary steps for an effective analytical project. In this version, the research design is entirely customized. For example, the authors started with Exploratory data analysis (2.2) and the next jump between other methods.

2.2 - it is not clear what is the difference between scientific articles and conference papers.

Figures 3 and 4 have the x-axis in decimal numbers. I recommend changing to integers.

2.4 - the selection of 54 papers is quite disputable. The larger the input sample of data, the more relevant results we can obtain.

Table 1 - a used approach for document classification is quite surprised. Why did not the authors use a binary character for variables C1 - C6?

Figure 9 - this word cloud version is expected. I recommend eliminating from the experiments the main concepts like C1 - C6. If you select the papers according to these concepts, their highest position is expected.

Figures 10-12, especially figure 10, are difficult to read. I recommend direct translation to English.

The abstract includes only result for cluster 1 and 3.

Author Response

We are grateful for the comments from the reviewer that are outlined below with our responses on a point-by-point basis.

Point 1: The paper is devoted to the analysis of a group of selected publications related to the sustainability domain.

The authors provided a comprehensive state of the art and investigated the objective from various points of view. I recommend also adding Problem-based learning between learning strategies.

Response 1

We are grateful for the suggestions from the review, the project-based teaching method, if the classification from the scientific papers is taken into account, can be verified in Figure 9 (current version, figure 10 of the original version).  In the qualitative analysis that was carried out, articles that included Problem-based Learning are related to the categorization of Teaching Learning approach, Innovative Education and also include Flipped Classroom experiments, all of these significantly promote learning.  Its importance is also referred to in the Discussion.

Point 2: From the methodological side, I recommend organizing the paper according to suitable research methodology related to data mining like e.g., CRISP-DM. This methodology contains six phases that clearly defined all necessary steps for an effective analytical project. In this version, the research design is entirely customized. For example, the authors started with Exploratory data analysis (2.2) and the next jump between other methods.

Response 2

We would like to that the reviewer for suggesting that we use CRISP-DM, this method was used in the following phases:

Phase I. Business Understanding. Definition of customer needs (business understanding)

Phase II. Data Understanding. Study and understanding of the data

Phase III. Data Preparation. Analysis of data and selection of characteristics

Phase IV. Modeling. Modeling

Phase V. Evaluation. Evaluation (obtaining results)

Phase VI. Deployment. Deployment (putting into production)

However, a mixed methods methodology in the analysis of the results of the systematic scientific literature review joint with an analysis of the following key words; “inclusive education” AND “sustainability” AND “disability” was applied, which as can be seen in Figure 1, prior to 2006 there is very little research. This fundamentally increases as of 2019, of which, 66.2% of the documents are scientific articles and are those which have been used in order to carry out this study. Mixed methodology enables qualitative data to be transformed into data on which quantitative data techniques can be applied, data mining techniques were applied for this, as prediction is enabled in supervised techniques and classification in unsupervised techniques.  This is why our aim, in and of itself, is not to purely carry out a study of the application of a data mining process, rather to use these techniques as data analysis tools of the systematic review.

Point 3: 2.2 - it is not clear what is the difference between scientific articles and conference papers.

Response 3

This is a classification used in the data bases (WOS and SCOPUS).  The articles appear with access to the pdf of the publication and not to the conference papers, that is why it is more feasible to use the first ones in the research papers.

Point 4: Figures 3 and 4 have the x-axis in decimal numbers. I recommend changing to integers.

Response 4

These figures cannot be changed as they have been extracted from the Scopus data base that automatically carries out an analysis and includes the numbers with decimals. We believe it is important to maintain these in order for the reader to understand the development of the state of the art.

Point 5: 2.4 - the selection of 54 papers is quite disputable. The larger the input sample of data, the more relevant results we can obtain.

Response 5

We fully agree with the review, as has been previously indicated, on carrying out a search in the data bases using the keywords, “inclusive education” AND “sustainability” AND “disability” a total of 133 documents was obtained. If adhering to the criteria for inclusion and exclusion, the total number of scientific articles that met the criteria were 54.  It must be considered that other types of documents such as scientific conference papers only include the abstract which provides little information on progress of the paper, this is why only scientific articles were used.

Point 6: Table 1 - a used approach for document classification is quite surprised. Why did not the authors use a binary character for variables C1 - C6?

Response 6

A classification of the articles was carried out that met with the inclusion criteria in 6 categories: (1 = Disability, 2 = Society, 3 = Higher Education, 4 = Childhood Education, 5 = High School and Higher Education, 6 = Primary School, 7 = All, 8 = High School; Classification: C1 = Sustainability, C2 = Inclusive Society, C3 = Technology, C4 = Innovative Education, C5 = Active Methodologies and C6 = Society and Economy) In line with the content of the article.  That which is in Table 1 is that category however, as per the reviewer’s suggestion, binary code will be used 1 (belongs to the category) 0 (does not belong).

Point 7: Figure 9 - this word cloud version is expected. I recommend eliminating from the experiments the main concepts like C1 - C6. If you select the papers according to these concepts, their highest position is expected.

Response 7

Figure 9 has been removed.

Point 8: Figures 10-12, especially figure 10, are difficult to read. I recommend direct translation to English.

Response 8

The labels in English have been included in the Figure which was previously 10 and is now 9 after Figure 9 was removed.

Point 9: The abstract includes only result for cluster 1 and 3.

Response 9

The abstract has been modified and other results have been included, not all results were able to be included as the length of the abstract is limited to 200 words.

In the last few years research in the field of sustainability has experienced a significant increase in interest between sustainability and other areas (inclusive education, active methodologies and society). Moreover, the use of mixed research methods (quantitative and qualitative) along with the application of Data Mining Techniques, enables the analysis of information and the connection between the different studies. The objectives of this paper were: (1) To establish the results of the research related to the concepts of sustainability, inclusive education and disability. (2)  To study the key concepts that are detected in the articles selected with respect to the concepts of sustainability, inclusive education, disability and their relations. In order to do so, two studies were carried out (quantitative and qualitative). In the first study, K-Means and Heat Map Clustering techniques were applied. In the second study, the technique of Text Mining was applied. 133 scientific papers were studied, of which, 54 fulfilled all the inclusion criteria. 3 clusters were found in the first study, cluster 1 included the categories: inclusive society, educational innovation, active methodologies. Cluster 2: active methodologies and society and economy and cluster 3: inclusive society and society and economy. In the second study, the most Krippendorff's Alpha Coefficient were found in articles that linked sustainability with social transformation stemming from a change in education by means of the use of active teaching methods and technological resources. The research moves towards the development of competencies in sustainability at all stages of the educational system, and in all areas of knowledge.

Author Response File: Author Response.pdf

Reviewer 2 Report

The world is changing fast, the goals of sustainability also need to be adapted, especially if we talk about special education. This article brings some of the experience that the consortium of the project SUSKIDS analyses before and now, during the implementation of the project. The methodology (mixed, quantitative and qualitative) used is very appropriated for the objectives that they want to check. They are some minor language errors and some questions that need to be answered before the article could be accepted. The authors need to check the PDF.

Comments for author File: Comments.pdf

Author Response

We are grateful for the comments from the reviewer that are outlined below with our responses on a point-by-point basis.

Point 1: The world is changing fast, the goals of sustainability also need to be adapted, especially if we talk about special education. This article brings some of the experience that the consortium of the project SUSKIDS analyses before and now, during the implementation of the project. The methodology (mixed, quantitative and qualitative) used is very appropriated for the objectives that they want to check. They are some minor language errors and some questions that need to be answered before the article could be accepted. The authors need to check the PDF.

Response 1

We would like to thank that review for the evaluation. The article has been sent to be reviewed by a native English translator, a certification is included.

Reviewer 3 Report

Thank you for the opportunity to review this article. The time involved in submitting your manuscript is greatly appreciated.

Despite this, the article presents a series of issues that must be noted and mended. The recommendations are presented separately by sections. Hopefully, they would be useful.

Title: the title does not adequately reflect the content of the paper. Please, try to change it to better inform the readers about that content.

Abstract:

Less information appears in the abstract. Maybe expanded by adding the most relevant findings.

Introduction:

At the end of the literature review, the aims and the questions in the research should appear. Maybe to formulate the questions as a hypothesis would be an option to clear this aspect. Another commentary, it is the possibility of including this part at the final of the introduction part; even a separate section could be a good option, in order to clear the final of the introduction and to serve as a connection with the method.

Discussion:

First of all, try to better adjust your conclusions to the findings. Or to say in other words, please try to justify more clearly the connection between your conclusions and your findings. 

Finally, a section related to limitations, future lines of investigations and the principal contributions of the research could be interesting. Your paper has a lot of relevant implications for society and policymakers, but you need to elaborate more on this topic.

Conclusion:

They don’t appear new conclusions on this part. This part does not add any new to the rest of the paper. Please, try to condense your findings, or to highlight your main contribution to the field.

Author Response

We are grateful for the comments from the reviewer that are outlined below with our responses on a point-by-point basis.

Point 1: Thank you for the opportunity to review this article. The time involved in submitting your manuscript is greatly appreciated.

Despite this, the article presents a series of issues that must be noted and mended. The recommendations are presented separately by sections. Hopefully, they would be useful.

Title: the title does not adequately reflect the content of the paper. Please, try to change it to better inform the readers about that content.

Response 1

We would like to thank the reviewer for the evaluation of the article and for the suggestions made.

The title of the article has been changed, “Systematic review on Inclusive Education, Sustainability in Engineering: An analysis with mixed methods and data mining techniques”.

Point 2: Abstract: Less information appears in the abstract. Maybe expanded by adding the most relevant findings.

Response 2.

The abstract has been changed and other aspects included, though the established length in the publication does not allow for further aspects to be included.

In the last few years research in the field of sustainability has experienced a significant increase in interest between sustainability and other areas (inclusive education, active methodologies and society). Moreover, the use of mixed research methods (quantitative and qualitative) along with the application of Data Mining Techniques, enables the analysis of information and the connection between the different studies. The objectives of this paper were: (1) To establish the results of the research related to the concepts of sustainability, inclusive education and disability. (2)  To study the key concepts that are detected in the articles selected with respect to the concepts of sustainability, inclusive education, disability and their relations. In order to do so, two studies were carried out (quantitative and qualitative). In the first study, K-Means and Heat Map Clustering techniques were applied. In the second study, the technique of Text Mining was applied. 133 scientific papers were studied, of which, 54 fulfilled all the inclusion criteria. 3 clusters were found in the first study, cluster 1 included the categories: inclusive society, educational innovation, active methodologies. Cluster 2: active methodologies and society and economy and cluster 3: inclusive society and society and economy. In the second study, the most Krippendorff's Alpha Coefficient were found in articles that linked sustainability with social transformation stemming from a change in education by means of the use of active teaching methods and technological resources. The research moves towards the development of competencies in sustainability at all stages of the educational system, and in all areas of knowledge. 

Point 3: Introduction:

At the end of the literature review, the aims and the questions in the research should appear. Maybe to formulate the questions as a hypothesis would be an option to clear this aspect. Another commentary, it is the possibility of including this part at the final of the introduction part; even a separate section could be a good option, in order to clear the final of the introduction and to serve as a connection with the method.

Response 3.

The objectives of the research were outlined at the end of introduction section and are:

(1)       To establish the results of the research related to the concepts of sustainability, inclusive education and disability.

(2)       To study the key concepts that are detected in the articles selected with respect to the concepts of sustainability, inclusive education, disability and their relations.

Point 4. Discussion:

First of all, try to better adjust your conclusions to the findings. Or to say in other words, please try to justify more clearly the connection between your conclusions and your findings.

Finally, a section related to limitations, future lines of investigations and the principal contributions of the research could be interesting. Your paper has a lot of relevant implications for society and policymakers, but you need to elaborate more on this topic.

Response 4

The Discussion has been modified, the changes are in red

On the one hand, the objectives were to establish the results of the research related to the concepts of sustainability, inclusive education and disability. The systematic scientific literature review revealed that

The second objective of this research was to study the key concepts that are detected in the articles selected with respect to the concepts of sustainability, inclusive education, disability and their relations.  It was discovered that highest relations according to Krippendorff's Alpha Coefficient were found for the keywords Educational transformation and use of Active methods, Educational Transformation and Educational Methodology, Educational Transformation and Technology and Sustainability with the application of Active Methods and finally Educational Transformation and Technology and Sustainability and Teaching-Learnings Approach and Innovative Education.

Limitations and future lines of research

            At its initial stage, the concept of sustainability focussed on revealing human beings’ actions against the environment that were having negative impacts on the planet and on the lives of people. However, in the last few years research has been targeted towards showing that establishing a sustainable society and social transformation can only be achieved based on educational reform and this can only be achieved by using innovative Teaching-Learning methods based on technological resources.  In order meet these challenges, On the part of government leaders, there needs to be an active global involvement centred on legislative reform and the investing of resources.  A culture of sustainability needs to be inculcated from childhood and should continue throughout a person’s entire life.  This will facilitate the application of the concepts of sustainability in different areas, services and businesses [9,11,12] and will enable a more sustainable society committed to respecting the environment to be achieved [40].  Future research will be targeted towards establishing the impact of the experiments in education orientated towards real sustainable, social inclusion in different groups.

Point 5. Conclusions:

They don’t appear new conclusions on this part. This part does not add any new to the rest of the paper. Please, try to condense your findings, or to highlight your main contribution to the field.

Response 5

The Conlusions section has been modified

Educating people on sustainable attitudes and skills is to invest in a better future for the human race. This study has helped establish the type of studies carried out in the area of sustainability from an inclusive education approach. Specifically, it has been found that there are few studies focussed on studying educational approaches to promoting sustainable education among disabled people.  For this reason, experiments such as those carried out in the European project SUSKIDS will enable it be established how sustainability training in these groups promotes the adoption of sustainable conduct both in the users as well as in their families.

Author Response File: Author Response.pdf