A Literature Review on Intelligent Services Applied to Distance Learning

Abstract

Distance learning has assumed a relevant role in the educational scenario. The use of Virtual Learning Environments contributes to obtaining a substantial amount of educational data. In this sense, the analyzed data generate knowledge used by institutions to assist managers and professors in strategic planning and teaching. The discovery of students’ behaviors enables a wide variety of intelligent services for assisting in the learning process. This article presents a literature review in order to identify the intelligent services applied in distance learning. The research covers the period from January 2010 to May 2021. The initial search found 1316 articles, among which 51 were selected for further studies. Considering the selected articles, 33% (17/51) focus on learning systems, 35% (18/51) propose recommendation systems, 26% (13/51) approach predictive systems or models, and 6% (3/51) use assessment tools. This review allowed for the observation that the principal services offered are recommendation systems and learning systems. In these services, the analysis of student profiles stands out to identify patterns of behavior, detect low performance, and identify probabilities of dropouts from courses.

1. Introduction

The emergence of the internet has facilitated access to information and the dissemination of knowledge through the distribution of educational materials. This scenario has boosted distance learning (DL), expanding its adoption in educational institutions around the world [1].

In the current circumstances in which the world faces the new coronavirus pandemic and adopts express guidelines from the World Health Organization (WHO) to follow social isolation protocols, DL is an ally in the teaching and learning process [2].

With the advance of the pandemic and the suspension of in-person classes, institutions, teachers, and students had to adapt their learning routine using distance learning to guarantee the continuity of the academic calendar and minimize the impact on education. The last decade has shown exponential growth in the adoption of e-learning due to the transaction from face-to-face classes to virtual classes [3].

Thus, education has sought a new meaning to its practices through the integrated use of multiple technologies in educational environments as resources for teaching-learning processes in the digital age.

An educational environment is a space dedicated to learning, supporting pedagogical, psychological, and sociocultural conditions. The environment influences the development of the students’ personality and creates conditions for the improvement of their skills. In addition, it reveals students’ individual characteristics, interests, and talents. In addition, these environments ensure the interaction and cooperation of teachers and students [4]. This article considers educational environments at different levels of learning, focusing on intelligent services applied to distance learning.

Therefore, the pandemic scenario (COVID 19) intensifies the need to use distance learning as an element for the continuity of student education processes [5]. At the same time, the need for resources and tools that enable personalization, learning improvement, and the analysis of educational data is intensifying.

UNESCO has recommended these resources and tools since 2019 to meet the four challenges of the united nations for sustainable development Pedró et al. [6]. Digital mediation and its context in education are relevant assets for improving learning, inclusion, and equity, as it allows for an interaction process between teachers and students, as a coparticipation through a digital platform.

Distance learning allows for advancement in the educational system, overcoming the limitations of traditional fully face-to-face classes. It provides independence from the classroom, allowing students to freely choose the place and time of study, thus reaching a significant number of students with different socioeconomic profiles, which contributes to the democratization of learning.

The absence of a physical presence caused by remote access is one of the main problems faced by DL. This problem has been mitigated by Virtual Learning Environments (VLEs). VLEs have tools that allow and encourage contact between students and teachers. The use of discussion forums, debates, virtual meetings, and chats, among others, diversifies the teaching-learning routine and promotes interaction between them.

The growing search for information, high connectivity, and the use of virtual learning environments has generated a significant amount of data. These data can be analyzed, allowing for the discovery of student behavior. This analysis can be used to develop intelligent services dedicated to prediction and intervention in learning environments [7].

Becker et al. [8] argued that the mediation of learning is a trend, with an increasing amount of methods and tools used by teachers to assess, measure, and document students’ academic life, learning advancement, skill attainment, and other educational needs. Becker et al. [8] also mentioned that the increase in adaptive learning technologies expands the amount of data that can be collected and analyzed. Learning Analytics (LA) is an alternative for the treatment and discovery of knowledge in databases generated by educational platforms [9].

Acatech [10] stated that the storage, analysis, and interpretation of data allow for the development of intelligent services, which can be customized according to the requirements of each user.

Koldewey et al. [11] claimed that intelligent services were first described by Allmendinger and Lombreglia [12]. The authors indicated that these services are data based, connected to intelligent objects, and allow for continuous and interactive feedback [13]. Furthermore, Beverungen et al. [14] stated that intelligent services are based on cocreation involving monitoring, optimization, control, and autonomous adaptation of results.

This article presents a study on intelligent services and how they are being applied to distance learning environments. The research covered the period from January 2010 to May 2021, considering five academic databases. The initial search returned the number of 1316 articles. After applying the exclusion criteria, 51 articles remained to be analyzed.

The article is divided into six sections. Following the Introduction, the second section addresses basic concepts that form the background of this study. The third defines the research methodology. Next, the article contains a section dedicated to the results, mainly presenting the types of intelligent services applied to distance learning. The fifth section contains a discussion of the results with 12 lessons learned. Finally, the last section addresses final considerations and future work.

2. Background

This section presents principles related to Distance Learning, Virtual Learning Environments, Intelligent Services, and Learning Analytics.

2.1. Distance Learning

Cambruzzi et al. [15] affirmed that the definitions of Distance Learning are diverse, but they all take into account these characteristics: (1) DL does not share the same physical spaces; (2 ) DL allows the students to study at different times; and (3) mediation is performed through technologies. Due to the high level of mediation, the DL generates data that can be used in different kinds of analysis [15].

Traxler [16] pointed out that the DL requires the autonomy of the student, and if associated with the use of information technology, it promotes knowledge quickly and widely, stimulating the student to search for new knowledge.

2.2. Virtual Learning Environments

When dealing with distance learning, it is worth highlighting the use of environments that support the educational processes. VLEs allow for the sharing of contexts during the development of activities. Furthermore, it allows the synchronous and asynchronous communication between people in learning environments [9].

Waheed et al. [7] defined VLE as a computational software that aggregates different media and resources, allowing the propagation of information. It enables data storage, retrieval, and distribution, as well as synchronous and asynchronous bidirectional communication, contributing to the generation of digital data that can be used to assess students.

According to Clow [17], there is a large amount of data available about users, due to the increased use of online learning environments. In this sense, the growing use of VLEs provides the tools to develop learning patterns adaptable to the user’s profile [18].

2.3. Intelligent Services

According to Cummaudo et al. [19] and Hosseini et al. [20], the development of intelligent services differs from the usual web services, as they are developed with components based on artificial intelligence (AI).

The predictions performed by the intelligent services focus only on training datasets, and the results obtained are presented as probabilities that the inference satisfies one or more labels in the training data [19].

According to Cummaudo et al. [19] due to the evolution of intelligent services, training datasets must be representative and frequently evaluated concerning the chosen service. These data allow for the continuous update of prediction algorithms.

Marquardt [21] defined an intelligent service as part of an intelligent task performed by a computer system, with behavior equivalent to that of a human being when performing a similar task.

The Smart Urban Services project defined intelligent services as services adapted to specific use cases of customers with the help of data and intelligent processing [22], and according to Koldewey et al. [23], intelligent services allow a company to become competitive and innovative.

2.4. Learning Analytics

Learning Analytics (LA) refers to the application of analytical techniques to analyze educational data, such as data on student and teacher activities, the identification of behavior patterns, and the provision of information that can be used to improve learning [15].

According to Andrade et al. [9], LA is a rapidly growing field of research, focused on the development and application of processes and tools to collect, explore, and analyze large amounts of data. This analysis allows one to better understand the learning behavior of students, helping teachers to provide better support and appropriate interventions, and ultimately improve the quality of learning and teaching, as well as educational outcomes.

According to Waheed et al. [7], through learning analytics platforms, LA supports pedagogical strategies by offering real-time opinions and recommendations through learning analytics panels and VLE visualization systems. LA uses educational data and translates them into useful information for decision making, based on responses and records of students’ academic life available on online learning platforms [7].

3. Methodology

This article carried out a study on intelligent services applied to distance learning from January 2010 to May 2021. The work used the following academic databases: ACM Digital Library (https://0-dl-acm-org.brum.beds.ac.uk/ (accessed on 19 october 2021)) IEEE Xplore Digital Library (https://0-ieeexplore-ieee-org.brum.beds.ac.uk/Xplore/home.jsp (accessed on 19 october 2021)), ScienceDirect (https://0-www-sciencedirect-com.brum.beds.ac.uk/ (accessed on 19 october 2021)), Springer Library (https://0-www-springer-com.brum.beds.ac.uk/br (accessed on 19 october 2021)) and Scopus (https://0-www-scopus-com.brum.beds.ac.uk/home.uri (accessed on 19 october 2021)).

The search string considered the following keywords: Distance Learning, Learning Analytics, and Intelligent Services. In addition, these keywords allowed synonyms and related words to compose the search terms. The terms were joined through Boolean expressions and organized into three groups as presented in

Table 1. Search string composition.

Major Terms	Search Terms
Distance learning	(Distance learning OR e-learning OR educational technology OR online education OR virtual learning environment OR Distance learning OR learning management system)
	AND
Learning Analytics	(Learning Analytics OR data analysis OR academic data mining OR educational data mining OR learning data mining OR data Science OR learning analytic OR school data mining)
	AND
Intelligent services	(smart services OR smart methods OR Smart processes OR intelligent systems OR Intelligent service OR intelligent task OR smart service OR Intelligent processes)

.

The following inclusion criteria (IC) allowed the selection of articles: publication with full content; publications at journals, conferences, and workshops; works with data analysis applied to DL; works with intelligent services and publications from January 2010 to May 2021. On the other hand, the Exclusion Criteria (EC) were: publications that precede 2010; abstracts, books, dissertations, and theses; reviews and texts that use a language other than English; and works unrelated to this research and duplicate works.

The first step consisted in searching in the five databases and removing impurities, resulting in a total of 1316 articles, 271 in the ACM Digital Library database, 315 in the IEEE Xplore Digital Library, 188 in Science Direct, 289 in the Springer Library, and 253 in Scopus (

Table 2. Number of articles obtained by database and selected in the study.

Database	Return Articles	Percentage Return Articles	Selected Articles	Percentage of Selected Articles
ACM Digital Library	271	21%	17	33%
IEEE Xplore Digital Library	315	24%	10	20%
Science Direct	188	14%	4	8%
Springer Library	289	22%	13	25%
Scopus	253	19%	7	14%
Total	1316	100%	51	100%

). In the second step, the texts were filtered considering the title, abstract, and keywords. In this stage, 1036 articles were discarded, leaving 280 works that were revised through the introduction, results, and conclusions. The third step discharged 229 works, selecting 51 articles. The selected articles were fully read to ensure their suitability for this review study.

4. Results

This section presents the types of intelligent services that are being offered in distance learning, according to this literature research. Among the intelligent services, the study found learning systems in 33% (17/51) of the selected articles, recommendation systems in 35% (18/51), models or forecasting systems in 26% (13/51), and the assessment tools in 6% (3/51).

Table 3 shows the selected works with the authors, publication year, publication dataset, and a summary of the intelligent services. The following sections organize and discuss the articles as learning systems, recommendation systems, forecasting models or systems, and assessment tools.

4.1. Learning Systems

Lavoie and Proulx [24] developed a Learning Management System (LMS) with features oriented to flipped courses that allow students to watch videos and interact in Jupyter Notebooks. The LMS automatically creates progression graphs for students and sends automatic messages related to their progression. For instructors, the LMS automatically creates statistics on overall class and exercise progression. This allows teachers to target students with difficulty who can be helped individually, decreasing the failure rate.

Dahdouh et al. [25] developed an online learning system based on big data technologies and cloud computing. The authors suggested a methodology to use the huge amount of data produced by online learning platforms. In addition, the authors proposed to develop a course recommendation system that helps students to select the most appropriate courses and guides them throughout the learning process.

Wang et al. [26] proposed a system that uses natural language processing (NLP) technology as a development and design tool. The assistant was built for online learning platforms to provide timely feedback to students and increase their enthusiasm for learning.

Kozierkiewicz-Hetmańska and Zyundefinedk [27] proposed a method to determine an opening learning scenario based on the ant colonies optimization technique. The algorithm tries to choose the learning material best suited to the learning styles and current level of knowledge stored in the student profile. The method for determining an initial learning scenario required defining a student profile and a representation of knowledge. According to the authors, the customization of the learning scenario is an important task in the design of intelligent tutorial systems, because research indicates that students achieve better learning outcomes if the teaching material is appropriate to their learning styles.

Table 3. List of articles containing intelligent services in distance learning.

ID	Authors	Source	Summary
1	Anaya et al. [28]	ACM	Recommendation system based on an ID in the context of collaborative learning in the e-learning environment.
2	Balderas et al. [29]	ACM	Domain-specific language to customize online learning assessments in Moodle.
3	Chanaa and Faddouli [30]	IEEE	Custom model with 3 main components, sentiment analysis, cognitive analysis and learning style.
4	Chen et al. [31]	IEEE	Enhanced recommendation method called Adaptive Recommendation based on Online Learning Style.
5	Dahdouh et al. [25]	Springer	Online learning systems based on big data technologies in cloud computing.
6	Dahdouh et al. [32]	Springer	Recommendation of courses to e-learning platforms.
7	Dimopoulos et al. [33]	ACM	Moodle plug-in that implements an evaluation tool (Enriched Learning Analytic).
8	El Fouki et al. [34]	ACM	System dedicated for assisting instructors on decision-making process.
9	El Moustamid et al. [35]	ACM	System that analyzes the student profiles indexing videos in order to offer students a database with courses that correspond to their levels.
10	Florian et al. [36]	Springer	System that supports indicators as learning analytical applications.
11	Hamada [37]	ACM	Model of an e-learning system based on Java2D technology and containing an intensive set of learning materials to support all types of students.
12	Huang et al. [38]	ACM	Deep Reinforcement learning structure for Exercise Recommendation.
13	Iqbal et al. [39]	IEEE	Kernel Context Recommendation System algorithm, which is a flexible, fast and accurate.
14	Joy et al. [40]	ACM	Ontology model that encompasses the student profile and learning object attributes, which can be used for recommending content on an e-learning platform.
15	Kapembe and Quenum [41]	ACM	System that conducts an hybrid recommendation through profiles students, the relevance and quality of learning objects for the program in which the student is enrolled, and student feedback.
16	Kim and Kim [42]	IEEE	Personalized Tutor as a system that integrates three developmental learning networks.
17	Kolekar et al. [43]	ScienceDirect	Learning styles of students used to customization of user interface considering web log analysis.
18	Kozierkiewicz-Hetmańska and Zyundefinedk [27]	Springer	Algorithm to determine an opening learning scenario based on the ant colony optimization technique.
19	Lagman and Mansul [44]	ACM	System to monitor paths of students in e-learning environments, allowing one to determine difficult subjects and to provide academic intervention.
20	Lavoie and Proulx [24]	ACM	Learning management system (LMS) oriented to inverted courses.
21	Manhães et al. [45]	ACM	WAVE architecture that provides useful information about student performance.
22	Sharma and Ahuja [46]	ACM	Semantic recommendation using ontology to recommend relevant and personalized learning content to students.
23	Thai-Nghe et al. [47]	ScienceDirect	Recommendation system techniques for mining educational data, especially to predict student performance.
24	Venugopalan et al. [48]	ACM	Content-based recommendation system.
25	Wang et al. [26]	IEEE	Intelligent teaching assistant system that replaces the way the user waits for manual response.
26	Zakrzewska [49]	ACM	Agent-based recommendation system, which, for each new student, suggests a group of students of similar profiles.
27	Zaoudi and Belhadaoui [50]	ACM	Learner Behavior Analytics model based on a system called Score and Behavior Analytics to analyze student outcomes and behavior.
28	Khosravi et al. [51]	ACM	Adaptive learning system with a focus on the student, scalable, and independent of content that depends on crowdsourcing and partnership with students for the development.
29	Zhang et al. [52]	SCOPUS	Learning analysis using Moodle plugins to discover possibilities to improve the learning process and reduce the number of under performing students.
30	Angeline et al. [53]	SCOPUS	Discriminant analysis to measure student performance.
31	Hashim et al. [54]	SCOPUS	Student performance prediction model based on supervised machine learning algorithms (decision tree, Naïve Bayes, logistic regression, support vector machine, K-nearest neighbor, and minimal and neural sequential optimization Network).
32	Maâloul and Bahou [55]	SCOPUS	Recommendation system based on machine learning that is fundamentally based on a digital learning technique (i.e., semisupervised learning) and that determines the degree of similarity between students.
33	Freitas et al. [56]	SCOPUS	IoT system for predicting school dropout using machine learning techniques based on socioeconomic data.
34	Villegas-Ch et al. [57]	SCOPUS	Integration of technologies, with artificial intelligence (AI) and data analysis, with learning management systems to improve learning.
35	Villegas-Ch et al. [58]	SCOPUS	Architecture for Integration of Chatbot with Artificial Intelligence in Intelligent Campus for Improvement of Learning.
36	Han and Xu [59]	ScienceDirect	Intelligent education platform based on deep learning and image detection.
37	Shi et al. [60]	ScienceDirect	Learning path recommendation model based on a multidimensional knowledge graph structure.
38	Chang et al. [61]	IEEE	Ontology capable of mapping students interaction data with respect to a set of tutorial actions, allowing an artificial tutor to observe students and their interactions with the learning environment and provide an appropriate tutoring.
39	Rajkumar and Ganapathy [62]	IEEE	Recommendation system to increase classification accuracy.
40	Ruangvanich et al. [63]	IEEE	Architecture of a learning analysis system in a virtual intelligent learning environment as a tool to support student learning.
41	Barlybayev et al. [64]	IEEE	Intelligent system for assessing students’ professional skills levels in e-learning.
42	Leithardt et al. [65]	IEEE	Control system for learning environments specialized in special education.
43	Lin et al. [66]	Springer	Complementary recommendation structure for freshmen under restrictions or requirements, based on objective-oriented standards.
44	Chen et al. [67]	Springer	Phased forecasting model to predict students at risk at different stages of a semester.
45	Niknam and Thulasiraman [68]	Springer	Intelligent learning path recommendation based on meaningful learning theory.
46	Turabieh et al. [69]	Springer	Harris Hawks algorithm optimization enhanced as a feature selection for predicting student performance.
47	Iatrellis et al. [70]	Springer	Two-stage machine learning approach to predict student outcomes.
48	Ullah et al. [71]	Springer	IoT model based on Software Defined Network for student interaction, which interconnects students and teacher in a smart city environment
49	Nuguri et al. [72]	Springer	Cloud-based virtual reality learning environment (VRLE) system that can be deployed on high-speed networks using the platform.
50	Azzi et al. [73]	Springer	Classifier capable of identifying the student’s learning style in the e-learning system.
51	Mendes et al. [74]	Springer	Educational tool based on motion detection using the Kinect sensor in a game that is projected on the classroom wall.

Table 3. List of articles containing intelligent services in distance learning.

ID	Authors	Source	Summary
1	Anaya et al. [28]	ACM	Recommendation system based on an ID in the context of collaborative learning in the e-learning environment.
2	Balderas et al. [29]	ACM	Domain-specific language to customize online learning assessments in Moodle.
3	Chanaa and Faddouli [30]	IEEE	Custom model with 3 main components, sentiment analysis, cognitive analysis and learning style.
4	Chen et al. [31]	IEEE	Enhanced recommendation method called Adaptive Recommendation based on Online Learning Style.
5	Dahdouh et al. [25]	Springer	Online learning systems based on big data technologies in cloud computing.
6	Dahdouh et al. [32]	Springer	Recommendation of courses to e-learning platforms.
7	Dimopoulos et al. [33]	ACM	Moodle plug-in that implements an evaluation tool (Enriched Learning Analytic).
8	El Fouki et al. [34]	ACM	System dedicated for assisting instructors on decision-making process.
9	El Moustamid et al. [35]	ACM	System that analyzes the student profiles indexing videos in order to offer students a database with courses that correspond to their levels.
10	Florian et al. [36]	Springer	System that supports indicators as learning analytical applications.
11	Hamada [37]	ACM	Model of an e-learning system based on Java2D technology and containing an intensive set of learning materials to support all types of students.
12	Huang et al. [38]	ACM	Deep Reinforcement learning structure for Exercise Recommendation.
13	Iqbal et al. [39]	IEEE	Kernel Context Recommendation System algorithm, which is a flexible, fast and accurate.
14	Joy et al. [40]	ACM	Ontology model that encompasses the student profile and learning object attributes, which can be used for recommending content on an e-learning platform.
15	Kapembe and Quenum [41]	ACM	System that conducts an hybrid recommendation through profiles students, the relevance and quality of learning objects for the program in which the student is enrolled, and student feedback.
16	Kim and Kim [42]	IEEE	Personalized Tutor as a system that integrates three developmental learning networks.
17	Kolekar et al. [43]	ScienceDirect	Learning styles of students used to customization of user interface considering web log analysis.
18	Kozierkiewicz-Hetmańska and Zyundefinedk [27]	Springer	Algorithm to determine an opening learning scenario based on the ant colony optimization technique.
19	Lagman and Mansul [44]	ACM	System to monitor paths of students in e-learning environments, allowing one to determine difficult subjects and to provide academic intervention.
20	Lavoie and Proulx [24]	ACM	Learning management system (LMS) oriented to inverted courses.
21	Manhães et al. [45]	ACM	WAVE architecture that provides useful information about student performance.
22	Sharma and Ahuja [46]	ACM	Semantic recommendation using ontology to recommend relevant and personalized learning content to students.
23	Thai-Nghe et al. [47]	ScienceDirect	Recommendation system techniques for mining educational data, especially to predict student performance.
24	Venugopalan et al. [48]	ACM	Content-based recommendation system.
25	Wang et al. [26]	IEEE	Intelligent teaching assistant system that replaces the way the user waits for manual response.
26	Zakrzewska [49]	ACM	Agent-based recommendation system, which, for each new student, suggests a group of students of similar profiles.
27	Zaoudi and Belhadaoui [50]	ACM	Learner Behavior Analytics model based on a system called Score and Behavior Analytics to analyze student outcomes and behavior.
28	Khosravi et al. [51]	ACM	Adaptive learning system with a focus on the student, scalable, and independent of content that depends on crowdsourcing and partnership with students for the development.
29	Zhang et al. [52]	SCOPUS	Learning analysis using Moodle plugins to discover possibilities to improve the learning process and reduce the number of under performing students.
30	Angeline et al. [53]	SCOPUS	Discriminant analysis to measure student performance.
31	Hashim et al. [54]	SCOPUS	Student performance prediction model based on supervised machine learning algorithms (decision tree, Naïve Bayes, logistic regression, support vector machine, K-nearest neighbor, and minimal and neural sequential optimization Network).
32	Maâloul and Bahou [55]	SCOPUS	Recommendation system based on machine learning that is fundamentally based on a digital learning technique (i.e., semisupervised learning) and that determines the degree of similarity between students.
33	Freitas et al. [56]	SCOPUS	IoT system for predicting school dropout using machine learning techniques based on socioeconomic data.
34	Villegas-Ch et al. [57]	SCOPUS	Integration of technologies, with artificial intelligence (AI) and data analysis, with learning management systems to improve learning.
35	Villegas-Ch et al. [58]	SCOPUS	Architecture for Integration of Chatbot with Artificial Intelligence in Intelligent Campus for Improvement of Learning.
36	Han and Xu [59]	ScienceDirect	Intelligent education platform based on deep learning and image detection.
37	Shi et al. [60]	ScienceDirect	Learning path recommendation model based on a multidimensional knowledge graph structure.
38	Chang et al. [61]	IEEE	Ontology capable of mapping students interaction data with respect to a set of tutorial actions, allowing an artificial tutor to observe students and their interactions with the learning environment and provide an appropriate tutoring.
39	Rajkumar and Ganapathy [62]	IEEE	Recommendation system to increase classification accuracy.
40	Ruangvanich et al. [63]	IEEE	Architecture of a learning analysis system in a virtual intelligent learning environment as a tool to support student learning.
41	Barlybayev et al. [64]	IEEE	Intelligent system for assessing students’ professional skills levels in e-learning.
42	Leithardt et al. [65]	IEEE	Control system for learning environments specialized in special education.
43	Lin et al. [66]	Springer	Complementary recommendation structure for freshmen under restrictions or requirements, based on objective-oriented standards.
44	Chen et al. [67]	Springer	Phased forecasting model to predict students at risk at different stages of a semester.
45	Niknam and Thulasiraman [68]	Springer	Intelligent learning path recommendation based on meaningful learning theory.
46	Turabieh et al. [69]	Springer	Harris Hawks algorithm optimization enhanced as a feature selection for predicting student performance.
47	Iatrellis et al. [70]	Springer	Two-stage machine learning approach to predict student outcomes.
48	Ullah et al. [71]	Springer	IoT model based on Software Defined Network for student interaction, which interconnects students and teacher in a smart city environment
49	Nuguri et al. [72]	Springer	Cloud-based virtual reality learning environment (VRLE) system that can be deployed on high-speed networks using the platform.
50	Azzi et al. [73]	Springer	Classifier capable of identifying the student’s learning style in the e-learning system.
51	Mendes et al. [74]	Springer	Educational tool based on motion detection using the Kinect sensor in a game that is projected on the classroom wall.

Lagman and Mansul [44] conducted a study with individualized and personalized learning, adapted to specific learning requirements and preferences. The research focuses on student assessments and learning as the main key component of e-learning processes. The system captures student’s e-learning paths, determines difficult topics and subjects, and provides intervention to the learning process. The system helps students to improve their performance.

Chanaa and Faddouli [30] created a model with three main components: cognitive analysis, learning style, and sentimental analysis. The model uses trails of learners when using a learning management system to find convenient information about students. In addition, the model also improves course completion rate and provides appropriate content to meet individual student needs.

Kolekar et al. [43] focused on the characteristics of students and the development of user interfaces according to their learning styles. The sample selected was the second-year engineering students, comprising seventy-six students grouped into two class units called experimental and control groups. The inference proves that the identification of learning styles and recommendation of course content and topics increase students’ performance.

Khosravi et al. [51] developed an adaptable, scalable, content-independent learning system (RiPPLE) that depends on crowdsourcing and partnering with students to develop learning resources that are served by adaptive forms. RiPPLE is an adaptive learning system that recommends personalized learning activities to students, based on their state of knowledge. The system recommends from a grouping of crowdsourced learning activities that are generated and evaluated by educators and students themselves.

Villegas-Ch et al. [57] proposed the integration of technologies, such as artificial intelligence (AI) and data analysis, with learning management systems to improve learning. The proposal was based on an online education model from a university in Ecuador. As a tool, the model used an LMS, where students had sections with resources and activities that served for the training of the model.

Villegas-Ch et al. [57] presented an assistant for students and teachers, allowing for the management of students’ calendars, as well as the generation of events and reminders. The assistant sends notifications to students informing them which activities must be performed. In addition, it performs continuous monitoring, allowing students to improve their performance.

Han and Xu [59] proposed an intelligent education system that was customized to provide students with resources to suit their perceptions when starting the platform. The systems provide an environment with a full range of asynchronous and synchronous communication tools. The designed system requires a combination of sensors, devices, software, applications, and services in real-time.

Chang et al. [61] developed an ontology capable of mapping student interaction data to a set of tutoring actions. This mechanism allowed an artificial tutor to observe students in terms of their interactions with the learning environment. It also provides an appropriate tutoring action to improve the learning process. The learning environment discretizes the learning process in a sequence of activities, and the student’s interaction data comes from the last activity but also includes a set of data aggregating information from previous activities (learning history). Although normally an ontology is built by humans (knowledge engineers and experts in the field), in this work, the authors proposed an automatic process of building ontology.

Ruangvanich et al. [63] developed a learning analysis system as a tool to support student learning. The technologies have been proposed as a means of supporting reflective practice based on instructor data, and these technologies are considered a priority in educational research and innovation. The system consists of ten elements, namely: Virtual Learning Environment, Learning Analysis, Alert, LMS, Learning Records, Stakeholders, Data, Student Information, Learn Direct, and Report Information.

Azzi et al. [73] proposed a classifier capable of identifying the student’s learning style in the E-Learning System. The student’s learning behavior was captured in different contexts, usually in different courses related to a specific subject. Web usage mining was used to capture students’ behaviors, and then learning styles were mapped to the Felder-Silverman Learning Style Model (FSLSM) categories. The authors used the Fuzzy C Means (FCM) algorithm to group the behavioral learning data.

Ullah et al. [71] proposed the IoT model based on Software Defined Network (RDS) for student interaction, which interconnects students to a teacher in a smart city environment. Students and teachers are free to move anywhere, anytime, and with any hardware. An RDS-IMSI model interconnects students with the teacher through their heterogeneous IoT devices.

Nuguri et al. [72] presented vSocial, a cloud-based virtual reality learning environment (VRLE) system that can be deployed on high-speed networks using the high-fidelity “social VR” platform. For the development of vSocial, the authors relied on the use of an existing special education VLE, the iSocial that trains young people with Autism Spectrum Disorder through the implementation of the Social Competence Intervention (SCI) curriculum.

Leithardt et al. [65] developed a control system for learning environments specialized in special education. Among its many possible uses, the system focuses on managing the attendance to classes of special education students, teachers, and other classroom users through the use of widespread and ubiquitous technologies. The system aims to contribute to the extension of pervasive computing systems to educational environments.

Mendes et al. [74] proposed an educational tool based on motion detection using the Kinect sensor in a game that is projected on the classroom wall. Students use balls to hit the projected elements. These collisions are detected by the sensor and registered in the program, thus completing the task in question. According to the authors, the system and architecture were designed to make life easier for teachers in promoting physical activity in combination with classroom learning. The proposed system is based on the projection of educational activities and the possibility for students or users to interact with them through the exercises.

Table 4. Articles containing learning systems.

Authors	Learning Systems
Chanaa and Faddouli [30]	Custom model with 3 main components, cognitive analysis, learning style, and sentiment analysis.
Dahdouh et al. [25]	Online learning systems based on big data technologies and cloud computing.
Kolekar et al. [43]	User interface personalized through learning styles.
Kozierkiewicz-Hetmańska and Zyundefinedk [27]	Algorithm to determine an opening learning scenario based on the ant colony optimization technique.
Lagman and Mansul [44]	System dedicated to monitor the pathways in e-learning environments. The system can detect difficult subjects and provide intervention in learning process.
Lavoie and Proulx [24]	Learning management system with unique features oriented to inverted courses.
Wang et al. [26]	Intelligent teaching assistant system that replaces the way the user waits for manual response.
Khosravi et al. [51]	Adaptive learning system with a focus on the student, scalable and independent of content that depends on crowdsourcing and partnership with students for the development of learning resources.
Villegas-Ch et al. [57]	Integration of technologies, with AI and data analysis, with learning management systems to improve learning.
Han and Xu [59]	Intelligent education platform based on deep learning and image detection.
Chang et al. [61]	Ontology to mapping student interaction data with respect to a set of tutorial actions, allowing an artificial tutor to observe the student and his interactions with the learning environment.
Ruangvanich et al. [63]	Architecture of a learning analysis system in a virtual intelligent learning environment as a tool to support student learning.
Leithardt et al. [65]	Control system for learning environments specialized in special education.
Ullah et al. [71]	IoT model based on Software Defined Network for student interaction, which interconnects students to a teacher in a smart city environment.
Nuguri et al. [72]	Cloud-based virtual reality learning environment (VRLE) system that can be deployed on high-speed networks using the platform.
Azzi et al. [73]	Classifier capable of identifying the student’s learning style in the e-learning system.
Mendes et al. [74]	Educational tool based on motion detection using the Kinect sensor in a game that is projected on the classroom wall.

presents the 17 works with learning systems from 51 articles analyzed. In addition, Figure 1 presents the learning systems and technologies used by the researchers in the articles. Among the main technologies, Deep Learning Algorithms stood out with three articles.

4.2. Recommendation Systems

Huang et al. [38] proposed a new deep reinforcement learning framework for Exercise Recommendation (DRE). Two exercise Q networks (EQN) were proposed to select exercise recommendations following different mechanisms, namely, a direct EQNM with Markov property and a sophisticated EQNR with a recurrent way. Three domain-specific rewards were also leveraged to characterize the benefits of factors such as review and exploration, smoothness, and engagement to enable the DRE to find the optimal recommendation strategy. The work carried out experiments on two sets of real-world data. The results show that the proposed DRE can effectively learn from student interaction data to optimize multiple objectives in a single unified structure and adaptively recommend appropriate exercises to students.

Joy et al. [40] proposed an ontology to integrate the student’s profile and the attributes of the learning objects. The ontology conceptualizes the characteristics of the student and the learning object and suggests an adaptive learning environment. The static and dynamic characteristics of a student are considered in the ontology. The static data are collected directly through forms and questionnaires, and the dynamic data are collected by tracking student behavior while interacting through a learning management system.

Kapembe and Quenum [41] presented a hybrid recommendation model, based on the student’s profile, in which the value and quality of learning objects for the program in which the student is enrolled and the student comments. The approach uses student learning behavior, performance, and interests to suggest learning objects based on the student’s profile. The recommendation system consists of two components, the content-based learning object filtering module, and the collaborative filtering module.

Sharma and Ahuja [46] presented an integrated approach to semantic recommendation using ontology to recommend relevant and personalized learning content to students. According to the authors, during their early stages, recommendation systems often face the problem of cold booting. This is due to the scarcity of information available during these phases. The proposed system approaches this problem, maintaining an ontological approach to the user profile and improving the accuracy of the recommendations during the experiment.

Florian et al. [36] presented a study based on Engeström’s Activity Theory and the Actuator–Indicator model as pillars to implement an apprentice model based on Moodle’s activities. The authors developed a prototype that implements indicators as examples of analytical learning applications. The prototyping process indicated that Moodle activity tracking includes data on more complex social structures. The authors analyzed the reuse of Moodle tracking data for modeling students and groups. Moodle’s activity log was used to build advanced models based on students’ activities in social contexts and their implications for learning support.

Anaya et al. [28] proposed a recommendation system based on Influence Diagrams (ID) for collaborative learning in the e-learning environment. The ID solution provided a recommendation decision table, which alerts to problematic situations. An ID was proposed including the essential variables to assess the student’s collaboration and the variable that represents whether there was a collaboration or not.

Hamada [37] developed an improved version of a learning style index, considering students’ cultural differences. The model allows students to verify their learning preferences, and teachers have a broader view of their students’ learning preferences. The model was integrated into an e-learning system based on Java2D technology that contains a set of learning materials to support students.

Chen et al. [31] created an enhanced recommendation method called Adaptive Recommendation based on Online Learning Style (AROLS). This method is integrated into a comprehensive learning style model for online learners. The method makes recommendations considering the learning style as previous knowledge. First, it generates groups of students of different learning styles. Second, the behavioral patterns represented by the similarity matrix of learning resources and the membership rules of each cluster are extracted using the students’ browsing history, creating a set of custom recommendations of variable size according to the data mining results of the previous steps.

Iqbal et al. [39] proposed a context-aware framework for both user- and item-based versions by using the kernel mapping concept in collaborative filtering. The Kernel mapping recommender system algorithm is based on a novel structure learning technique. This framework has the flexibility to exploit various user- and item-related contexts during the recommendation process using different kernels that influence the performance of the system by improving the predictive accuracy, scalability, and flexibility factors. The proposed algorithm was compared with pre- and post-filtering approaches since they are the favorite approaches in the literature to solve the problem of context-aware recommendation.

A system for course recommendation distributed to the e-learning platform was also developed by Dahdouh et al. [32]. The system aims to discover the relationships between the student’s activities using the association rules method to help choose the most appropriate learning materials. In addition, it was used to analyze historical data passed from enrollment in courses or registration data. The article especially discussed the concept of frequent itemsets for determining interesting rules in the database. The extracted rules are then used to find the most appropriate course according to the student’s profile. The recommendation system uses big data technologies and techniques.

Venugopalan et al. [48] proposed a content-based recommendation system based on pedagogical content modeling. The system considers user queries and finds the best match. The experiment validated the system involving students seeking engineering education. The results showed that the system presents a high recovery of relevant and accurate results.

Zakrzewska [49] presented an agent-based recommendation system, which, for each new student, suggests a group of students with a similar profile and indicates corresponding learning resources. The method can be used when creating the course or when creating activities for groups. The system assumes that groups of students were created based on similar characteristics, such as usability preferences, similar behaviors, or cognitive styles. The tests were done with real data and different groups of students. The performance of the technique was validated based on student data described by cognitive traits, such as the dimensions of the dominant learning style.

The work proposed by Rajkumar and Ganapathy [62] found a correlation between introverted and extroverted personality types and their corresponding learning styles. The modified VARK questionnaire was implemented as a chatbot to classify individuals. After chatbot evaluations, all students (introverts and extroverts) watched the visual and auditory content in a completely silent environment. While watching the content, the students’ Beta brainwaves were recorded, and a dataset was created at an interval of one second. This dataset was validated using machine learning classification algorithms such as Naïve Bayes, N48 tree, and clustering algorithms, improving the accuracy of students’ classification.

Maâloul and Bahou [55] proposed a recommendation system that is fundamentally based on a digital learning technique (that is, semisupervised learning) and that determines the degree of similarity between the students, to recommend the items corresponding to the interest of the student. The system aims to process student profiles from the e-learning platform. The proposal aims to predict and determine student preferences based on information shared on their different social media.

Shi et al. [60] proposed a learning path recommendation model based on a multidimensional knowledge graph structure. Initially, the authors designed a multidimensional knowledge graph structure that separately stores learning objects organized in several classes. Then, they proposed six main semantic relationships between learning objects in the knowledge graph. Second, they designed a path recommendation model based on the multidimensional knowledge graph structure. The model generates and suggests personalized learning paths according to the student’s target learning object. The results of the experience indicated that the proposed model can generate and recommend qualified and personalized learning paths to improve learning experiences.

Lin et al. [66] proposed a complementary recommendation framework for freshmen under constraints or requirements, based on goal-oriented standards. Students can obtain the results of recommendations according to different types of learning objectives. The structure developed by the authors presents the following contributions: (1) convex optimization framework through the integration of the characteristics of the university’s courses and students and (2) data-based machine learning algorithm using resources extracted from formatted and unformatted data.

Niknam and Thulasiraman [68] designed and implemented a learning path recommendation (LPR) system. The system groups students and chooses a suitable learning path for students based on their prior knowledge. The clustering component used the Fuzzy C-Mean (FCM) algorithm, which can recommend more than one learning path for students located on the cluster boundaries. The effectiveness of the LPR system was assessed by developing and offering a database course for real students.

Villegas-Ch et al. [58] proposed an architecture for the integration of a chatbot with artificial intelligence in an intelligent campus for improving learning. The authors developed a model that integrates the identification and evaluation of variables through the analysis of data that students generate in the academic systems. The results of the data analysis are transferred to an AI tool for decision making.

Among the 51 articles evaluated, Table 5 presents 18 works with different recommendation systems to use as strategies to improve students’ learning.

Figure 2 shows the distribution of recommendation systems and technologies used by researchers in the articles. Among the main technologies, the most used were machine learning techniques with three articles.

Table 5. Articles that contain recommendation systems.

Authors	Recommendation Systems
Anaya et al. [28]	Recommendation system based on an ID in the context of collaborative learning in the e-learning environment.
Joy et al. [40]	Ontology model that encompasses the student profile and learning object attributes, which can be used for recommending content on an e-learning platform.
Chen et al. [31]	Enhanced recommendation method called Adaptive Recommendation based on Online Learning Style (AROLS).
Dahdouh et al. [32]	System of recommendation of courses distributed to the e-learning platform.
Florian et al. [36]	System supporting indicators related to applications of learning analytics.
Hamada [37]	Model of an e-learning system based on Java2D technology and containing an intensive set of learning materials to support all types of students.
Huang et al. [38]	Deep Reinforcement learning structure for Exercise Recommendation.
Iqbal et al. [39]	Kernel Context Recommendation System algorithm, which is flexible, fast, and accurate.
Kapembe and Quenum [41]	Hybrid recommendation, based on the student’s profile, the relevance and quality of learning objects for the program in which the student is enrolled.
Sharma and Ahuja [46]	Semantic recommendation using ontology to recommend relevant and personalized learning content to students.
Venugopalan et al. [48]	Content-based recommendation system.
Zakrzewska [49]	Agent-based recommendation system, which, for each new student, suggests a group of students of similar profiles.
Maâloul and Bahou [55]	Recommendation system based on machine learning that is fundamentally based on a digital learning technique and that determines the degree of similarity between students.
Villegas-Ch et al. [58]	Architecture for Integration of Chatbot with Artificial Intelligence in Intelligent Campus for Improvement of Learning.
Shi et al. [60]	Learning path recommendation model based on a multidimensional knowledge graph structure.
Rajkumar and Ganapathy [62]	Recommendation system to increase classification accuracy.
Lin et al. [66]	Complementary recommendation structure for freshmen under restrictions or requirements, based on objective-oriented standards.
Niknam and Thulasiraman [68]	Intelligent learning path recommendation based on meaningful learning theory.

Table 5. Articles that contain recommendation systems.

Authors	Recommendation Systems
Anaya et al. [28]	Recommendation system based on an ID in the context of collaborative learning in the e-learning environment.
Joy et al. [40]	Ontology model that encompasses the student profile and learning object attributes, which can be used for recommending content on an e-learning platform.
Chen et al. [31]	Enhanced recommendation method called Adaptive Recommendation based on Online Learning Style (AROLS).
Dahdouh et al. [32]	System of recommendation of courses distributed to the e-learning platform.
Florian et al. [36]	System supporting indicators related to applications of learning analytics.
Hamada [37]	Model of an e-learning system based on Java2D technology and containing an intensive set of learning materials to support all types of students.
Huang et al. [38]	Deep Reinforcement learning structure for Exercise Recommendation.
Iqbal et al. [39]	Kernel Context Recommendation System algorithm, which is flexible, fast, and accurate.
Kapembe and Quenum [41]	Hybrid recommendation, based on the student’s profile, the relevance and quality of learning objects for the program in which the student is enrolled.
Sharma and Ahuja [46]	Semantic recommendation using ontology to recommend relevant and personalized learning content to students.
Venugopalan et al. [48]	Content-based recommendation system.
Zakrzewska [49]	Agent-based recommendation system, which, for each new student, suggests a group of students of similar profiles.
Maâloul and Bahou [55]	Recommendation system based on machine learning that is fundamentally based on a digital learning technique and that determines the degree of similarity between students.
Villegas-Ch et al. [58]	Architecture for Integration of Chatbot with Artificial Intelligence in Intelligent Campus for Improvement of Learning.
Shi et al. [60]	Learning path recommendation model based on a multidimensional knowledge graph structure.
Rajkumar and Ganapathy [62]	Recommendation system to increase classification accuracy.
Lin et al. [66]	Complementary recommendation structure for freshmen under restrictions or requirements, based on objective-oriented standards.
Niknam and Thulasiraman [68]	Intelligent learning path recommendation based on meaningful learning theory.

4.3. Forecasting Models or Systems

Table 6 presents prediction models or systems observed in 13 articles among the 51 analyzed.

El Fouki et al. [34] proposed a decision-making system that helps instructors respond to problems using intelligent general techniques applied to data collected on e-learning platforms. The adapted system explores parameters such as learning styles and teaching styles, based on deep neural network algorithms and reinforcement learning, and takes into account the use of the teacher to improve the accuracy of the recommendation system. Principal component analysis and reinforcement learning improve classification models and increase the prediction performance of a deep neural network algorithm, reducing the dimensionality of dataset variables, with accuracy and reliability.

Manhães et al. [45] proposed the WAVE architecture that supports useful information on the performance of undergraduate students and predicts those who are at risk of dropping out of the educational system. The authors used several classifier algorithms. The Naïve Bayes algorithm showed the highest true positive rate in the three undergraduate courses analyzed.

El Moustamid et al. [35] developed a multimedia recommendation system capable of analyzing student profiles and indexing videos on the web to offer a database with courses according to the student’s level, aiming at their improvement. The first block represents a standard learning management system. In this block, the students must authenticate themselves. The second block represents a system that retrieves the results, processes, and converts them into exploitable data, and then sends to the third block in the form of an order. The third block retrieves the data from the second block and looks for videos that are located on the web or in a data source provided by the user and keeps the videos that match the student’s profile.

Table 6. Articles that contain forecast models or systems.

Authors	Forecast Models or Systems
El Fouki et al. [34]	System for assisting instructors to take decisions.
El Moustamid et al. [35]	System that analyzes students profiles and indexes videos on the web in order to offer students a database with courses that correspond to their levels.
Kim and Kim [42]	Individualized Tutor of Artificial Intelligence as a system that integrates three developmental learning networks (DLNS).
Manhães et al. [45]	WAVE architecture that provides useful information about student performance.
Thai-Nghe et al. [47]	Techniques of recommendation for mining educational data, especially to predict student performance.
Zaoudi and Belhadaoui [50]	Learner Behavior Analytics (LBA) model that uses a system called Score and Behavior Analytics (SBAN) to analyze student outcomes and behavior.
Chen et al. [67]	Phased forecasting model to predict students at risk at different stages of a semester.
Turabieh et al. [69]	Harris Hawks algorithm optimization enhanced as a feature selection for predicting student performance.
Iatrellis et al. [70]	Two-stage machine learning approach to predict student outcomes.
Angeline et al. [53]	Discriminant analysis to measure student performance.
Zhang et al. [52]	Learning analysis using Moodle plugins to discover possibilities to improve the learning process and reduce the number of underperforming students using plugins from the virtual Moodle environment.
Hashim et al. [54]	Student performance prediction model based on supervised machine learning algorithms (decision tree, Naïve Bayes, logistic regression, support vector machine, K-nearest neighbor, and minimal and neural sequential optimization Network).
Freitas et al. [56]	IoT system for predicting school dropout using machine learning techniques based on socioeconomic data.

Table 6. Articles that contain forecast models or systems.

Authors	Forecast Models or Systems
El Fouki et al. [34]	System for assisting instructors to take decisions.
El Moustamid et al. [35]	System that analyzes students profiles and indexes videos on the web in order to offer students a database with courses that correspond to their levels.
Kim and Kim [42]	Individualized Tutor of Artificial Intelligence as a system that integrates three developmental learning networks (DLNS).
Manhães et al. [45]	WAVE architecture that provides useful information about student performance.
Thai-Nghe et al. [47]	Techniques of recommendation for mining educational data, especially to predict student performance.
Zaoudi and Belhadaoui [50]	Learner Behavior Analytics (LBA) model that uses a system called Score and Behavior Analytics (SBAN) to analyze student outcomes and behavior.
Chen et al. [67]	Phased forecasting model to predict students at risk at different stages of a semester.
Turabieh et al. [69]	Harris Hawks algorithm optimization enhanced as a feature selection for predicting student performance.
Iatrellis et al. [70]	Two-stage machine learning approach to predict student outcomes.
Angeline et al. [53]	Discriminant analysis to measure student performance.
Zhang et al. [52]	Learning analysis using Moodle plugins to discover possibilities to improve the learning process and reduce the number of underperforming students using plugins from the virtual Moodle environment.
Hashim et al. [54]	Student performance prediction model based on supervised machine learning algorithms (decision tree, Naïve Bayes, logistic regression, support vector machine, K-nearest neighbor, and minimal and neural sequential optimization Network).
Freitas et al. [56]	IoT system for predicting school dropout using machine learning techniques based on socioeconomic data.

Thai-Nghe et al. [47] proposed a new approach that uses recommendation system techniques for educational data mining to predict student behavior. Recommendation systems techniques were compared with traditional regression methods, using data from intelligent tutoring systems. The work presented the following contributions: (1) the application of recommendation systems techniques, such as matrix factoring in the educational context, to predict student performance; (2) educational data mapping research; and (3) comparison of recommendation systems with traditional techniques such as linear regression or logistic regression. Experimental results showed that the proposed approach can improve prediction results.

Kim and Kim [42] developed an individualized AI tutor as a system that integrates three Developmental Learning Networks (DLNs) to help a student achieve a high level of academic success. The AI Tutor suggests learning content that matches the educational standard of the academic grade. The AI tutor considers the student’s current status and preferences to deliver education programs on an individual basis.

Zaoudi and Belhadaoui [50] proposed a Learner Behavior Analytics (LBA) model based on a system called Score and Behavior Analytics (SBAN) to analyze student outcomes and behavior. This model would be responsible for continuously monitoring and evaluating the student’s actual level throughout their training trajectory. The authors intended to further detail these models, proposing an architecture and prototypes that would allow better modeling for the LBA system, making it possible to present content more adaptable to the profiles of evolving students.

Chen et al. [67] proposed a phased forecasting model to predict at-risk students in different semesters. Students’ characteristics and online learning behaviors were analyzed.The proposed model has three main contributions: (1) restriction strategies to obtain valuable resources; (2) a dynamic prediction model; and (3) it can predict at-risk students at different stages of the semester.

Iatrellis et al. [70] proposed a two-stage machine learning approach that uses supervised and unsupervised learning techniques to predict outcomes for students in higher education. The objective of the research was to predict the results of students in undergraduate courses in computer science offered by higher education institutions in Greece. Students involved in the case study were grouped based on the similarity of education-related factors and metrics. The K-means algorithm was used in the clustering experiments, and the result produced evidence that the proposed approach can contribute to the accuracy of predicting student outcomes.

Turabieh et al. [69] simulated the proposed modification of the Harris Hawks Optimization algorithm as a resource selection algorithm for the students’ performance prediction problem. The proposed approach improves the original Harris Hawks Optimization algorithm and supports the claim that the control of population diversity improves the process of exploring the algorithm.

Zhang et al. [52] performed learning analytics to discover possibilities to improve the learning process and reduce the number of underperforming students using plug-ins from the Moodle virtual environment. The analysis considered records of 124 participants, to verify the relationship between the amount of records in the e-course and the students’ final grades. The authors also performed a correlation analysis to determine the impact of students’ educational activity on the Moodle system in the final assessment.

Angeline et al. [53] used discriminant analysis to measure student performance. The data-mining technique identified students’ cognitive skills and their associated behaviors in a virtual instructor-led classroom. The datasets collected in the research study refer to different subjects addressed by students of engineering graduates from Dr. G. U. Pope College of Engineering (Hyderabad, India). The students’ performances in the respective discipline prerequisites were collected from the departmental records of summaries of results related to the computer science course and the engineering discipline. According to the authors, the discriminant analysis works well with the dataset covering all data groups and provides a better forecast.

Hashim et al. [54] compared the performance of various supervised machine learning algorithms to predict students’ academic success and their performance in higher education. The authors used a set of data provided by the courses in the bachelor’s degree programs of the Faculty of Informatics and Information Technology at the University of Basra, in the 2017–2018 and 2018–2019 academic years, to predict student performance on final exams. The experiments showed that the Logistic Regression classifier algorithm demonstrated the best performance.

Freitas et al. [56] proposed an approach to detect and classify students at risk of dropping out based on their socioeconomic data. The IoT platform was designed to allow this task to be performed using any device connected to the Internet. Machine learning methods were used to identify the possibility of evasion.

Figure 3 shows the distribution of forecast models or systems and technologies used by researchers in the articles. The 13 works contain proposals that identify the characteristics and profiles of students with learning problems and probable dropout before the end of the course, enabling actions to improve the learning process.

4.4. Assessment Tool

Among the 51 articles analyzed, only three presented assessment tools (Table 7): Domain-specific language to customize online learning assessments in Moodle [29], a system called Enriched Learning Analytics Rubric (LAe-R) [33], and an intelligent system for assessing students’ professional skills levels in e-learning [64].

Balderas et al. [29] developed a domain-specific language to customize online learning assessments in Moodle. The authors implemented EvalCourse, a computer system that performs queries written in this language, providing in the output the requested information. In this way, teachers can retrieve the indicators of information stored in Moodle activity logs without any technical knowledge in databases or computer programming. The study was carried out at the University of Cádiz, Spain, in a mandatory course of Language Processors II from its degree in Computer Science, with 36 students from the first semester and the fifth year enrolled in the academic year 2012/13.

Table 7. Articles that contain an assessment tool.

Authors	Summary/Assessment Tool
Balderas et al. [29]	Domain-specific language to customize online learning assessments in Moodle.
Dimopoulos et al. [33]	A tool called Enriched Learning Analytics Rubric (LAe-R), developed as a Moodle plug-in.
Barlybayev et al. [64]	Intelligent system for assessing students’ professional skills levels in e-learning.

Table 7. Articles that contain an assessment tool.

Authors	Summary/Assessment Tool
Balderas et al. [29]	Domain-specific language to customize online learning assessments in Moodle.
Dimopoulos et al. [33]	A tool called Enriched Learning Analytics Rubric (LAe-R), developed as a Moodle plug-in.
Barlybayev et al. [64]	Intelligent system for assessing students’ professional skills levels in e-learning.

Dimopoulos et al. [33] presented an evaluation tool called Enriched Learning Analytics Rubric (LAe-R), which was developed as a Moodle plug-in. LAe-R allows teachers to create enriched rubrics containing related criteria and classification levels. For this, data extracted from the analysis of student interaction and learning behavior in a course in the Moodle environment are used, such as the number of messages posted, access times, material, and task notes. LAe-R was considered a stable and promising assessment tool that can fill the gap in evaluating student performance in e-learning environments using student interaction data.

Barlybayev et al. [64] proposed the creation of an intelligent system for assessing students’ professional skills levels in e-learning. Mathematical models and methods were used to evaluate the formation of students’ professional skills at the level of subjects, modules, and the entire educational program. Competency (knowledge) assessments were carried out at the three levels of the educational program. To assess knowledge, fuzzy binary relationships were used with standard responses from the knowledge base and the responses of students. The authors used fuzzy calculations on data obtained by the comparison algorithm. The construction of fuzzy calculations used the Mamdani method implemented in Matlab.

5. Discussion

This section discusses the results obtained by reviewing the literature, analyzing the articles, and identifying gaps to encourage future research. The analysis of 51 articles identified a variety of intelligent services applied to distance learning. Intelligent services were categorized as learning systems (17), recommendation systems (18), prediction systems (13), and assessment tools (3).

Section 4.1 showed that the authors proposed different learning systems that help both managers and teachers in the teaching and learning process.

Through the services offered by the learning systems, institutions can promote a quality education directed to the profile of each student. Learning systems enable teachers to help struggling students individually or in groups, select courses that best suit the student’s profile, and choose learning materials best suited to the student’s learning styles and level of knowledge.

In addition, learning systems contribute to interactivity between students and teachers, promote student enthusiasm for learning through continuous feedback, provide intervention to the learning process, contribute to the evolution of student performance, improve course completion rate, and provide content appropriate to meet individual student needs.

Section 4.2 showed that the proposed recommendation systems have different types of recommendations.

Recommendation systems collect and learn from students’ data as they interact through a learning management system and use their learning behaviors to recommend different intelligent services such as appropriate exercises (Huang et al. [38]), objects learning (Lin et al. [66]; Kapembe and Quenum [41]; Joy et al. [40]), personalized learning content (Sharma and Ahuja [46]), supportive teaching materials (Hamada [37]), courses according to the student profile (Dahdouh et al. [32]), and personalized learning paths to enhance learning experiences (Niknam and Thulasiraman [68]).

Other referral systems also suggest groups of students with a similar profile and indicate related learning resources. The recommendation systems mostly take advantage of student-generated data when using virtual learning environments or educational systems. Data are analyzed and used to recommend intelligent services. These systems serve as a strategy to improve student learning.

The literature review in Section 4.3 also showed different systems that used student data analysis to predict the risk of failure or dropout in distance learning courses. The works presented in this section address prediction systems.

The analyzed works propose systems that identify the characteristics and profiles of students and predict their behavior (Zaoudi and Belhadaoui [50]; Thai-Nghe et al. [47]), cognitive skills (Angeline et al. [53]), academic success (Kim and Kim [42]; Hashim et al. [54]), performance (Iatrellis et al. [70]), learning styles (El Fouki et al. [34]), and potential dropout or failure (Manhães et al. [45]; Chen et al. [67]; Freitas et al. [56]).

These systems help institutions to make decisions in the short, medium, and long term. The systems also enable actions to improve the teaching and learning process and reduce the failure and dropout rate.

Section 4.4 presented assessment tools, among which only three works addressed this category.

The works addressed the following themes: a domain language was developed to customize assessments and assess the performance and skills of students in the Moodle environment (Balderas et al. [29]); a tool to assess student performance and learning behavior using student interaction data, such as the number of post messages, access times to learning material and task grades (Dimopoulos et al. [33]), and, finally, an intelligent system that assesses the competence levels and the formation of professional skills of students in an educational program (Barlybayev et al. [64]).

The literature review focused on intelligent services applied to distance learning, and during the research, lessons were learned related to the categories of services found.

Table 8. Lessons learned.

Item	Description
1	Intelligent services categorized as learning systems and recommendation systems are trends among intelligent systems. The use of intelligent systems helps teachers and managers in decision making in the face of the problems found in distance learning courses.
2	Learning systems identify learning behavior patterns, identify underachieving students, and provide personalized tools or content as educational support.
3	Intelligent systems promote improvements in learning and make it possible to minimize the dropout rate in distance learning courses.
4	Prediction systems are used in discovering student behavior patterns, predicting academic progress and possible dropout.
5	Intelligent systems allow teachers and managers to use the information to reduce problems faced in conducting distance learning courses, such as failure and dropout.
6	Intelligent systems can be used as a complementary educational tool to help students improve their academic performance.
7	Intelligent systems with recommendation functions can solve problems in the teaching and learning process by offering the appropriate content that meets the students’ individual needs and preferences.
8	Intelligent systems can offer differentiated services according to the student’s profile.
9	Intelligent systems can be used as advanced assessment tools.
10	Intelligent systems provide statistical and analytical services by showing the data on dashboards, thus facilitating management by graphically presenting the information.
11	Intelligent systems can trigger personalized alerts for multiple devices, keeping managers and system administrators informed about alerts triggered via triggers for important events; messages can be directed to the responsible smartphones to take actions in time, including anticipating events.
12	Intelligent systems can be configured to receive data from various IoT devices scattered in the educational environment such as entrance, classroom, presence detector, proximity detectors, biometric readers, classroom temperature, and humidity. Intelligent services can also receive data from mobile devices of remote students such as login date and time, connection time, and location, among others.

presents the twelve lessons learned in this literature review.

6. Conclusions and Future Research

Distance Learning aims to offer a complete, dynamic, and efficient teaching and learning process mediated by technological resources. It has been growing exponentially and taking an important role in the educational environment. The use of this modality allows the generation of information according to the behavior of students in Virtual Learning Environments (VLEs).

The data extracted from the VLEs are analyzed using data analysis techniques that identify student behavior patterns. The discovery of standards helps managers and teachers in strategic planning, allows monitoring the student’s academic progress, and offers solutions through intelligent services for monitoring, intervention, motivation, and improvement in the students’ learning process.

A research methodology based on a literature review allowed the identification of 51 publications on intelligent services applied to distance learning. Among the intelligent services, 33% (17 articles) presented learning systems, 35% (18 articles) contained recommendation systems, 26% (13 articles) presented models or forecasting systems, and only 6% (3 articles) contain assessment tools.

The approach presented is broad, because the work addressed educational contexts at different levels of learning, focusing on distance learning, and, therefore, the text includes generic conclusions.

The study indicated that recommendation systems and learning systems are research trends. These systems analyze student profiles, identify patterns of behavior, detect low performance, and identify the probabilities of dropouts from courses.

Most research papers analyze the learning profile to indicate personalized content and courses or extracurricular activities that contribute to student learning. In addition, the studies allow teachers and educational managers to take preventive actions to minimize possible problems in the learning paths.

Future work will expand this literature review through a specific focus on mobile learning [75,76,77] and ubiquitous learning [65,78,79,80,81,82]. Both technologies allow expanding the limits of distance learning environments mainly collaborating to the infrastructure of intelligent systems. In this sense, the use of temporal series of contexts to organize and analyze data is an emergent research theme. This organization of data is called Context Histories [83,84,85] or Trails [86,87]. Context histories allow data analysis based on profile management [88], context prediction [89], and pattern and similarity analysis [90,91]. The continuation of this review will consider research works that applied Context Histories to implement intelligent services in distance learning.