Evaluation of the Functionality of a New E-Learning Platform vs. Previous Experiences in E-Learning and the Self-Assessment of Own Digital Literacy

Abstract

Recent civilizational transformations have led us to search for and introduce new didactic solutions. One of these is e-learning, which is a response to the needs of the education system and its individual stakeholders. The e-learning systems currently available offer similar solutions. Only during direct interaction with a given tool can one notice significant differences in their functionality. By carrying out evaluation studies the indicators that determine this functionality can be identified. The paper presents e-learning in the context of the academic training of the future generations of teachers. The reflections revolve around digital literacy and experience in using modern information and communication technologies in education. The goal of the research was to evaluate three areas: the functionality of the SELI platform, individual experiences with e-learning, and digital literacy. The technique used was an e-learning survey appended to the end of two e-learning courses offered on the platform. The survey was addressed to teachers and students of the biggest pedagogical university in Poland. The general impression of the content presented on the platform was, in most cases, rated as being very good or good. The platform itself was also evaluated positively. Based on the analyses conducted, two groups of platform users were identified. One third of the users have diverse experiences with e-learning, which corresponds with their digital literacy. The remaining two thirds of the respondents need more training in the areas evaluated. The authors of the paper believe that this type of study should accompany all activities that introduce e-learning at every stage of education. Only then will it be possible to discover where the digital divide lies among the teaching staff and learners.

1. Introduction

The development of modern means of communication has influenced contemporary education. Traditional forms of teaching and those based on e-learning have been enriched by new forms that overcome the barriers of time and space. Web-based training (WBT) and computer-based learning (CBL) not only expand the opportunities for teachers and students and increase the attractiveness of learning, but they also allow the elimination of factors that have previously limited both groups. Modern societies function mainly on the basis of information and knowledge, and thus their members need to develop their competencies both constantly and rapidly [1,2]. Individualization and easy access have become the categories that determine the attractiveness of educational offers. E-learning only requires access to dedicated tools, namely, e-learning platforms, which are usually intuitive and can be accessed using different technical devices.

To meet the current needs, universities offer classes using different LMS (learning management system) platforms. One important issue is the selection of the product that will meet the expectations of the academic teachers who develop the courses, and the students who participate in the resulting courses. To ensure the highest quality of learning and to include the needs of different study groups (as well as groups at risk of social marginalization), more and more advanced tools are designed. One of these is the SELI (Smart Ecosystem for Learning and Inclusion) platform, created as part of an international project. According to the requirements, the platform was subject to a complex evaluation that covered its different components. Evaluations of VLEs (virtual learning environments) are commonly used but most are limited to an assessment of the VLE’s functionality. The evaluation presented herein was expanded with the additional element of digital literacy (understood as knowledge, skills and previous experiences with technical operation and information management). Occasionally this subjective factor can affect the general evaluation of the product. The authors of the paper wanted to avoid this error. Verification of this variable enables an objective evaluation of the VLE, and also helps to separate opinions about purely technical aspects from opinions resulting from ignorance or subjective fears.

The lack of relevant digital literacy is one of the main factors that determine the digital divide. That is why all initiatives to develop digital literacy are so important. Education platforms provide an environment where this process takes place in a natural and practical way. The education market offers more and more advanced and user-friendly solutions. Monitoring the opinions of people from the risk group is a key element when developing innovative solutions to reduce educational failure among these individuals. Evaluation reports should be disseminated internationally because only the exchange of ideas and collaboration at this level will lead to the optimization of new e-learning environments.

Theoretical Framework

E-learning is defined as a formal approach to learning where the instructor and students interact remotely with one another using Internet technologies (e-infrastructure) [3]. There are different concepts and interpretations of e-learning. Each of these concepts is historically rooted and finds its expression in modern education institutions that are open to global culture, society, and individuals [4].

Pham et al. (2018) [5] list four main characteristics of e-learning. They include (1) instructor and students who work together remotely, (2) universities that support the learning and teaching process using online platforms together with adapted student evaluation strategies, (3) Internet technologies used for interactions between the instructor and the students, and (4) effective communication between all stakeholders.

The development of information and communication technologies and tools is rapid, and this is one of the reasons why e-learning is important from the perspective of mass implementation and development [6]. The rapid development of modern technologies forces researchers to undertake analyses systematizing changes related to technological determinism. The transformations resulting from the implementation of ICT (Information and Communication Technologies) in professional, private, and educational life are of interest not only to sociologists and computer scientists, but also to educators. Specialists in the field of education are currently analyzing more and more often the issue of the extent to which new technologies contribute to the improvement of digitally mediated didactics. In addition, researchers dealing with issues on the borderline between media sociology, pedagogy, and computer science are also trying to find factors that enable the effective implementation of new media in the educational process. Of course, researchers are aware of organizational, didactic, economic, motivational, and competence diversity. This diversity of determinants related to the implementation of new technologies in education has resulted in the emergence of several interesting theories useful in the analysis of the evaluation of new digital teaching tools. The list of the most popular theories used in research on digitally mediated didactics is presented in

Table 1. Review of the theories related to the inclusion of new technologies in educational processes.

Theory	Key Factors	Practical Training
TPACK	Technological, pedagogical, and content knowledge	Implementation of the new e-learning platform requires technological knowledge (digital competence), attractive and relevant educational content, methodological knowledge, and the ability to conduct digitally mediated classes [7,8,9].
The technology acceptance model (TAM)	Perceived usefulness (PU) and perceived ease of use (PEOU);	The implementation of the new e-learning platform requires the content and functionality of the digital learning environment to be focused on the usability of content and tools and take into account ease of use [10,11,12].
UTAUT (The Unified Theory of Acceptance and Use of Technology)	Performance expectancy, effort expectancy, social influence, and facilitating conditions	The implementation of a new digital learning environment requires taking into account the efficiency of the solution, the ability to anticipate the effort required to operate the platform, anticipating the social impact (e.g., rapid dissemination of the tool or vice versa), and creating conditions to facilitate the operation of the platform [13,14,15].
Lifelong learning in digital competence	Continuous updating of knowledge and ability to improve key competences with a particular focus on digital skills	The ability to implement new digital learning solutions requires lifelong learning skills [16,17,18]. The issue of updating knowledge and skills mainly concerns the digital competence of teachers [19,20,21].
Development of the information society	The development of the information society is an intense and irreversible phenomenon.	The development of the information society is noticeable in almost all areas of social life. Education is also changing intensely through the development of new websites and digital devices [22,23,24].

.

When analyzing issues related to the inclusion of new solutions in the implementation of e-learning, it is worth referring to the results of research that are consistent with the objectives of this study. Rabiman et al. [25] compared the results of traditional education and e-learning, emphasizing that contemporary students prefer digital content. This is of positive value for online education activities in a situation in which didactic materials can be processed (created, stored, and shared) via the Internet. However, for education to be successful, it requires a high level of interaction and collaboration [26]. Collaboration is a “form of relations” between students, it is the “way of learning,” and it focuses on the relationships implied by the tasks and on the process of completing these tasks [27]. Collaboration during problem-solving is one of the skills best promoted by modern e-learning. Problem-solving skills are considered an integral part of the process of understanding specific concepts during learning. However, the literature often reports high indicators of failure and discontinuation of activities on the platform or mobile applications. At the same time, both students and teachers appreciate the opportunities provided by e-learning and highly rate the way it supports cognitive processes and engagement in students [28]. In the context of e-learning, the philosophical position is also recalled, namely, that of social constructivism, which suggests that group work, language, and discourse are crucial for effective learning [29].

Thanks to online learning/teaching platforms, e-learning has greatly influenced the higher education system [30]. Pham et al. [31] quote the results of a diagnostic survey conducted since 1997. The survey in the academic year 1997–1998 showed that more and more academic courses were implemented as e-learning, supporting the education of over 1,400,000 students; in the academic year 2005–2006, more than 318,000 people in the U.S. received their bachelor’s degree in business and more than 146,000 people received their master’s degree in business using e-learning. These authors say this tendency is still growing, as can be demonstrated by the fact that many advanced Internet applications are being introduced at different universities. Information technology used for academic e-learning must be constantly improved and adapted to the needs of these universities. Tawafak et al. [32] conducted a study to develop a structure based on the university communication model (UCOM). They assume that, following Al-Qirim [33], online learning has become one of the most frequently used forms of learning and that it is a necessary university practice that includes the integration of e-learning and scientific mediation strategies, support for active learning, and real collaboration between students through online technologies. At the same time, they emphasize that e-learning faces some problems and therefore, there is a need for institutions to plan remote education and introduce more and more best practices to evaluate e-learning in order to improve student outcomes. Based on the previous experiences of different countries, universities organize distance learning at an ever higher level. This is particularly important in the case of pre-service teacher training, as by improving the level of their metacognitive competencies, these teachers can prepare their students for permanent education. As early as the first decade of the 21st century, the emphasis was on the development of cloud computing, as this would represent a great step towards closing the gaps between using ICT in teacher training and in teachers’ future professional work [34]. All the research has indicated that teachers must thoroughly plan their didactic role to facilitate communication situations adapted to different needs in a virtual environment that is based on asynchronous learning. Other studies explore the effectiveness of online education platforms in motivating teachers to improve their didactic skills and in motivating students to learn, as well as strategic grounds for choosing technologies according to learning goals and content [35]. For at least the last several years, universities have successfully made use of the Moodle platform, mainly in hybrid education. Researchers analyze mixed-model learning based on three main theories: behaviorism, cognitivism, and constructivism. However, in their attempts to obtain the most effective outcomes, they face many limitations [36,37].

At present, the emphasis is on the further development of e-learning platforms and adding specific, professional content prepared by experts in the relevant fields. There are important indicators that recommend the formation of a community of practitioners—teachers from different universities who would cooperate with the teaching staff within pedagogical universities in order to solve the existing content-related, didactic, and technical problems [38]. At the international level, higher education institutions recognize the need to implement and integrate ICT in order to be able to make use of current opportunities and face the challenges that attend the various innovations in teaching and learning processes [39]. As a result, a variety of experts have combined their efforts to implement virtual learning environments called “learning management systems,” with functionalities that support flexible and active learning within the constructivist approach. Previous studies confirm the instrumental and functional use of the platform, which serves mainly as a repository of resources and information, and its didactic use remains limited [39]. This problem needs to be discussed and reflected upon from a systemic perspective, especially in universities that train pre-service teachers.

This text is part of the analysis related to the modernization of education. The creation of a new, international e-learning platform is not a task that occurs very often in the field of pedagogical practice. It is also not an activity that is easy to implement due to the interdisciplinary nature of undertaken multi-stage and complex activities requiring knowledge in the field of computer science, pedagogy, higher education didactics, pedeutology. The results of the data presented in the next part show a fragment of activities within SELI—the Smart Ecosystem for Learning and Inclusion project, which developed a new virtual learning environment that has been implemented in select countries of Latin America, the Caribbean, and Europe. The implementation of the platform was combined with evaluation of the platform, improvement of the SELI environment, and measurement of key parameters for the platform’s implementation. The comparison of the platform’s evaluation, self-evaluation of digital competences of future users, and experiences related to e-learning is unique. It is a text that characterizes two areas that are strategic for the implementation of new solutions based on e-learning or mixed learning.

The presented text is also a response to the needs of the school and academic community, which is looking for new virtual programs and websites to enhance the effectiveness of learning and teaching. The text is unique because it combines an international perspective and research aimed at changing educational practices, and shows the coexistence of key variables for implementing new e-learning solutions.

2. Materials and Methods

2.1. Research Objective and Problems

The main purpose of the study was to evaluate the new e-learning platform SELI and to compare this evaluation with previous e-learning experiences and an evaluation of individual digital literacy. The following research questions were identified:

-

How do students and teachers evaluate the new e-learning platform?

-

What is the difference in the evaluation of elements of the new e-learning platform by teachers and students?

-

What is the relationship between the evaluation in terms of general course quality, professionally prepared materials, content usefulness, visual design, and the innovative character of the platform?

-

To what extent is the evaluation connected with previous experiences of e-learning and the self-evaluation of digital literacy?

-

Based on the data collected, which groups of users of the new platform can be identified?

2.2. Research Procedure

The study was conducted in the biggest Polish university that focuses mainly on the education of pre-service teachers. The research had a few stages. All stages of the study are shown in detail in the diagram below (Figure 1).

The SELI platform is an international implementation-research project by several countries from Latin America, Europe, and the Caribbean. Its goal is to create a new, visually attractive, intuitive website to support learning and teaching at the academic level [40,41], as well as teacher training for active teachers [42]. Designed from scratch, the platform addresses different levels of the digital divide [43] by creating a friendly learning and teaching environment within formal, non-formal, and informal education. The platform has an interface that enables the website to be used by people with visual and hearing impairments [44,45,46]. The tool was created in cooperation with a team of IT specialists, teachers, pedagogues, and special education teachers [47]. The platform uses relatively new solutions based on digital storytelling, blockchain, and problem-based learning [48]. It is available in a number of languages: English, Spanish, Portuguese, Turkish, and Polish. This study involves a test of the platform by Polish students using the Polish interface. The server used in the tests was located in Europe to ensure the stable functioning of the learning environment (The University of Eastern Finland, Joensuu, Finland). In the first part, students and teachers were invited to explore one of the two e-learning courses available on the SELI platform—Smart Ecosystem for Learning and Inclusion [49].

The students and teachers participating in the study were able to choose one of two courses: (1) Cyberbullying Prevention [50,51] or (2) Digital Inclusion [52]. The goal of the first course was to present information about the mechanisms and the scale of cyberbullying among children and adolescents, as well as the methods available to solve this problem in the context of teaching. The course was addressed to both active and pre-service teachers. The other course was designed to present the phenomenon of the digital divide and the methods by which digital inclusion can be achieved. It presented the complex methods used to improve the digital literacy of older people. Both courses were prepared by professionals with rich experience in research into cyberbullying and digital inclusion. The courses were subject to internal and external reviews. Screenshots of the platform interface are presented below (Figure 2).

Participation in testing and the final survey was voluntary. The study was conducted in Poland, with students of the pedagogical faculties and teachers participating in university vocational training between May and July 2020.

2.3. Sample Characteristics

There were 227 respondents. A total of 35.2% (N = 80) chose the Digital Inclusion course whereas 64.8% (N = 147) took part in the Cyberbullying Prevention course. A total of 98.2% were women (N = 223) and 1.8% men (N = 4). The disproportion in the sample results from the fact that the teaching profession and the student population in education faculties in Poland are highly female. A total of 83.3% (N = 189) of the respondents were students and 16.7% were active teachers (N = 38). A total of 46.3% (N = 105) of the respondents lived in rural areas, 26.4% lived in towns of up to 100,000 residents (N = 60), and 27.3% (N = 62) lived in a city with a population of more than 100,000. The sample does not allow for generalization into the broader population of pedagogy students or teachers. The average age of the respondents was 24.6, with a standard deviation of 7.47.

The teachers and future teachers examined were selected on a targeted basis. This was due to the assumptions of the project. The SELI platform is aimed at current and future pedagogical staff. Participation in the research was voluntary in Poland. Teachers cooperating with the Pedagogical University were invited to participate in the research, e.g., tutors of practices and teachers improving their professional qualifications. Students of pedagogical faculties also voluntarily chose the course in which they participated and then filled in the questionnaire. Students participating in academic courses related to new media were invited to participate in the survey. The instruction related to the platform and filling in the questionnaire was provided by the staff of the Pedagogical University in Krakow. The collected results do not allow for the transfer of the obtained regularities to all Polish teachers or pedagogical students. Nevertheless, the collected data allowed for the first testing of the SELI platform among people closely interested in the subject of digital inclusion and cyberbullying prevention.

2.4. Research Tools

Once they had tested the platform, the students and teachers were asked to complete a survey that consisted of several forms measuring:

• General evaluation of how the e-learning platform functioned, with a focus on the following elements: course quality, professionalism of the resources, usefulness of the content, graphic design, and modern character of the platform. Feedback was collected using the 5-degree Likert scale, where 1 is very poor and 5 is very good. The survey is an original tool with the following psychometric features:

Scale Reliability Statistics
	McDonald’s ω	Cronbach’s α	Gutmann’s λ6
scale	0.880	0.876	0.879

• Experiences with e-learning during the last year, including activities such as participation in online training that was mandatory in the official study curricula or required as part of career development, searching for appropriate resources on the Internet in order to complete online training, participation in free e-learning courses (e.g., foreign languages, ICT), participation in paid online courses, and participation in online study groups. The respondents provided answers where 1 is never and 5 is very often. The tool had the following psychometric features:

Scale Reliability Statistics
	McDonald’s ω	Cronbach’s α	Gutmann’s λ6
scale	0.680	0.666	0.651

• Self-evaluation of digital literacy, which included an evaluation of the skills and knowledge regarding the use of a text editor (e.g., Word), the use of a spreadsheet program (e.g., Excel, Calc), the ability to use presentation software (e.g., PowerPoint), the use of graphic software (e.g., Picasa, Gimp), and awareness of digital threats (e.g., cyberbullying, Internet addiction, sexting). The students evaluated their knowledge and skills using the 5-degree Likert scale where 1 is very low and 5 is very high.

Scale Reliability Statistics
	McDonald’s ω	Cronbach’s α	Gutmann’s λ6
scale	0.788	0.768	0.776

The whole tool presents a satisfactory level of Cronbach’s inner coherence: α = 0.731.

2.5. Limitations and Directions of Research

The study was conducted according to the accepted standards of the social sciences. However, given the characteristics of the sample, the data collected cannot be generalized across the whole population. The non-random sampling and non-representative sample do not enable the generalization and transfer of the results to all students and teachers who seek to improve their professional qualifications in Poland or who are studying at the Pedagogical University of Krakow. The postulate is to test the platform in more representative samples and in different types and forms of professional training of pre-service and active teachers. In addition, the authors are aware that the evaluation of digital literacy through self-assessment is not the perfect way to measure this variable. It is assumed that in later editions of the study, the tests used will employ, for example, the European Certificate of Digital Literacy (ECDL) sets to measure Digital Literacy.

3. Results

3.1. Evaluation of the New E-Learning Platform

Prior to answering the research problems, the proposed research model was verified. Based on Kaiser–Meyer–Olkin, it was noticed that all indicators for the proposed model are found in a range from moderate to high (see

Table 2. Kaiser–Meyer–Olkin test.

	MSA (Measure of Sampling Adequacy)
Overall MSA	0.758
General course quality	0.859
Professionally prepared materials	0.766
Content usefulness	0.782
Visual design	0.782
Innovative character of the platform	0.763
I took part in online courses required in the official study curriculum or as part of my professional development.	0.669
I searched for relevant resources on the Internet to complete online classes.	0.656
I took part in free e-learning courses (online courses such as foreign languages, ICT).	0.732
I took part in paid online courses.	0.711
I took part in online joint study groups.	0.783
Using a text editor	0.707
Using a spreadsheet program	0.767
Using presentation software	0.679
Using graphics software	0.763
Awareness of digital threats	0.803

). This means that the data collected allow for factor analysis. In the research, exploratory factor analysis (EFA) was used. The data collected are characterized by the following coefficients describing the structure of the indicators: Bartlett’s test: Χ² = 1235.524; df = 105.000, p < 0.001; chi-squared test: value = 222.472, df = 63, p < 0.001. For this test model, confirmatory factor analysis (CFA) was also carried out, which can be found in Appendix A.

The structure of the data is interesting. Based on the rotation method promax, three factors were identified. All the presented indicators are coherent in their attribution to the variables adopted in the model: evaluation of course quality (factor 1), self-evaluation of digital literacy (factor 2), and e-learning experiences in the calendar year (factor 3). The factor loadings for certain indicators is presented in detail in

Table 3. Factor loadings.

	Factor 1	Factor 2	Factor 3	Uniqueness
General course quality	0.852			0.272
Professionally prepared materials	0.765			0.406
Content usefulness	0.711			0.489
Visual design	0.796			0.361
Innovative character of platform	0.735			0.437
I took part in online courses required in the official study curriculum or as part of my professional development.			0.630	0.646
I searched for relevant resources on the Internet to complete online classes.			0.582	0.684
I took part in free e-learning courses (online courses such as foreign languages, ICT).			0.584	0.623
I took part in paid online courses.			0.436	0.760
I took part in online joint study groups.			0.481	0.735
Using a text editor		0.769		0.457
Using a spreadsheet software		0.672		0.526
Using presentation software		0.781		0.447
Using graphic software		0.563		0.631
Awareness of digital threats		0.481		0.723

.

The majority of the students and teachers evaluated the new SELI platform as very good and good. The most highly rated factors were the quality of the content on the platform and the usefulness of the resources presented. A total of 95% of the respondents evaluated the professionalism of the materials as very high and high. Almost one in five students and teachers evaluated the visual side of the platform as average (18%). The same percentage of respondents, 18%, was not satisfied with the graphical layout of the new platform. It should be pointed out that during their studies, the pre-service and active teachers have the opportunity to explore the Moodle platform, as this is the official e-learning environment of the population studied. The detailed distribution of answers is presented in Figure 3.

3.2. Evaluation of the New E-Learning Platform (Students vs. Teachers)

There are differences between the areas evaluated by students and teachers. The teachers evaluated the general aspects of the course more highly: F(1, 224) = 5.8716, p = 0.01618. Other factors such as content usefulness, innovative character, professionalism of the materials, and the visual aspects of the platform were all rated similarly. The differences are presented in Figure 4. Both groups provided very similar answers.

3.3. Correlation between the Assessment of Individual Elements of the Platform

Using Spearman’s correlations coefficient (lack of nominal distribution), it was noticed that there is a correlation in the mean intensity across the majority of the platform elements that were evaluated. Thus, satisfaction in one area is correlated with a positive evaluation for other elements. However, these are not cause-and-effect correlations, so it cannot be stated which variable is dependent and which is independent. The correlations are also not particularly strong, so there are differences in the evaluation of certain areas. It is also interesting that the metric age is negatively correlated (weak correlation) with the evaluation of the visual appearance and the innovative character of the platform. Older respondents (active teachers) were less positive regarding these two areas. The strength of the correlations is presented in detail in

Table 4. Correlation between the evaluation of the indicators.

Variable	1	2		3		4		5
1. General course quality	—
2. Professionally prepared materials	0.516	***	—
3. Content usefulness	0.502	***	0.586	***	—
4. Visual design	0.536	***	0.444	***	0.343	***	—
5. Innovative character of platform	0.557	***	0.337	***	0.338	***	0.676	***	—
6. Metrical age	0.003		0.003		0.043		−0.150	*	−0.106

* p < 0.05, ** p < 0.01, *** p < 0.001.

.

3.4. Predictive Evaluation of the Platform

Expanding the analysis to include other key factors, calculations were made using multilinear regression analysis for the following factors, which became the dependent variables: (1) general course quality, (2) professionally prepared materials, (3) content usefulness, (4) visual design, and (5) innovative character of the platform. In the case when the model includes all of the factors and the evaluation of the platform depends on digital literacy and previous e-learning experiences, it can be noticed that this assumption is true only for a low percentage of the respondents (the exception is the innovative character of the platform, where R² = 58.6%). Only in two cases is having more experience connected with participation in free e-learning courses related to a more positive evaluation of the professionalism and usefulness of the platform’s content. Other factors have no significant impact on the dependent variables. The complete results of the multilinear regression analysis are presented in

Table 5. Multilinear regression analysis.

	(1) General Course Quality R = 0.182, R2 = 0.033, F = 0.738, p < 0.001			(2) Professionally Prepared Materials R2 = 0.060, F = 1.376, p < 0.001			(3) Content Usefulness R2 = 0.058, F = 1.343, p < 0.001			(4) Visual Design R2 = 0.061, F = 1.405, p < 0.001			(5) Innovative Character of Platform R2 = 0.026, F = 0.586, p < 0.001
	β	t	p	β	t	p	β	t	p	β	t	p	β	t	p
Intercept		8.44	0.00		9.77	0.00		11.44	0.00		7.00	0.00		7.03	0.00
V1. I took part in online courses required in the official study curriculum or as part of my professional development	0.09	1.14	0.25	0.03	0.39	0.70	0.10	1.24	0.22	0.00	0.00	1.00	0.11	1.43	0.15
V.2 I searched for relevant resources on the Internet to complete online classes.	−0.14	−1.81	0.07	−0.13	−1.63	0.10	−0.17	−2.19	0.03	−0.13	−1.68	0.09	−0.02	−0.25	0.81
V.3 I took part in free e-learning courses (online courses such as foreign languages, ICT).	0.14	1.79	0.08	0.17	2.13	0.03	0.17	2.11	0.04	0.14	1.81	0.07	0.04	0.50	0.62
V.4 I took part in paid online courses.	−0.08	−1.04	0.30	−0.04	−0.49	0.63	−0.08	−1.06	0.29	−0.07	−0.86	0.39	−0.05	−0.70	0.49
V.5 I took part in online joint study groups.	0.05	0.60	0.55	−0.04	−0.54	0.59	−0.05	−0.73	0.46	0.14	1.83	0.07	0.08	1.07	0.28
V.6 Using a text editor (e.g., Word)	0.04	0.40	0.69	0.08	0.84	0.40	0.13	1.43	0.15	0.18	1.91	0.06	0.06	0.60	0.55
V.7 Using a spreadsheet program (e.g., Excel, Calc)	0.01	0.07	0.94	−0.09	−1.03	0.31	0.00	−0.02	0.98	−0.01	−0.12	0.90	0.03	0.36	0.72
V.8 Using presentation software (e.g., PowerPoint)	0.00	0.03	0.98	0.16	1.66	0.10	0.00	−0.01	0.99	−0.07	−0.73	0.47	−0.07	−0.73	0.46
V.9 Using graphic software (e.g., Picasa, Gimp)	−0.01	−0.08	0.94	−0.06	−0.74	0.46	−0.10	−1.20	0.23	0.01	0.11	0.91	−0.01	−0.14	0.89
V.10 Awareness of digital threats (e.g., cyberbullying, Internet addiction, sexting)	−0.05	−0.63	0.53	−0.03	−0.42	0.68	−0.06	−0.82	0.41	−0.10	−1.31	0.19	−0.06	−0.71	0.48

.

3.5. Platform Users—An Attempt to Group the Respondents

Using cluster analysis, two groups of respondents were identified. The first consisted of 86 persons (37.88%). This group evaluated the new platform in a similar way as group 2. However, the difference is seen mainly in the e-learning experiences of the respondents and their slightly higher evaluation of their own digital literacy. This group has quite strong potential connected with the implementation of teaching innovations and awareness of e-threats. The other group (the red cluster), composed of 140 individuals (62.12%), were respondents with less experience in e-learning, and who at the same time evaluated their digital literacy as being lower. This was two thirds of the sample: the persons who will be or are teachers. This group requires special training support during their pedagogical studies. The statistical differences between the groups are presented in

Table 6. Differences between the groups.

	Group 1			Group 2
	Mean	Standard Deviation	Variance	Mean	Standard Deviation	Variance
V1. General course quality	4.34	0.93	0.86	4.27	0.89	0.79
V2. Professionally prepared materials	4.48	0.82	0.68	4.54	0.69	0.48
V3. Content usefulness	4.44	0.76	0.58	4.55	0.67	0.45
V4. Visual design	4.09	0.97	0.93	3.99	1.01	1.01
V5. Innovative character of platform	4.20	1.00	1.01	4.14	0.97	0.94
V6. I took part in online courses required in the official study curriculum or as part of my professional development.	4.35	0.81	0.65	3.53	1.25	1.56
V7. I searched for relevant resources on the Internet to complete online classes.	4.66	0.48	0.23	4.10	0.97	0.94
V8. I took part in free e-learning courses (online courses such as foreign languages, ICT).	4.15	0.99	0.98	2.78	1.19	1.43
V9. I took part in paid online courses.	3.21	1.47	2.17	1.54	0.86	0.74
V10. I took part in online joint study groups.	4.00	1.20	1.44	2.20	1.11	1.23
V11. Using a text editor (e.g., Word)	4.65	0.50	0.25	4.25	0.72	0.52
V12. Using a spreadsheet software (e.g., Excel, Calc)	3.93	0.84	0.70	2.94	0.89	0.79
V13. Using presentation software (e.g., PowerPoint)	4.60	0.58	0.34	4.20	0.78	0.61
V14. Using graphic software (e.g., Picasa, Gimp)	3.84	0.89	0.80	2.72	1.10	1.21
V.15 Awareness of digital threats (e.g., cyberbullying, Internet addiction, sexting)	4.34	0.93	0.86	4.27	0.89	0.79

and Figure 5.

4. Discussion

The popularity of e-learning platforms has been growing rapidly in recent years, and they are used in almost every sector of education. In the academic sector, this form of education has already been implemented on a mass scale. E-learning platforms have proven extremely useful during the COVID-19 pandemic [53]. For this and other reasons, using e-learning platforms in university and professional training has been the subject of many scientific investigations. The wide spectrum of e-learning applications has been studied, from the evaluation of the quality of e-learning systems and the self-evaluation of their users’ digital literacy, to the development of a successful e-learning model. There are numerous scientific publications addressing these issues, among them the research reports by Al-Fraihat et al. [54], Taufiq et al. [55], Khlifi [56], Yilmaz [57], Rodrigues et al. [58], the studies by Ventayen et al. [59], Fryer and Bovee [60], Yang et al. [61], and some older research into the use of the Moodle platform in higher education by Hölbl et al. [62].

One of the most popular e-learning platforms used by universities in recent years is Moodle. The experiences with the learning management system when using Moodle were studied by Hölbl et al. [62]. The authors presented the results of their research into students’ experiences with the Moodle platform, along with an evaluation of its functionality and data privacy issues. The research indicates that the respondents were satisfied with being able to access the study and practice materials from any place and any time and with the possibility to access all the materials through one platform. The respondents also pointed to the positive aspects of Moodle-based e-learning, such as notifications via email about activities and changes. The respondents think e-learning is a very interesting form of learning. More than 90% declared that they had no problems with completing evaluation surveys upon completing their e-learning course. As suggested by the researchers, this may have resulted from the fact that most students had a positive experience with the Moodle platform. Many students readily presented their suggestions for potential changes to how the platform operated, along with suggestions for improving the study materials. In their concluding remarks, the authors emphasized that students are generally well-prepared to participate in developing courses on the Moodle platform and, in general, they are aware of the benefits e-learning strategies bring to modern studying [62].

The fact is that the significant increase in the quantity of research into the use of e-learning platforms has influenced how we understand e-learning success factors such as the quality of the platform, the quality of information published on the platform, the quality of the services that are provided, user satisfaction, and the usefulness of the course. Consequently, the main challenge researchers face at present is to develop a model of e-learning success. The challenge was accepted by Al-Fraihat et al., whose studies explore the factors that determine the success of e-learning and propose a model that would include the determinants and aspects of e-learning success. They also studied the level of interest in e-learning platforms among their users. Another goal of the research was to share the experiences from measuring the success of e-learning in highly developed countries, through the example of Great Britain. The researchers identified seven types of quality factors that determined satisfaction in participating in e-learning training: the quality of the technical system, the quality of the information carried by the platform, the quality of the services provided, the quality of the education system, the quality of support, the quality of the students, and the quality of the instructors. The research also showed the relationship between the quality of the students, the quality of the instructor, the educational background of the students, and the quality of the e-learning system and its usefulness [54].

The most recent studies have revealed that school and university students are now much more aware of the usefulness of e-learning platforms and the benefits of using this form of learning. Further promotion of e-learning platforms may be planned in the form of workshops and training for school and university students. In addition, it is important to draw the attention of universities to the necessity of providing students with clear and concise information about the functions and workings of the e-learning platforms they have available to them. Such activities would increase the sense of usefulness and general satisfaction derived from using the platforms, which in turn will result in further benefits connected with the wider use of the e-learning system. Importantly, the e-learning platform should not only be intuitive and easily navigated but also reliable, personalized, user friendly, and visually attractive [54]. The studies show that self-evaluation (e-evaluation) performed following the completion of an e-learning course may be an appropriate method of evaluation. Its advantages include providing a fast and clear evaluation of the knowledge and learning opportunities of the users as well as an evaluation of the students’ abilities. Regular evaluation by platform users after they complete their e-learning course increasingly improves their digital literacy and their ability to use e-learning for studying individually. Another advantage of e-evaluation, as compared to traditional evaluation, is that it means that the students receive instantaneous feedback. Flexibility, reliability, and greater objectivity of this form of assessment is also important. In addition, e-evaluations can be archived on a server [56].

The research indicates that willingness to learn using e-learning is an important factor in determining student satisfaction with this form of education. Readiness and a mature attitude towards e-learning also motivate school and university students to engage in individual learning in this modern form. Yilmaz [57] showed that student satisfaction and motivation both have a significant impact on student motivation to use e-learning and to pursue individual development. The more motivated a student is to engage in e-learning and to improve their ability to study individually, the more satisfied they will be with the classes designed according to the FC teaching model. When analyzing other similar research, the authors concluded that successful e-learning also depends on the growth of motivation to participate in e-learning and to improve self-learning skills. Another important determinant of satisfaction and motivation is the sense of self-efficacy in using the Internet. The better the student’s self-learning skills, the greater their satisfaction and motivation to study using modern e-learning platforms. Students who struggle with individual learning during online courses will not know what they should do during the whole learning process and will feel confused and helpless. To increase such students’ level of readiness to engage in e-learning, it is necessary to offer them training and courses to help them expand their knowledge and improve their IT competencies. Without appropriate training, students who are forced to learn online when they are not prepared for it will adopt a negative attitude towards e-learning in general. According to Yilmaz [57], readiness to engage in e-learning, the sense of one’s own effectiveness in using the Internet, IT competencies, the sense of one’s own effectiveness in online communication, the ability to learn individually, and the level of control exercised by teachers, all work to determine student satisfaction with e-learning and students’ motivation to engage in this form of learning.

Different e-learning platforms are used in higher education in parallel with traditional teaching in many countries around the world, but in the era of the COVID-19 pandemic, many have turned out to be an excellent alternative to the previously used methods. The studies conducted in Indonesia have revealed that different technologies that support distance learning were available in university education and that these may be successfully applied in university management in the future. It is necessary to reinforce the various e-learning systems, but the priority is to strengthen the status of e-learning itself [55].

5. Summary

The evaluation presented herein focused on three areas: the quality of the courses, e-learning experiences during the last calendar year, and the self-evaluation of digital literacy. The SELI platform tested was rated positively by the respondents, thus proving the success achieved by the team that developed the tool [63].

Based on cluster analysis, two groups of respondents were identified. One third were individuals who had used e-learning before and evaluated their digital literacy more highly. The remaining two thirds of the respondents declared lower digital literacy, and this appears to translate into a lower frequency of using e-learning in the past.

The data analysis including the variable (student, active teacher) showed that teachers provided higher ratings within one factor. They were able to evaluate more precisely whether the course content was useful in their work. They also preferred concise forms of communicating information and focused mainly on practical aspects.

Based on the results of Spearman’s correlations coefficient, it was determined that there were correlations between most of the platform elements evaluated. The quality of the content on the platform and the usefulness of the materials presented were evaluated the highest. The majority of negative evaluations addressed the graphical layout of the content. This evaluation may have resulted from a lack of experience in learning using this type of tool (contact with Moodle only) and a poor knowledge of the methodology of developing e-learning trainings.

The authors are aware of the limitations of the results presented herein. The areas recommended for further studies include the evaluation of the platform performed in a bigger population of users, both students and academic teachers.

To summarize, the text fits the research into the conditions of academic e-learning. Secondly, based on the data collected and statements assigned to the universities, a new area of online education research emerges. Universities, in particular those training pre-service teachers, should in a decisive and bold way develop new educational solutions to improve the forms of learning. However, these transformations should take into account the relevant micro-conditions, such as the level of digital literacy of future teachers obtained during previous stages of education.