Next Article in Journal
The Impact of Teacher Training Using Mobile Augmented Reality Games on Their Professional Development
Next Article in Special Issue
Perception of Risk in the Use of Technologies and Social Media. Implications for Identity Building during Adolescence
Previous Article in Journal
Digital Competence Assessment Methods in Higher Education: A Systematic Literature Review
Previous Article in Special Issue
Facilitating Student Understanding through Incorporating Digital Images and 3D-Printed Models in a Human Anatomy Course
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Higher Education Students’ Perceptions of Online Learning during COVID-19—A Comparative Study

1
School of Management, Swansea University, Swansea SA18EN, UK
2
Institute of Enterprise Management, Óbuda University, 1034 Budapest, Hungary
3
Department of Computer Science, University of the Western Cape, Bellville 7535, South Africa
4
Department of Statistics and Population Studies, University of the Western Cape, Bellville 7535, South Africa
5
Computer and Information Sciences, University of Strathclyde, Glasgow G1 1XQ, UK
6
Rhodes University, Grahamstown 6140, South Africa
7
University of South Africa, Pretoria 0003, South Africa
*
Authors to whom correspondence should be addressed.
Submission received: 2 July 2021 / Revised: 26 July 2021 / Accepted: 30 July 2021 / Published: 4 August 2021

Abstract

:
The pandemic and subsequent ‘lockdowns’ dramatically changed the educational landscape of higher education institutions. Before-COVID-19, traditional universities had choices in pedagogical practice, which included a variety of teaching delivery modes. Overnight, a single mode of delivery became the only option for traditional higher education institutions. All services migrated to digital platforms, leading to a period of “emergency eLearning”. The full impact of this sudden shift to digital platforms on all cohorts of students is still unclear. A measure of disruption to the normal student learning experience, especially for those attending traditional universities, was inevitable. Moreover, this disruption was varied depending on the University’s country and the country’s lockdown logistics. This international, comparative, quantitative research project investigated and explored higher education students’ perceptions of emergency eLearning during the COVID-19 pandemic. Experiences of students at universities in three countries were evaluated in terms of four dimensions: (1) home learning environment, (2) engagement, (3) participation preference, and (4) impact on learning skills. The research revealed significant differences between the participating universities students’ experiences. The most important differences were in the ‘home learning environment’, followed by ‘engagement’ and the perception of ‘impact on learning skills’. The differences in the ‘home learning environment’ can be attributed to the differing economic and digital development of the surveyed countries: South Africa, Wales, and Hungary. Finally, different cultural backgrounds suggest a noticeable difference in student engagement, participation, and learning skills.

1. Introduction

The emergency lockdown—imposed by most countries during the COVID-19 pandemic in 2020—has had a profound impact on all aspects of work and social interaction for everyone. Traditional higher education institutions also had to switch overnight from a predominantly face-to-face teaching mode to a fully online mode. This necessitated a fundamental change to core teaching and assessment processes.
Not only did this disruption bring about changes to the higher education landscape [1], it also severely impacted student learning experiences [2]. Since traditional modes of teaching and learning were infeasible, an era of “emergency eLearning” [3] was ushered in. Traditional universities suddenly found themselves in direct competition with distance education universities without their having the requisite pre-existing essential infrastructure or support services to deal with the altered teaching landscape [2]. Academic staff, in many cases, had to transform their teaching material to provide content for online delivery, without the necessary training or support to do so [4]. Even assessment strategies had to be adapted for online implementation, in contrast to traditional examination halls with invigilators [5].
The lecturers found the changes the pandemic imposed challenging, but so did the students, who not only had to transition to a new mode of learning but also had to contend with many other factors that influenced their learning experience [2]. For example, some students found it difficult, or even impossible, to study at home: possibly a reflection of their socio-economic status [2]. Furthermore, since a computer (rather than a smartphone) and Internet access, was essential to access study material, this was also problematic for some students and greatly impacted their learning experience [6]. According to Guio et al. (2018), cited in Van Lancker and Parolin (2020), neither being able to study at home nor having access to a computer is a given, even in Europe, where many learners (5%) do not have an appropriate study space at home nor do they have access to the Internet (7%). In South Africa, citizens mostly access the Internet from their smartphones but data costs are prohibitively high, making their students’ situations even worse [7]. Furthermore, students in all countries, who usually have to hold down jobs to support their studies, now found themselves unemployed and without funding [2].
Aristovnik et al. [8] thus call for in-depth studies to assist the educational community to understand the ways in which ways the pandemic impacted students’ learning experiences to inform future teaching practices [4]. A cursory look at the research studies of 2020/2021 suggest that several comparative studies focused on comparing countries with similar cultural and economic backgrounds, with similar educational structures and educational cultures [9,10]. A large global study conducted by Aristovnik et al. [8] compares 62 countries, but does not include Hungary, South Africa, or Wales (UK).
Educational research about the student learning experience has always been an important focus area. The proliferation of the Internet, the rate of digitalisation and the rapid development of Information Communication Technologies (ICT), has provided opportunities for a range of educational delivery modes, even before the pandemic of 2020 [11,12,13]. Innovative educational technology tools gradually crept into education and the use of these technologies and applications resulted in a revolutionary change in pedagogy [14,15]. Soon after the emergency online remote learning was imposed in March 2020, and even as early as May 2020, research studies were published about the impact of COVID-19 on the online student learning experience. These studies considered a number of perspectives: student learning outcomes; student motivation and engagement; the importance of attitude [16]; learning platforms and related challenges [4]. A study conducted by Martinho et al. [17] investigated the sentiment of the impact of the lockdown and pandemic on students’ learning experiences. However, this was from the lecturers’ perspective, not from the students’. Several case studies were conducted [18,19,20] but these, too, focused on specific departments or modules within a university. Both qualitative [21,22] and quantitative research [8,23,24,25,26] was conducted, both in developing [27,28,29,30], and developed countries [31,32,33] as well as in post-communist countries [34,35].
This study presents an original comparative study of the student learning experience, from the perspective of students, across three universities from three very different countries—Hungary, a post-communist European country, South Africa, an African country which is still arguably an emerging democracy, and Wales, a country steeped in tradition with an ancient system of democracy. These countries differ in terms of their digitalisation, economic development, historical and cultural backgrounds, and COVID-19 lockdown strategies imposed by their different governments. All three universities are residential, using face-to-face tuition as the norm, but with blended learning supported in some instances.
This research highlights how these differences affected the students’ online learning experience and draws on Hofstede’s [36] cultural theories of “Power Distance”, “Individualism”, and “Avoidance”, rated on two poles: low and high (see Figure 1).
Hofstede’s ‘Power Distance’ cultural dimension [36] indicates the “degree to which the less powerful members of a society accept and expect that power is distributed unequally”, and deals with the fact that individuals in societies are not equal, expressing the attitude of the culture towards these inequalities. Hofstede [36] defines the ‘Uncertainty Avoidance’ cultural dimension as “the extent to which the members of a culture feel threatened by ambiguous or unknown situations and ….. try to avoid these”, and has to do with the way that a society deals with the fact that the future can never be known, dealing with the question of whether to try to control the future or just to let it happen. The fundamental issue addressed by the ‘Individualism’ dimension is the degree of interdependence a society maintains among its members, which has to do with whether people’s self-image is defined in terms of “I” or “we” [36].
Four dimensions of student experiences were studied: (1) home learning environment; (2) engagement; (3) participation preference and (4) impact on learning skills. The following research questions were posed:
RQ1: 
What digital home learning environment id students have access to?
RQ2: 
How did students engage in the online sessions?
RQ3: 
What were the student preferences for participation with the online learning platform?
RQ4: 
How did emergency eLearning education impact student learning skills?
The perspectives from these participating universities facilitated a comparative analysis of the student experience in the different countries, which could inform pedagogical practices in the post-pandemic period. Significant differences were found in terms of the home learning environment of students in the different countries, how engaged they were in online sessions, and their perception of how the pandemic impacted their learning skills.
The rest of the paper is organised as follows: Section 2 introduces the materials and methods used, Section 3 presents and discusses the results organised in terms of the dimensions posed, Section 4 justifies the results and finally Section 5 draws conclusions and summarizes the research as well as outlines possible future research options.

2. Materials and Methods

A self-administered questionnaire was designed to collect data from students in the three different countries. A pilot of the survey was conducted to confirm the validity of the questionnaire, using several random students at each university and in different years of study. Some of the questions were revised after the pilot test. The Qualtrics platform offers a modern method of distributing the questionnaires to a large but specific group of respondents [38], and was thus used. The targeted respondents received the online questionnaire as a Qualtrics link in an email and were asked to spend about 10 to 15 min answering the questions. Data was collected from all three participating universities using the same questionnaire but with different links per country. The questionnaire was translated into Hungarian to facilitate ease of understanding for those participating students with Hungarian as a first language.
The researchers received ethical approval and permission from each of the respective universities to conduct the study. The questionnaire was disseminated among the respective student populations in October/November of 2020.
Quantitative analysis was conducted to reveal the similarities and differences among the three participating universities using the statistical programmes Statistical Analysis System (SAS) version 9.4 and Statistical Package for the Social Sciences (SPSS) version 25. Factor analysis—using a principal component method with a varimax rotation—was used to confirm the validity of the identified dimensions. Comparative analysis was conducted using the Chi2 test to identify the significant differences in the self-reported behaviours and attitudes of students toward their online learning experience.
A decision tree using the exhaustive Chi2 Automatic Interaction Detector (CHAID) splitting algorithm helped to reveal the most significant differences between the students from the three different countries. The decision tree was not used to rank the questions nor for predictive modelling, but rather to identify questions which emphasised the differences between students at the participating universities and to confirm the importance of the dimension questions. The decision tree was applied as a segmentation process [39,40,41] to provide a visual representation of the important questions.

2.1. Confirmation of Dimensions and Questions

Factor analysis confirmed the importance of the four identified dimensions with a significant Bartlett’s Test (Chi2 = 1200.554, p = 0.000) and a Kaiser–Meyer–Olkin (KMO) measure of 0.741, it points to a satisfactory factorisation of the dimensions [42]. The four dimensions explained 62% of the variation in the data set (see Table 1).

2.2. Demographics of Participants

A total of 559 students participated in this study. After data cleaning, the information of 512 participants could be used: 240 in Hungary, 141 in Wales and 131 in South Africa (see Figure 2). The participants were mostly undergraduate students (95%) studying a wide variety of subjects, ranging from psychology to engineering. Fifty four percent were male, and 45% female; 1% did not identify with either gender. Ninety five percent of all respondents were in their 20′s with a few older participants.
Most students indicated that they were living in the country where they were studying during lockdown—97% of the Hungarian students remained in Hungary, 97% of the South African students remained in South Africa and 89% of the students studying in Wales remained in Wales. Although all the universities had students from other countries, the Welsh university had the most international participants. Students from 46 countries participated in the survey, the countries are Angola, Azerbaijan, British, China, Congo, Ethiopia, France, Ghana, Greece, Hongkong, Hungary, Indonesia, Ireland, Japan, Jordan, Kazakhstan, Kenya, Kuwait, Kyrgyzstan, Latvia, Libya, Lithuania, Malaysia, Mexico, Moldovia, Mongolia, Morocco, Lesotho, Namibia, Nigeria, Norway, Poland, Portugal, Romania, Russia, Rwanda, Saudi Arabia, Slovakia, South Africa, Spain, Thailand, Turkey, Vietnam, Yemen, Zambia, Zimbabwe (46 countries).

3. Results

Sentiment analysis was used to understand which aspects of online learning the students agreed with (see Figure 3). The sentiment analysis considered all participating students’ behaviour during the COVID-19 pandemic.
Most had a good learning environment at home and were satisfied with their Internet access. They did not switch their videos on when attending online sessions and struggled to concentrate and to engage with the learning environment when a lecture or seminar video lasted longer than 15 min. The majority of the participants agreed that they missed the in-person interaction and preferred face-to-face delivery. Most preferred to work independently and felt that they had become more independent and that their digital skills had improved.
The comparison of the students’ self-reported behaviours, by dimension, and by country, revealed significant differences. The following reports the results in terms of the dimensions and the questions within each dimension.

3.1. Analysis of the Dimensions

3.1.1. Home Learning Environment

The learning experience of students during COVID-19 was assessed with three questions, referring to (1) good learning environment, (2) quality of the Internet access, and (3) the appropriate digital equipment to access the Learning Management System (LMS) (See Figure 4). The analysis revealed no significant differences regarding Internet access. The ‘learning environment’ and ‘appropriate digital equipment to access the LMS’, will be considered next.
The majority of all the students (63%) were satisfied with their home learning environment, but students studying in Hungary considered theirs to be “good”, as compared to students from the other two countries (Chi2 = 65.56 and p < 0.0001). For all pairwise comparisons within a row of each innermost sub-table Bonferroni correction was used—see Table 2 which presents the significant differences by participating university.
The letters used for each group (Hungary-A, Wales-B, South Africa-C) indicate the significant differences and compares the responses by group. For example, students in Hungary agreed significantly more with the statement “I have a good learning environment at home” than students in Wales and South Africa. The results are based on two-sided tests. For each significant pair, the key of the category with the smaller column proportion appears in the category with the larger column proportion.
Most participating students, in all three countries (86%), felt that they had appropriate digital equipment to access the University’s digital environment (Chi2 = 56.68 and p < 0.0001). A significant difference was found between the different universities’ students (see column proportion comparisons in Table A1 in Appendix A).

3.1.2. Student Engagement

When analysing student engagement with online education, significant differences were found (see Figure 5). The participating students studying in Hungary (53%) preferred the digital learning environment to in-person on-campus learning. In contrast, the participating students studying in South Africa (31%) and Wales (25%) preferred face-to-face teaching (Chi2 = 55.77 and p < 0.0001).
Students in the Welsh and South African universities significantly disagreed with the statement “I preferred accessing the digital learning environment more than the in-person on campus learning”, as compared to the students in Hungary (Table A2 in Appendix A).
The research suggests that the participating students in Hungary (53%) found it easier to interact with their lecturers and peers during online lecture seminar sessions whereas students from Wales disagreed (55%), and in South Africa, the students were not as conclusive about this statement, with approximately similar proportions agreeing and disagreeing. (Chi2 = 50.64 and p < 0.0001). For significance see Table A3 in Appendix A.
Both Welsh and South African students missed the in-person interaction with other students more than the Hungarian students did (Chi2 = 31.87 and p < 0.0001). Table A4 depicts the significant differences (see Appendix A).
The Hungarian students disagreed more (57%) with the statement “I cannot concentrate and engage with the learning effectively when the lecture or seminar video is longer than 15 min long” with 34% of the Welsh and 38% of the South Africans disagreeing with the statement (Chi2 = 27.05 and p = 0.0007), see Figure 5. Hence, the majority of the participating students studying in Hungary felt that they could concentrate for longer than 15 min (see Table A5 in Appendix A).

3.1.3. Participation Preference

This dimension compared opinions about participation in the online learning environment. Most students (77%) did not always have their video camera on when attending an online session (Chi2 = 44.93 and p < 0.0001). Table A6 (in Appendix A) shows these significant differences between the students from the three universities.
Most students (64%), in all three countries, indicated that they preferred to work independently (Chi2 = 8.34 and p = 0.4006) (see Figure 6). Thirty seven percent of the participants agreed that they liked to participate in online discussions, and 36% felt neutral about it (Chi2 = 8.91 and p = 0.3502). No significant differences could be found between the respondents, by university.

3.1.4. Impact on Student Learning Skills

This dimension considered how or whether the digital and learning skills of students developed during the COVID-19 pandemic. The students studying in South Africa (71%) felt more strongly that “The online academic education during the pandemic, helped me to become more independent as a learner” while half (52%) of the participating students studying in Wales and 48% of the participating students studying in Hungary (see Figure 7) indicated so (Chi2 = 40.13 and p < 0.0001). Table A7 in Appendix A depicts the pairwise comparison.
More students in the South African university (68%) agreed that “The online academic education during the pandemic improved my digital literacy”, while only 50% of the Welsh and 37% of the Hungarian students indicated this (Chi2 =61.75 and p < 0.0001). The pairwise comparison can be seen in Table A8 in Appendix A, which shows the significant differences between the three universities.

3.2. Features Shaping the Participating University Student Groups

A decision tree method was used to identify the separating questions of the dimensions that indicate the important differences between the student groups from the three universities (see Figure 8). Each dimension is represented by at least one identified question of importance, with two dimensions identifying two questions of importance per dimension.
During the tree development, only the questions where significant differences were detected were added as independent variables. The decision tree algorithm was run having either of the three countries as a target variable, which resulted in very similar trees. The criteria used were the splitting node significance level was set to α = 0.05, the minimum number of cases in the parent node was set to 30 while that of the child node was set to 10 as the number of students in South Africa was relatively low and the goal was to gain a decision tree with sufficient depth. The maximum tree depth was set to 5 to gain as many significant splitting variables as possible.
The level 1 splitting of the tree identified “the good learning environment” as a significant difference among the students from the different universities and assigned students in South Africa to the dissatisfied, neutral group. The satisfied group is the group of students from the participating Hungarian university while participating students from the Welsh university were rather satisfied in this question and did not determine a segment.
At level 2, two separating learning experiences differentiate the students from these three universities namely, the practice of “having the video on during the online session” and the “improvement of digital literacy”.
At level 3, the leftmost leaf was split further. The question of “digital literacy” was also significant in the group which did not turn on the video camera, namely the group dominated by the students in Hungary. In this case, two further segments were defined, separated by “how easy students find to interact with the lecturers and peers”, and whether students “prefer digital learning environment or in-person on campus learning”.
The Decision tree analysis identified six-dimension questions of importance:
  • Home learning environment: I have a good learning environment at home (or where I reside).
  • Engagement: (1) I found it easy to interact with my lectures and peers during an online lecture/seminar session; (2) I preferred accessing the digital learning environment more than the in-person on campus learning.
  • Participation Preference: I always have my video on when attending an online session.
  • Impact on learning skills: (1) The online academic education during the pandemic improved my digital literacy; (2) the online academic education during the pandemic helped me to become more independent as a learner.
Each dimension is represented by at least one identified question of importance, with two dimensions identifying two questions of importance.

4. Discussion

Several studies have been conducted [2,5,21,30,43] to understand and investigate the impact of the COVID-19 pandemic on higher education. This study compared the perceptions of higher education students about the impact of COVID-19 on their student learning experience in universities from three different countries. The findings in terms of the research questions are presented next.
RQ1: 
What digital home learning environment did students have access to?
Arnou et al. argue that access to a good digital home learning environment is key to enhancing students’ online experiences [44]. Our study’s findings suggest that there was no significant difference in digital home learning environment. Participating students from all three universities were satisfied with their access to digital equipment, their access to the Internet, and their home learning environment. In general, the Hungarian students were more satisfied with their home learning environment.
A great digital divide exists in the South African society: most of the population live below the poverty line, with the country being one of the most unequal in the world [45]. The cost of internet access is considered expensive as compared to other countries. Affordability is thus a challenge, and people with high incomes are likely to report using the Internet more than those with lower incomes [46]. Despite this, almost half of the participating South African students indicated that they had a good digital learning environment at home. Individual participating university responses to the COVID-19 pandemic were quite different and contextualized to the needs of the students, which suggests an explanation for this outcome. For example, all participating South African students were issued with laptops, where required, purchased via the university, and credited to their student account, with free but limited data packages. Some students were given laptops as a bursary. Appropriate access to digital equipment and access to the Internet for home learning was therefore provided.
It is interesting to note that even though students indicated that they had a good learning environment at home, they did not always switch on their videos. In South Africa, this could be explained by the limited bandwidth and degradation of Internet access when video cameras were activated. It does not explain this behaviour by students in the other two participating universities.
RQ2: 
How did students engage in the online sessions?
University students are heterogenous [47]. The student population of the Welsh participating university is a case in point, where a large proportion of the student population is not from Wales but from countries within the UK: England, Scotland, and Ireland, as well as internationally. Students from different races, culture, and affluence attend the South African university. The significant differences among the attitude of students in the online environment might be explained by this cultural diversity. Although the participating universities are not homogenous entities, the student responses from the different universities to the question “I prefer online learning to face-to-face learning”, and the question “I miss the in-person interaction with other students” compares well with the differences depicted in Figure 1 (adapted from [37]), except in the case of the Welsh students.
Significantly more of the Hungarians preferred the online mode of study, more so than the South African students, which compares well with the ’Individualism’ dimension for Hungary and South Africa as countries. The Welsh students however, preferred the ‘face to face’ mode of study, which is an interesting contradiction to the Hofstede dimension of “Individualism”. The impact of the change to a totally new learning management system for the Welsh students just before the lockdown period could be a contributing factor. Another factor could be that the number of participating students from Hungary in the age range 20–30 was considerably higher than the number of participating students from Wales and South Africa, who were comparatively younger. The influence of students’ age and hence, experience, could have impacted responses to the question about their preferences.
A study conducted by Almaiah et al. [21] suggests that ’Culture’ is one of the critical factors that affect the usage of e-learning systems. It is therefore important, when trying to understand student experiences of online learning, that the cultural aspect be acknowledged.
Hofstede [36] suggests that societies that present with a large degree of ‘Power Distance’ accept what the hierarchy imposes. In societies with low ‘Power Distance’, reasons for inequalities are sought. Our results showed that participating Hungarian students found it easier to interact with their lecturers and peers during online lecture seminar sessions than students from Wales and South Africa.
The ‘Uncertainty Avoidance’ cultural dimension can be used to explain the responses from the participating Hungarian students when asked the question “I find it easy to interact with my lecturers and peers during the online lectures or seminar sessions”, as the majority of these students agreed with this statement. The South African and Welsh students disagreed and were uncertain about this. The combination of the lower level of ‘Uncertainty Avoidance’, and higher level of Individualism suggests a more flexible attitude to emerging and changing environments and encourages creativity and innovation [36].
The Hungarian students agreed that they could concentrate and engage with the learning effectively when the lecture or seminar video was longer than 15 min. The Welsh and South African students disagreed with this statement. Research indicates that the average adult attention span is 8 s, and that videos under 5 min will generally garner the most user engagement [48]. Anderson (2014), cited in [49] indicates that “…the length of a TED talk—18 min—is one of the key reasons behind the formats success, indicating that this length of time is long enough to be serious and short enough to hold people’s attention’’.
The Welsh and South African students preferred face-to-face teaching and learning. The results of this study are similar to a study conducted by Besser et al. [50], who found that traditional face-to-face learning was generally preferred to online learning. It is interesting to note that the participating students from the Hungarian university preferred the online learning mode of teaching.
RQ3: 
What were the student preferences for participation with the online learning platform?
The country comparison, with respect to their preferences related to having their video camera on during an online session, was found to be significant, with all the participating students preferring not to have their video cameras on. This could also be explained by the Hofstede [36] ‘Individualism’ dimension for these three countries, with slightly more of the participating students from Wales and Hungary (with higher Hofstede individualism scores, see Figure 1) preferring not to switch on their video cameras.
RQ4: 
How did emergency eLearning education impact student learning skills?
This research suggests significant differences. The majority of the South African participants indicated that the emergency eLearning education during the pandemic improved their independent learning skills, while only half of the participants from Wales, and less than half of the participants from Hungary agreed that: “The online academic education during the pandemic, helped me to become more independent as a learner”. Here, again, Hofstede’s [36] ‘Individualism’ cultural dimension could be explanatory, as South Africa is generally considered less individualistic than Wales and Hungary (see Figure 1). The emergency eLearning provided these students with the opportunity to improve their independent learning skills.
It is interesting to note that more South Africans agreed that “The online academic education during the pandemic, improved my digital literacy”, but only half of the Welsh and even fewer of the participating Hungarian students indicated this. The policy responses from the participating universities to address the challenges and impact of the pandemic on their emergency provision of education, were different.
The response from each of the universities reflected the educational needs of the students. For example, in South Africa, a majority of the students normally only have access to digital equipment at their university. This university responded by subsidising each student who did not have the necessary resources with a purchased and discounted laptop and free, but limited data bundles were included in the package deal provided to these students. Mobile Service Providers in South Africa also allowed students to access the university websites free of charge.
Even so, many of these students had to learn different and new digital skills even though access to digital resources might not have been an issue. This can be explained by the Digital Intelligence Index (DII) of a country. This index refers to the country’s “…economy’s digital trajectory as a function of two factors: its current state of digitalization, and its pace of digitalization over time” [51]. According to this index, the United Kingdom is currently digitally advanced, but the pace of advancement is showing signs of slowing. Furthermore, this index suggests that Hungary, as well as South Africa, has significant challenges in terms of their digitisation, and its slow development, which is in keeping with the participating university’s emergency educational response.
Students who did not have a good learning environment at home were not always convinced that their digital literacy had improved. The participating students from South Africa dominated in their perception of their digital literacy being improved or were neutral. However, on the contrary, participants from Wales did not consider their digital literacy skills to have improved.
The question of “digital literacy” was also significant in the group that did not turn on the video camera, namely the group dominated by Hungarian students. In this case, two further segments were defined, separated by “how easy students find to interact with the lecturers and peers”, and whether students “prefer digital learning environment or in-person on campus learning”. Students from the participating Welsh University dominated the group that prefers in-person on-campus learning while the Hungarian group preferred the digital learning environment. At the same time, students studying in Wales who did not find it easy to interact with the lecturers and their peers during the online sessions, became more independent learners.

5. Concluding Remarks and Future Work

A comprehensive comparison of the students from the three participating universities helped the authors to expose the dimensions of difference. The dimension-related questions helped to explain the different perceptions of students’ experiences of the emergency online learning during the COVID-19 ‘lockdown’ and explored different attitudes and self-reported behaviours.
This study provides insights which can inform university authorities and academic researchers. It will help to manage the challenges of online learning and the necessary factors that need to be taken into consideration to ensure an optimal student experience. Based on the results from this study, several suggestions can be made to influence future pedagogical approaches to university teaching:
  • The younger students preferred face-to-face teaching and found it difficult to engage with lecturers and peers online, which may suggest that blended learning could be introduced later in students’ academic studies.
  • There were significant differences between the responses from the participating universities within the three countries, in terms of how students experienced the online learning environment. This depended on how the country responded to the pandemic crisis, the support provided to students, and the resources made available. It is clearly important to understand the digital requirements of students, as well as the challenges of their home study environments, and to provide access to study spaces to those not privileged enough to have appropriate home learning spaces.
  • The development of the online study content requires careful consideration to ensure that the study sessions incorporate enough activities to keep students engaged.
  • Opportunities should be created for developing digital, information and academic skills early on in University careers, so that students learn to become independent learners.
Limitations relate to the restricted sample of students and the fact that only one university in each country participated. This research could be expanded to include more universities from the original participating countries as well as universities from other countries.
The next phase of this research study investigates the question of equitable access to digital technologies and the perceptions of risk of cyber security and safety and related student behaviours when conducting their online learning.

Author Contributions

Conceptualization, D.C., A.T. and I.M.V.; methodology, D.C., A.T., I.M.V. and R.J.B.; validation, A.T., R.J.B., I.M.V. and D.C.; formal analysis, A.T. and R.J.B.; investigation, D.C., A.T., I.M.V. and R.J.B.; writing—original draft preparation, D.C., I.M.V. and A.T.; writing—review and editing, D.C., I.M.V., A.T., K.R. and R.J.B.; visualization, D.C., A.T., I.M.V. and R.J.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of Swansea University (approval on the 23 June 2020) and Human and Social Sciences Ethics Committee, HS20/5/20, University of the Western Cape (approval on the 30 September 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data collected can be made available upon request.

Acknowledgments

The authors would like to thank Professor Paul Jones, Head of School, Swansea University, for supporting this collaboration between the three countries, by providing funds to initiate the collaboration with South Africa and Hungary. The authors would also like to thank all three participating universities for providing the researchers the time to conduct the research.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Comparison of appropriate digital equipment.
Table A1. Comparison of appropriate digital equipment.
Comparisons of Column ProportionsGroup
HungaryWalesSouth Africa
(A)(B)(C)
I have the appropriate digital equipment to access the university digital environmentDisagree A (0.022)
Neutral
AgreeC (0.001)
Significance level < 0.05.
Table A2. Participation Preference.
Table A2. Participation Preference.
Comparisons of Column ProportionsGroup
HungaryWalesSouth Africa
(A)(B)(C)
I preferred accessing the digital learning environment more than the in-person on campus learningDisagree A (0.000)A (0.005)
Neutral
AgreeB (0.000)
C (0.000)
Significance level < 0.05.
Table A3. Ease of interaction during online session.
Table A3. Ease of interaction during online session.
Comparisons of Column ProportionsGroup
HungaryWalesSouth Africa
(A)(B)(C)
I found it easy to interact with my lecturers and peers during online lecture/seminar sessionsDisagree A (0.000)
C (0.021)
Neutral
AgreeB (0.000)
C (0.007)
B (0.036)
Significance level < 0.05.
Table A4. Preference of in-person interaction with peer students.
Table A4. Preference of in-person interaction with peer students.
Comparisons of Column ProportionsGroup
HungaryWalesSouth Africa
(A)(B)(C)
I miss the in-person interaction with other studentsDisagreeB (0.008)
C (0.004)
Neutral
Agree A(0.000)A(0.001)
Significance level < 0.05.
Table A5. Comparison of concentration on videos longer than 15 min.
Table A5. Comparison of concentration on videos longer than 15 min.
Comparisons of Column ProportionsGroup
HungaryWalesSouth Africa
(A)(B)(C)
I cannot concentrate and engage with the learning effectively when the lecture or seminar video is longer than 15 minDisagreeB (0.000)
C (0.004)
Neutral
Agree A (0.002)
Significance level < 0.05.
Table A6. Comparison of whether students have their video on during an online session.
Table A6. Comparison of whether students have their video on during an online session.
Comparisons of Column ProportionsGroup
HungaryWalesSouth Africa
(A)(B)(C)
I always have my video on when attending an online sessionDisagreeC (0.000)C (0.002)
Neutral A (0.000)
B (0.014)
Agree A (0.003)
Significance level < 0.05.
Table A7. Comparison of how independent students could become as learners.
Table A7. Comparison of how independent students could become as learners.
Comparisons of Column ProportionsGroup
HungaryWalesSouth Africa
(A)(B)(C)
The online academic education during the pandemic, helped me to become more independent as a learnerDisagreeC (0.014)
Neutral
Agree A (0.000)
B (0.011)
Significance level < 0.05.
Table A8. Comparison of how students perceive their digital literacy improvement.
Table A8. Comparison of how students perceive their digital literacy improvement.
Comparisons of Column ProportionsGroup
HungaryWalesSouth Africa
(A)(B)(C)
The online academic education during the pandemic, improved my digital literacyDisagreeC (0.000)C (0.004)
Neutral
Agree A (0.036)A (0.000)
B (0.011)
Significance level < 0.05.

References

  1. Iglesias-Pradas, S.; Hernández-García, Á.; Chaparro-Peláez, J.; Prieto, J.L. Emergency remote teaching and students’ academic performance in higher education during the COVID-19 pandemic: A case study. Comput. Hum. Behav. 2021, 119, 106713. [Google Scholar] [CrossRef]
  2. Grant, K.; Gedeon, S. The Impact of COVID-19 on University Teaching. In The University of the Future-Responding to COVID-19, 2nd ed.; ACPIL: Reading, UK, 2020; p. 161. [Google Scholar]
  3. Muller, A.; Goh, C.; Lim, L.; Gao, X. COVID-19 Emergency eLearning and Beyond: Experiences and Perspectives of University Educators. Educ. Sci. 2021, 11, 19. [Google Scholar] [CrossRef]
  4. Al-Kumaim, N.; Alhazmi, A.; Mohammed, F.; Gazem, N.; Shabbir, M.; Fazea, Y. Exploring the Impact of the COVID-19 Pandemic on University Students’ Learning Life: An Integrated Conceptual Motivational Model for Sustainable and Healthy Online Learning. Sustainability 2021, 13, 2546. [Google Scholar] [CrossRef]
  5. Singh, S. Reflecting on Higher Education Examinations. In The University of the Future: Responding to COVID-19; ACPUL: Reading, UK, 2020; p. 161. [Google Scholar]
  6. Tick, A. An extended TAM model for evaluating eLearning acceptance, digital learning and smart tool usage. Acta Polytech. Hung. 2019, 16, 213–233. [Google Scholar]
  7. Venter, I.; Daniels, A. Towards Bridging the Digital Divide: The Complexities of the South African Story. In Proceedings of the 14th International Technology, Education and Development Conference, Valencia, Spain, 2–4 March 2020. [Google Scholar]
  8. Aristovnik, A.; Keržič, D.; Ravšelj, D.; Tomaževič, N.; Umek, L. Impacts of the COVID-19 Pandemic on Life of Higher Education Students: A Global Perspective. Sustainability 2020, 12, 8438. [Google Scholar] [CrossRef]
  9. Muir, T.; Milthorpe, N.; Stone, C.; Dyment, J.; Freeman, E.; Hopwood, B. Chronicling engagement: Students’ experience of online learning over time. Distance Educ. 2019, 40, 262–277. [Google Scholar] [CrossRef]
  10. Povian, C. Remote Learning and Teaching Methodologies in Norway and Romania. In Proceedings of the 15th International Technology, Education and Development Conference, Online Conference, 8–9 March 2021. [Google Scholar]
  11. Ellis, R.A.; Bliuc, A.-M. Exploring new elements of the student approaches to learning framework: The role of online learning technologies in student learning. Act. Learn. High. Educ. 2017, 20, 11–24. [Google Scholar] [CrossRef]
  12. Soegoto, E.S.; Ismail, Z.; Dewi, N.P. Online Learning as a Learning Innovation and New Business Models in the World of Education. In Proceedings of the 2nd International Conference on Business, Economic, Social Science, and Humanities–Economics, Business and Management Track (ICOBEST-EBM 2019), Bandung, Indonesia, 21 November 2019. [Google Scholar]
  13. Thamrin, T.; Saragih, A.; Aditia, R. The Implementation of Hybrid Learning Strategies to Improve Students Learning Outcomes of Introduction to Microeconomics Subject in Economic Education Department Universitas Negeri Medan. In Proceedings of the 5th Annual International Seminar on Trends in Science and Science Education (AISTSSE), Medan, Indonesia, 18–19 October 2018. [Google Scholar]
  14. Tick, A.; Beke, J.; Füstös, J. Rocking Up Digital Educational Methodology in Higher Education-Is Education 4.0 Here? In Proceedings of the Hawaii International Conference on Education, Honolulu, HI, USA, 4–7 January 2021. [Google Scholar]
  15. Abdelrahman, N.; Irby, B.J. The Perception of Faculty Members on Hybrid Learning: A Naturalistic Case Study. In Handbook of Research on Innovative Technology Integration in Higher Education; IGI Global: Hershey, PA, USA, 2015; pp. 178–203. [Google Scholar]
  16. Ferrer, J.; Ringer, A.; Saville, K.; Parris, M.A.; Kashi, K. Students’ motivation and engagement in higher education: The importance of attitude to online learning. High. Educ. 2020, 1–22. [Google Scholar] [CrossRef]
  17. Martinho, D.; Sobreiro, P.; Vardasca, R. Teaching Sentiment in Emergency Online Learning—A Conceptual Model. Educ. Sci. 2021, 11, 53. [Google Scholar] [CrossRef]
  18. Gelles, L.A.; Lord, S.M.; Hoople, G.D.; Chen, D.A.; Mejia, J.A. Compassionate Flexibility and Self-Discipline: Student Adaptation to Emergency Remote Teaching in an Integrated Engineering Energy Course during COVID-19. Educ. Sci. 2020, 10, 304. [Google Scholar] [CrossRef]
  19. Balderas, A.; Caballero-Hernández, J.A. Analysis of Learning Records to Detect Student Cheating on Online Exams: Case Study during COVID-19 Pandemic. In Proceedings of the Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM’20), Salamanca, Spain, 21–23 October 2020. [Google Scholar]
  20. Sunardiyom, S. Online learning in higher education during the Covid-19 pandemic: A case study in the Department of Electrical Engineering, Universitas Negeri Semarang. In IOP Conference Series: Earth and Environmental Science; IOP Publishing: Bristol, UK, 2020. [Google Scholar]
  21. Almaiah, M.A.; Al-Khasawneh, A.; Althunibat, A. Exploring the critical challenges and factors influencing the E-learning system usage during COVID-19 pandemic. Educ. Inf. Technol. 2020, 25, 5261–5280. [Google Scholar] [CrossRef]
  22. Khlaif, Z.N.; Salha, S.; Kouraichi, B. Emergency remote learning during COVID-19 crisis: Students’ engagement. Educ. Inf. Technol. 2021, 1–23. [Google Scholar] [CrossRef]
  23. Zhou, J.; Zhang, Q. A Survey Study on U.S. College Students’ Learning Experience in COVID-19. Educ. Sci. 2021, 11, 248. [Google Scholar] [CrossRef]
  24. Calder, N.; Jafri, M.; Guo, L. Mathematics Education Students’ Experiences during Lockdown: Managing Collaboration in eLearning. Educ. Sci. 2021, 11, 191. [Google Scholar] [CrossRef]
  25. Nambiar, D. The impact of online learning during COVID-19: Students’ and teachers’ perspective. Int. J. Indian Psychol. 2020, 8, 783–793. [Google Scholar]
  26. Abdelmatloub, M.R. Online Learning during the COVID-19 Pandemic and Academic Stress in University Students. Rev. Rom. Pentru Educ. Multidimens. 2020, 12, 100–107. [Google Scholar]
  27. Pazmiño, R.; Badillo, F.; González, M.C.; García-Peñalvo, F.J. Ecuadorian Higher Education in COVID-19: A Sentiment Analysis. In Proceedings of the Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality, Salamanca, Spain, 21–23 October 2020. [Google Scholar]
  28. Adnan, M.; Anwar, K. Online learning amid the COVID-19 pandemic: Students’ perspectives. J. Pedagog. Sociol. Psychol. 2020, 2, 45–51. [Google Scholar] [CrossRef]
  29. Chandra, Y. Online education during COVID-19: Perception of academic stress and emotional intelligence coping strategies among college students. Asian Educ. Dev. Stud. 2020, 10, 229–238. [Google Scholar] [CrossRef]
  30. El Said, G.R. How Did the COVID-19 Pandemic Affect Higher Education Learning Experience? An Empirical Investigation of Learners’ Academic Performance at a University in a Developing Country. Adv. Hum. Comput. Interact. 2021, 2021, 1–10. [Google Scholar] [CrossRef]
  31. Prat, J.; Llorens, A.; Alier, M.; Salvador, F.; Amo, D. Impact of Covid-19 on UPC’s Moodle Platform and ICE’s Role. In Proceedings of the Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality, Salamanca, Spain, 21–23 October 2020. [Google Scholar]
  32. Krouglov, A. Student Performance in Emergency Remote Learning and Assessment in Simultaneous Interpreting Training. In Proceedings of the International Scientific Conference, Rēzeknes Tehnoloģiju akadēmija, Latvia, 28–29 May 2021; Volume 1, pp. 363–373. [Google Scholar]
  33. Sugino, C. Student Perceptions of a Synchronous Online Cooperative Learning Course in a Japanese Women’s University during the COVID-19 Pandemic. Educ. Sci. 2021, 11, 231. [Google Scholar] [CrossRef]
  34. Uukkivi, A.; Labanova, O.; Retshnoi, V.; Safiulina, E.; Latynina, M.; Eensaar, A.; Ovtsharenko, O.; Lillemets, V.; Timmermann, R.; Mishtshenko, A. Learing Sciencein Remote Learning: The Learnrs’ View. In Proceedings of the INTED2021 Proceedings, Valencia, Spain, 8–9 March 2021. [Google Scholar]
  35. Nazarova, L.V.; Pomeranian, I.B. Distance Learning Experience; St Petersburg State University, Review: Technology and Design Series 3: Economic, Humanitarian and Science Founders; St Petersburg State University: St Petersburg, Russia, 2020; pp. 126–133. [Google Scholar] [CrossRef]
  36. Hofstede, G. Dimensionalizing Cultures: The Hofstede Model in Context. Online Readings in Context. Online Read. Psychol. Cult. 2011, 2, 2307-0919. [Google Scholar]
  37. Hostede Insights Country Comparisons. Available online: https://www.hofstede-insights.com/country-comparison/ (accessed on 14 May 2021).
  38. Adams, A.; Cox, L. Questionnaires, in-depth interviews and focus groups. In Research Methods for Human Computer Interaction; Cambridge University Press: Cambridge, UK, 2008; pp. 17–34. [Google Scholar]
  39. Dudás, P. Segmentation using a decision tree. Econ. New 2018, 9, 49–54. [Google Scholar]
  40. Kass, G. An exploratory technique for investigating large quantities of categorical data. Appl. Stat. 1980, 29, 119–127. [Google Scholar] [CrossRef]
  41. Hámori, G. A CHAID alapú döntési fák jellemzői. Stat. Szle. 2001, 79, 703–710. [Google Scholar]
  42. Kaiser, H.F. An index of factorial simplicity. Psychom 1974, 39, 31–36. [Google Scholar] [CrossRef]
  43. Plummer, L.; Kaygısız, B.B.; Kuehner, C.P.; Gore, S.; Mercuro, R.; Chatiwala, N.; Naidoo, K. Teaching Online during the COVID-19 Pandemic:A Phenomenological Study of Physical Therapist Faculty in Brazil, Cyprus, and The United States. Educ. Sci. 2021, 11, 130. [Google Scholar] [CrossRef]
  44. Arnou, C.; Cornelis, G.; Heymans, P.J.; Howard, S.K.; Leemans, G.; Nuyens, I.; Tondeur, J.; Vaesen, J.; Driessche, M.V.D.; Elen, J.; et al. COVID-19 and Educational Spaces: Creating a Powerful and Social Inclusive Learning Environment at Home, Academia.edu. 2020. Available online: https://www.academia.edu/download/63264421/20200507_EN_create_a_learning_environment_at_home20200510-115155-1l3v4pe.pdf (accessed on 31 July 2021).
  45. Venter, M.; Craffert, L.; van Greunen, D.; Veldsman, A.; Candi, M.; Sigurdarson, H.T. Diagnosis of the Digital Landscape in South Africa-Skills, Infrastructure and Available Technologies. European Union Erasmus Plus. 2019. Available online: https://project.commongoodfirst.com/wp-content/uploads/2019/11/D2.4-Consolidated-Overview.pdf (accessed on 31 July 2021).
  46. Pew Research Center. 8 Charts on Internet Use around the World as Countries Grapple with COVID-19: Akamai’s. 2017. Available online: https://www.pewresearch.org/fact-tank/2020/04/02/8-charts-on-internet-use-around-the-world-as-countries-grapple-with-covid-19/ (accessed on 31 July 2021).
  47. Thomsen, J.P. Exploring the heterogeneity of class in higher education: Social and cultural differentiation in Danish University programmes. Br. J. Sociol. Educ. 2012, 33, 565–585. [Google Scholar] [CrossRef]
  48. How Long Should Videos Be? The Ideal Length for Marketing. Available online: https://www.talkingtreecreative.com/blog/video-marketing-2/the-impact-of-video-length-on-engagement/#:~:text=Research%20indicates%20the%20average%20adult%20attention%20span%20is%20about%208%20seconds (accessed on 10 January 2020).
  49. Gallo, C. The Science behind TED’s 18-Minute Rule. Available online: https://www.linkedin.com/pulse/20140313205730-5711504-the-science-behind-ted-s-18-minute-rule/ (accessed on 13 March 2014).
  50. Besser, A.; Flett, G.L.; Zeigler-Hill, V. Adaptability to a sudden transition to online learning during the COVID-19 pandemic: Understanding the challenges for students. Sch. Teach. Learn. Psychol. 2020. [Google Scholar] [CrossRef]
  51. Fletcher School. Digital Intelligence Index; The Fletcher School, Tufts University: Medford, MA, USA, 2021; Available online: https://digitalintelligence.fletcher.tufts.edu/ (accessed on 31 July 2021).
Figure 1. Cultural dimensional differences between Hungary, South Africa and Wales / UK based on Hofstede’s dimensions [37], adapted by the authors.
Figure 1. Cultural dimensional differences between Hungary, South Africa and Wales / UK based on Hofstede’s dimensions [37], adapted by the authors.
Education 11 00403 g001
Figure 2. The number of participants from each of the countries.
Figure 2. The number of participants from each of the countries.
Education 11 00403 g002
Figure 3. The student’s perceptions of their digital learning.
Figure 3. The student’s perceptions of their digital learning.
Education 11 00403 g003
Figure 4. Home learning environment, by participating country.
Figure 4. Home learning environment, by participating country.
Education 11 00403 g004
Figure 5. Student Engagement by participating country.
Figure 5. Student Engagement by participating country.
Education 11 00403 g005
Figure 6. Participation preference.
Figure 6. Participation preference.
Education 11 00403 g006
Figure 7. Impact on learning skills by participating country.
Figure 7. Impact on learning skills by participating country.
Education 11 00403 g007
Figure 8. Decision Tree to identify the strongest separating variables.
Figure 8. Decision Tree to identify the strongest separating variables.
Education 11 00403 g008
Table 1. Four dimensions of online learning experience—factor loadings.
Table 1. Four dimensions of online learning experience—factor loadings.
DimensionFactor Loading
Home learning environment
I have a good learning environment at home (or where I reside)0.659
I have the appropriate digital equipment to access the university digital environment0.812
I am satisfied with my Internet access0.683
Student engagement
I miss the in-person interaction with other students−0.809
I cannot concentrate and engage with the learning effectively when the lecture or seminar video is longer than 15 min−0.616
I found it easy to interact with my lecturers and peers during an online lecture/seminar session0.753
I preferred accessing the digital learning environment more than the in-person on campus learning0.789
Participation preference
I like to actively participate in online discussions0.770
I always have my video on when attending an online session0.566
I prefer to work independently−0.494
Impact on learning skills
The online academic education during the pandemic, helped me to become more independent as a learner0.820
The online academic education during the pandemic, improved my digital literacy0.801
Table 2. Comparison of home learning environment.
Table 2. Comparison of home learning environment.
Comparisons of Column ProportionsGroup
HungaryWalesSouth Africa
(A)(B)(C)
I have a good learning environment at home (or where I reside)Disagree A (0.001)A (0.000)
Neutral A (0.001)
AgreeB (0.000)
C (0.000)
Significance level < 0.05.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Cranfield, D.J.; Tick, A.; Venter, I.M.; Blignaut, R.J.; Renaud, K. Higher Education Students’ Perceptions of Online Learning during COVID-19—A Comparative Study. Educ. Sci. 2021, 11, 403. https://0-doi-org.brum.beds.ac.uk/10.3390/educsci11080403

AMA Style

Cranfield DJ, Tick A, Venter IM, Blignaut RJ, Renaud K. Higher Education Students’ Perceptions of Online Learning during COVID-19—A Comparative Study. Education Sciences. 2021; 11(8):403. https://0-doi-org.brum.beds.ac.uk/10.3390/educsci11080403

Chicago/Turabian Style

Cranfield, Desireé J., Andrea Tick, Isabella M. Venter, Renette J. Blignaut, and Karen Renaud. 2021. "Higher Education Students’ Perceptions of Online Learning during COVID-19—A Comparative Study" Education Sciences 11, no. 8: 403. https://0-doi-org.brum.beds.ac.uk/10.3390/educsci11080403

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop