Next Article in Journal
Social Commitment at Higher Education Institutions: Analysis of Their Strategic Plans
Previous Article in Journal
Exploring the Barriers to Physical Education Opportunities in India’s Schools: A Study of Parental Perceptions after the Unprecedented Performance at the Tokyo Olympics
Previous Article in Special Issue
Experimental Programs of Critical Thinking Enhancement: A Worked-Based, Blended Learning Higher Education Curriculum for Economics
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Examining Pre-Service Teachers’ Critical Thinking Competences within the Framework of Education for Sustainable Development: A Qualitative Analysis

by
Panagiota Christodoulou
* and
Anastasios Papanikolaou
Department of Primary Education, School of Social Sciences and Humanities, University of Western Macedonia, 53100 Florina, Greece
*
Author to whom correspondence should be addressed.
Submission received: 4 October 2023 / Revised: 7 November 2023 / Accepted: 22 November 2023 / Published: 25 November 2023

Abstract

:
Empowering teachers with Critical Thinking and an understanding of sustainability is vital for guiding students’ informed decisions and actions in today’s world. Higher education needs innovative, student-centered methods like case-based teaching in order to promote Critical Thinking and the principles of Education for Sustainable Development. The aim of the study was to explore and evaluate pre-service teachers’ Critical Thinking when engaged with case studies in a practicum preparation course centered on Education for Sustainable Development. Nine undergraduate students in teacher education participated in the study and answered four case studies. The case studies’ responses were analyzed through a bottom-up content analysis revealing eight higher-order categories. While approaching the case studies, student teachers followed thinking processes similar to the processes proposed by the iterative models of Critical Thinking. Nevertheless, in some cases, pre-service teachers’ disengagement was evident. The rubric assessment highlighted that the responses fell under three profiles, namely the “Deficient Critical Thinker”, the “Emerging Critical Thinker” and the “Competent Critical Thinker”. The findings emphasize the need for targeted and individualized teaching interventions in teacher higher education programs aiming at Education for Sustainable Development complying with the learning needs of student teachers’ Critical Thinking profiles.

1. Introduction

UNESCO’s 2030 Agenda highlights the mission of Education for Sustainable Development (ESD) in promoting Quality Education (SDG4) [1]. Quality Education is not limited to steer memorization of conceptual knowledge but emphasizes the importance of developing Critical Thinking (CT), problem-solving, and analytical skills. CT within the framework of the 2030 Agenda is of paramount importance for at least two reasons. First, CT is essential for addressing complex global challenges, such as environmental sustainability and social justice, which are central themes of the 2030 Agenda. Second, CT is important as the 2030 Agenda promotes the idea of Global Citizenship. Particularly, citizens are encouraged to make informed and responsible decisions responding to complex global challenges and take actions that contribute to building a just society. Teacher education has the responsibility to prepare teachers who can provide high-quality and inclusive education to learners of all backgrounds and abilities. Consequently, the integration of specific competences linked to the development of CT in the educational curriculum is crucial [2]. However, meeting this demand requires higher education instructors to transform their teaching by employing student-centered instructional approaches fostering active learning and decision-making, such as problem-based and case-based teaching [3]. Case-based teaching has been effectively associated with ESD [4,5] and CT [6,7]. Still, this task, namely transforming higher education instruction for ESD and CT, has proven challenging, and only limited empirical findings can be identified in the literature (e.g., [8]). Hence, this study aimed to investigate pre-service teachers’ CT in case-based teaching centered on a practicum preparation course in the context of the ESD and to assess the quality of their CT responses within this context.

1.1. Education for Sustainable Development and “Environmental Study”

ESD in higher education has long been an established field as its role was recognized relatively early [9,10], and its expansion was propelled by the efforts of many initiatives and programs, particularly by the United Nations [11,12]. ESD in higher education aligns with the current UNESCO’s ESD for 2030 education program [13] and, particularly in teacher education, focuses on fostering knowledge and competences that are essential for restructuring educational processes and educational institutions towards sustainability [1] (p. 51). Teachers, as key facilitators of learning, are critical for providing good-quality education [10] and are powerful change agents who can deliver the educational response needed to achieve the Sustainable Development Goals [1] (p. 51). Hence, globally, actions are implemented to embed ESD in teacher education [14].
In K–12 education, ESD is not a subject on its own, and it is promoted interdisciplinary [15]. In Greek primary education, there is a compulsory subject, “Environmental Study” (in Greek, Μελέτη Περιβάλλοντος), which shares many common aspects with ESD, such as aims, characteristics, and thematic areas. According to the current Interdisciplinary Unified Curriculum Framework of the Greek School System [16], the overarching aim of the subject “Environmental Study” is the construction of knowledge and the development of skills, values, and attitudes that allow students to observe, describe, interpret, and predict the functions, relations, and interactions of the natural and human-made environment in which human activity develops. Ultimately, the subject renders students aware of the advantages and the imperative for sustainable development. The subject is offered in the first four grades of primary education. The main characteristics of the subject are interdisciplinarity and emphasis on CT, and it focuses thematically on the environment in which students live. Thus, “Environmental Study” is within the context of ESD.
Teacher training programs in Greek higher education not only provide courses on ESD but also provide courses focusing on the instruction approaches suitable to meet the overarching aim of the Greek Primary School Curriculum. The aim of such a course, named “Teaching approaches of the Environmental Study” in primary school, is to familiarize student teachers with the conceptual and methodological framework of the subject and to enable them to acquire conceptual and procedural knowledge, as well as the skills necessary for the design, implementation, and evaluation of lesson plans based on the relevant curriculum.

1.2. Conceptualization of Critical Thinking

The concept of CT, a multifaceted cognitive process essential for informed decision-making, stands as a subject of perplexity even among the scientific community. The multidimensional aspects of CT encompass analytical skills, logical reasoning, evidence evaluation, and the ability to synthesize information from diverse sources, making it a challenging task to encapsulate within a singular definition. There is a strand of scientists highlighting that CT is a two-dimensional construct composed of skills, namely cognitive abilities or competences and dispositions, which refer to attitudes and intellectual traits (e.g., [16,17,18]). According to [18], CT skills include interpretation, analysis, evaluation, inference, explanation, and self-regulation, while CT dispositions encompass truth-seeking, open-mindedness, analyticity, systematicity, self-confidence, inquisitiveness, and cognitive maturity.
However, there is another strand of scientists encompassing CT as an iterative process or cycle rather than a static skill engaging thinkers in ongoing thinking with specific steps [19,20,21]. In particular, the renowned philosopher John Dewey conceptualized CT as closely related to reflective thinking underlining the importance of five stages where this type of thinking is triggered while the learner is engaged in solving a problem. Firstly, the learner is engaged in making suggestions wherein the mind proposes possible solutions (suggestion). Then, the learner identifies and clarifies the ideas into a solvable problem (problem definition). At the same time, the learner uses one suggestion after another as a leading idea or hypothesis guiding observations and other operations while collecting factual material (hypothesis generation). Moreover, the learner mentally elaborates on the idea or supposition (reasoning). Finally, the learner engages in hypothesis testing (hypothesis testing). Dewey’s conceptualization of CT emphasizes the importance of reflective thinking and problem-solving in a linear sequence.
Brookfield [21] envisioned CT in a similar way, where the learner is engaged through five thinking phases starting with the triggering event, then the appraisal of the situation, the exploratory phase to explain anomalies or variances, the development of alternative perspectives, and finally the integration of alternatives into ways of thinking or acting. In comparison to Dewey, Brookfield’s concept of CT adds the dimension of exploring alternative perspectives as a step integrated into one’s thinking process. Further, according to Garrison [22], CT is a complete cycle of thinking activities including both problem-solving and creative thinking. Akin to Dewey or Brookfield, the thinking cycle of Garrison includes problem identification, problem definition, exploration, applicability, and integration. Although CT is a cyclical process for Garrison, he underlines that according to the context and the nature of the problem, the phases of CT could overlap.

1.3. Education for Sustainable Development and Critical Thinking

CT is considered one of the key competences of achieving sustainability [23] because it enables students to understand the state of the environment [24], analyze and solve environmental problems [25], and understand how new political, social, and economic structures and processes can lead us to sustainability [26]. More importantly, CT can empower students to question norms, practices, and opinions, reflecting on their values, perceptions, and actions as well as taking a position in the sustainability discourse [1], which will eventually allow them to participate in a democratic society [27]. CT is the quintessence of ESD, by definition and mission [1], as it teaches students “how to think” and not “what to think” [28] (p. 5). Studies that explore the connection between ESD and CT development in higher education are mounting, although they also point to the need for further research and practice (e.g., [29,30,31,32]). Although CT is considered as a key competence for educators promoting the Sustainable Development Goals [33], very little relevant research has been conducted on mapping the primary education teachers’ skills for the topic [27].
For higher education instructors to promote CT and the principles of Sustainable Development in learning and instruction, they need to transform their teaching. In particular, ESD pedagogies enable educators to shift from teacher-centered to student-centered instruction [34]. This shift helps in steering away from traditional instruction and embracing problem/case-based methodologies that foster CT and social analysis [3] meeting the need for transformation of their teaching. Besides, ESD pedagogies and instruction for CT are interconnected in many ways. First, to promote ESD effectively, it is necessary to support students’ construction of content knowledge [3]. Content knowledge is also essential for students to be able to exercise CT [35]. Second, ESD calls for students not only to think but also to act to promote sustainability by promoting an action-oriented learning approach [36]. This concept is in line with the concept of criticality introduced by [37] and further developed by [38], which expresses the need for students not only to argue, judge, or reflect critically but also to act critically and be critical thinkers. Finally, [3] suggest that ESD requires emotional learning for values and ethics to be activated, which in return could lead to a sustainable way of acting and being. Paul [39] argued that moral reasoning and citizenship are intertwined with CT. Moral reasoning involves understanding and empathizing with diverse perspectives and values. CT aids in developing this empathy by encouraging individuals to explore and analyze different viewpoints. In that way, individuals can move from egocentric to more global perspectives and make decisions or take actions defending the public good.

1.4. Case-Based Teaching

Various terms have been used in relevance to case-based teaching, which has been widely recommended as an appropriate approach for teacher training and teacher professional development (e.g., [40,41,42,43]). Cases are considered realistic class or school narratives essential for teacher training as they can exercise students’ professional judgement. Case-based teaching can vary in implementation. For instance, [40] suggest that the case, namely the scenario, is introduced, and students, building on their previous knowledge, generate hypotheses, which they can verify upon enquiry. This action leads them to a conclusion or a decision. Empirical research has concluded that teacher education should be case-based for various reasons [44,45]. First, case-based teaching facilitates students’ understanding that every situation in practice is unique and complex. Second, case-based teaching links theory and practice, as it can enhance students’ understanding of educational theories and principles and offer real-life settings for their application. Third, a case study allows for various acting approaches according to the diagnosis made by the teacher. Further, case-based teaching can provide student teachers with insights into their preconceptions of teaching.
Case-based teaching is deemed an appropriate method for promoting the principles of ESD in higher education. In particular, ESD calls for instructional approaches that facilitate active learning and promote responsibility and accountability while amplifying the ability to understand the interconnectedness of knowledge with real-life situations along with recognizing the potential consequences of one’s actions in the future [46]. Empirical studies highlight that case-based teaching can promote not only knowledge about sustainability concepts [5] but can also change students’ perceptions towards more sustainable decision-making [47].
Besides ESD, case-based teaching has been indicated as an effective approach to promoting CT. A line of the literature articulates the relationship between CT and the learning processes involved in teaching approaches including case-based teaching. At the same time, it stresses the effectiveness of case-based teaching for CT through empirical studies, reviews, and meta-analyses. To illustrate, [48] suggests that case-based teaching is appropriate for promoting CT as students engage in processes like analysis of the case, perspective-taking, evaluation of the sources of information, identification of alternatives, and assessment of the consequences of decisions or actions. Additionally, in her definition of CT, Halpern [49] (p. 8) mentioned explicitly that CT is the type of “thinking involved when solving problems, formulating inferences, calculating likelihoods, and making decisions”, processes engaged in case-based teaching as well. Further, Harrington [41] indicated that student teachers may learn to identify a problem and become aware of different perspectives through case-based teaching crucial for their CT. A meta-analysis conducted by [6] indicated that exposure of students to “authentic or situated problems” and examples can positively affect CT. Authors perceived “authentic or situated problems” as including instructional approaches like applied problem-solving, case studies, simulations, playing games, and role-playing. Similar were the results obtained by [7]. In their systematic review [7] and meta-analysis, they conceptualized problem-based learning similar to [6], including teaching strategies such as real cases/problems, (Socratic) class discussions/debate, inquiry-oriented experiments, problem-solving, problem-finding, brainstorming, decision-making, and analysis. Their findings indicated that, when compared to the control groups, participants’ scores of CT were improved in the experimental groups.

1.5. Assessing Critical Thinking

Conceptual and procedural aspects promoted during learning and instruction are essential to be assessed. Still, assessing CT can be challenging for instructors. One reason is that CT has multiple definitions, resulting in a lack of agreement about one instrument that successfully measures CT. There are various standardized CT tests, such as the Cornell Critical Thinking Test, the California Critical Thinking Dispositions Inventory, the Ennis–Weir Critical Thinking Essay Test, and the Halpern Critical Thinking Assessment test, among others [50]. Since each of the above tests is grounded on a particular definition of CT, one can argue that they differ in the aspects of CT they measure, namely different skills or dispositions [51]. Moreover, they have been criticized for failing to take into account fundamental issues regarding the nature of CT (e.g., domain specificity and transferability) [50]. Further, the CT standardized tests have been considered as having significant weaknesses in terms of validity and reliability [50,52]. Additionally, the standardized CT tests rely primarily on multiple-choice questions rather than on open-ended performance assessments. Therefore, it has been argued that such assessments are not authentic to the CT process triggered in real-life contexts or present unfamiliar situations to students [50,51]. Although one can find additional drawbacks in the literature with respect to the use of CT standardized tests, we conclude by highlighting that such tests are not easily accessible and are costly for mainstream use.
Recently, the use of assessment rubrics [53] has been highlighted as an appropriate assessment method for concepts such as CT. Assessment with rubrics falls under performance assessment [54], which reflects students’ abilities to solve real-world problems, analyze, synthesize information, and apply their knowledge and skills, while their performance is assessed against a set of well-defined criteria [55]. Rubrics are perceived as a criterion-referenced assessment, namely an evaluation method where students’ performance is measured against a set of predefined criteria or standards [56]. Rubrics can be categorized either as holistic, namely providing a single score based on an overall impression of a student’s performance on a task, or as analytic, to wit, providing specific feedback on several dimensions and levels [57,58].
Among the benefits reported in the literature regarding the effectiveness of rubrics are the increased consistency of judgement in evaluating performance and authentic tasks, the consistency in scoring across different students, assignments, as well as among multiple raters [57]. Moreover, rubrics enable valid assessment of complex competences accurately while providing a balance between validity and reliability of measurements [57]. Further, they are perceived as quick and easy to use, providing feedback to both students and instructors, as well as assessing individual aspects of a skill providing more detailed feedback [59]. Additionally, rubrics can be tailored to measure students’ performance either on specific content or specific skills, such as CT skills (e.g., [60]). Still, there are CT rubrics which attempt to assess performance on both content and skills [53,61]. Acknowledging the importance of rubrics in CT assessment, various scholars have employed this approach when assessing students’ CT performance [53,56,59,62,63].

1.6. The Current Study

In light of the evolving educational landscape, it is an imperative need for prospective teachers to be capacitated both in CT and in instruction for sustainability. Our previous literature review revealed some gaps and limitations, which the current study aims to address. First, the transformation of teacher education to integrate ESD and CT remains a challenging task, with only scarce empirical evidence in the existing body of research [8]. Second, although CT is recognized as a pivotal competency for educators supporting the Sustainable Development Goals [33], there is a lack of research examining primary education teachers’ CT, particularly in the context of ESD [27]. Moreover, the assessment of CT with standardized tests presents various limitations [50,51,52]. Consequently, the exploration of alternative assessment methods, such as rubrics, becomes increasingly pertinent. Therefore, the primary aim of the study was to investigate and evaluate pre-service teachers’ CT when engaged with case studies in a practicum preparation course centered on Education for Sustainable Development. The research question of the current study was:
How do student teachers approach case studies on “Teaching approaches of the Environmental Study” and what is the quality of their responses regarding CT?

2. Materials and Methods

In order to meet the objectives of the study, a cross-sectional research design was followed. Cross-sectional research design was deemed appropriate as we gathered data from a sample of individuals at a specific time. In addition, such research designs are useful for exploring relationships or associations between variables [64].

2.1. Sampling Method and Participants

A purposive sampling strategy, one of the nonprobability sampling methods often adopted in qualitative studies [65], was employed, and students enrolled in the course “Teaching approaches of the Environmental Study” were considered as participants of the current study. In particular, participants were nine (seven women) third- and fourth-year bachelor students in a teacher education program.

2.2. The Course “Teaching Approaches of the Environmental Study”

The course “Teaching approaches of the Environmental Study” is a compulsory course offered to students enrolled in a bachelor program on teacher education at a Greek University. The course focuses on teaching methodology and content knowledge of the specific subject matter “Teaching approaches of the Environmental Study”, which is taught in primary education. The academic course had a total duration of thirteen three-hour sessions per semester. Five sessions of the course focused on theoretical aspects of how to design a lesson plan as well as which teaching approaches and strategies are appropriate for the subject matter of the “Study of the Environment”. The rest of the sessions were more practical as they had an integrated apprenticeship format. Students were designing their lesson plans, which they then implemented at primary education schools collaborating with the University. After the implementation of students’ lesson plans, reflective sessions were taking place at the University. The instructor of the course employed student-centered teaching approaches, such as problem-based learning and case studies.
Moreover, the course integrated aspects of CT with the infusion approach. According to [66], infusion refers to the explicit instruction of CT aspects during the instruction of a specific subject matter. Thus, the instructor of the course, who was trained in CT (see [67] for more details on the training), during the first session of the “Teaching approaches of the Environmental Study” explicitly taught students about the nature of CT particularly referring to CT skills and dispositions. After explicit instruction of CT, students were engaged in case-based teaching through structured activities that would foster the application of CT knowledge. In the end, students reflected on the CT skills and dispositions activated during case-based teaching. These activities allowed students’ familiarization with case-based teaching.

2.3. Procedure and Data Collection Instruments

The study received ethical approval from the Research Ethics Committee of the University of Western Macedonia (Reg. No.: 230-2023/26-05-2023). In order to meet the study’s objectives, two data collection measures were used, namely (i) four case studies and (ii) the Critical Thinking Quality of Response Rubric (see Figure 1).

2.3.1. The Case Studies

After the explicit instruction of CT and familiarization with case-based teaching during the first session of the course, the instructor provided four case studies throughout the semester to students in order to further train students’ lesson planning skills as well as their CT skills. The case studies were real ill-structured lesson plans that could be applied in the school setting. The aim was for students to identify the inconsistencies in the case studies and suggest how they could be addressed. The case studies varied in complexity, from simple to complex. One indicative case study of medium complexity provided to the students was the following:
A student of the Department of Primary Education has designed his lesson on “Air pollution”. His teaching will take place in the context of practical training in the 4th grade of primary school at the 5th Primary School of Florina. The 4th-grade class consists of 10 boys and 10 girls. The student in his lesson plan set a cognitive learning objective: “To make students aware of human activities that cause air pollution”.
In the lesson plan, he states that as a related activity to this objective within the lesson, he will share with all students information he found in a 2012 publication from a personal blog. This information states that “the area of Ptolemaida-Kozani has high air pollution values due to the coal power plants and calm weather, that the area around the coal power plant in the area of Megalopolis in the prefecture of Arcadia has a significant problem, and then lists several areas in Greece that have air pollution problems due to industrial plants (e.g., Lesbos: lime kilns and seed oil extraction plants at the entrance to the town, Syros and Neorio (Cyclades): PPC station, etc.)”. The student intends to read and discuss the information on this page in class. The instructor encourages the student to reconsider the quality of his proposed activity before implementing it in the classroom. He also points out that the information in the personal blog he found does not help achieve the objective he set for his lesson. The student is not sure that he should take the instructor’s suggestion into account, as he believes that the information on the personal blog does mention human activities that cause air pollution.
What should the student do?
Students were engaged with the case studies individually. The activity was initiated during the face-to-face sessions at the University but was completed by students as homework assignments. Therefore, students had an interval of a week to finalize each case study and submit it to the instructor via Moodle. There was no word limit while answering the case studies. No extra credits or tokens were provided to students for completing the cases. The case studies were among the activities that students had to complete in order to be awarded a mark at the end of the semester after engaging in the course’s final exams. Each case study was accompanied by seven questions that further guided students in engaging with the case study and aimed at triggering their CT skills. Table 1 presents the questions of each case study.

2.3.2. The Critical Thinking Quality of Response Rubric

The Critical Thinking Quality of Response Rubric (CTQRR) employed in the study assessed the quality of students’ responses across case-based teaching. The rubric was inspired by the common rubric proposed by [62]. The common rubric mainly focused on evaluating the application of specific problem-solving skills during a performance task. Our rubric was adopted and, instead of problem-solving skills, addressed specific CT skills. In particular, the rubric provided explicit criteria for seven CT skills, namely inference, interpretation, explanation, evaluation, analysis, self-regulation, and reflection (see Appendix A). We chose these skills for three reasons. First, they were explicitly taught to students during the course of “Teaching approaches of the Environmental Study”. Second, these skills are often included in the definitions of CT [18,49] and recognized as relevant to problem-solving and case-based teaching [68]. We also included reflection as an essential element of CT [20,69]. Third, these skills are essential for the teaching profession [70]. Further, our adaptation of the rubric guided the design of the performance tasks, namely the case studies and particularly the questions that students had to respond to (see Table 1). The questions included in the performance task aimed at triggering the CT skills addressed by the CTQRR. We developed unweighted additive criteria, which we assumed to be equally relevant for CT. Moreover, depending on the quality of the responses, students were categorized in one out of the three levels of the rubric, namely “below or merely meet expectations-level 1”, “meets expectation-level 2”, and “exceeds expectation-level 3”. For each level, the criteria were 18. At the first level, each criterion could be scored with one point, with two points for the second level, and with three points for the third level. Thus, the highest score for the first level was 18 points, for the second level was 36 points, and for the third level was 54. If a criterion was not applicable, it was scored with no points. To ensure that the CTQRR accurately measured the intended CT skills, we conducted a content validity check with the input of two experts in the field of CT. During the content validity assessment, the experts were provided with the initial version of the CTQRR. The experts carefully examined the rubric and evaluated each of its criteria using a five-point scale, where 1 represented low validity, and 5 indicated high validity. This evaluation process allowed the experts to assess the alignment of the rubric with the intended CT skills we aimed to measure. The content validity evaluation by the experts resulted in the rubric being deemed as valid, with the experts consistently assigning high validity ratings to each of the criteria. However, it is important to note that the experts also provided some constructive feedback, primarily related to the wording of certain criteria. We valued their input and used their suggestions to refine the CTQRR before its implementation in our study. Further, the inter-rater reliability was calculated to assess the consistency of ratings between two raters. One rater was an expert in CT and the other at the “Teaching approaches of the Environmental Study”. Prior to commencing the rating process, the two raters engaged in a comprehensive discussion to establish a shared understanding of the specific CT skills that each question in the case study was designed to assess. This initial discussion served as the foundation for the subsequent assessment process. Both raters assessed students’ responses to the four case studies, individually assigning a level of quality to the responses. Cohen’s kappa coefficient was high between the two raters (0.86). In the cases where disagreements arose, the raters engaged in further dialogue and deliberation to resolve any discrepancies in their assessments.

2.4. Data Analysis

In order to answer the research question of the study, we employed a qualitative content analysis, which is an appropriate method for analyzing written, verbal, or visual communication [64]. The qualitative analysis aims at classifying large amounts of text into several categories, which share similar meanings and interpret a broad context [71]. The data were analyzed employing the inductive approach, but theoretical evidence was considered for naming the categories and subcategories that emerged from the analysis. The unit of analysis was the entire answer that students wrote for each case study question (see Table 1). Two experienced raters in social sciences coded the data, and the inter-rater agreement was high (k = 0.85). Any differences between the two raters were alleviated after discussion.

3. Results

3.1. How Do Student Teachers Approach Case Studies on “Teaching Approaches of the Environmental Study”?

In total, 252 units of analysis were identified across the four case studies for all students engaged in the study. These units of analysis were classified into 25 codes, which in turn were grouped into 19 subcategories that resulted in eight higher-order categories (see Figure 2 and Appendix B for more information and examples).
From the total 252 units of analysis identified, almost one-third revealed a lack of students’ answers and their disengagement with the questions of the case studies. We perceived this finding as rather interesting and decided to code these units of analysis in one subcategory, which resulted in one higher-order category. The category was named “Disengagement from the case study”.
The next most frequently coded category was named “Clarifying concepts and ideas”. In this category, we grouped units of analysis revealing that students tried to understand and clarify the concepts and ideas depicted in the case study. Two subcategories were grouped under this higher-order category. In the first subcategory, students clarified concepts and ideas drawing information from the case study or their previous knowledge. For instance, one student mentioned, “Also, if the information the student has gathered does not meet the learning objective set, the student must either modify the objective or gather additional information.” Thus, we named this subcategory “Clarifying concepts and ideas drawing from the case study or previous knowledge”. The second subcategory included statements revealing that students did not clarify any concepts or ideas from the case study and either focused on suggesting solutions to the case studies or highlighted the importance of engaging with such case studies for better teacher training. To illustrate, a student said that “My opinion about the student’s problem is that the student should listen to the professor’s opinion and suggestion.” Therefore, we named the subcategory “Avoiding clarifying concepts and ideas”.
Another frequently coded category referred to students’ reflection while engaging with the case studies and was named accordingly “Reflection”. Reflection was linked with students’ monitoring of their thinking process and the changes students made in their way of thinking. Therefore, two subcategories were grouped under this category. The first one was more frequently coded and included students’ statements revealing that they engaged in monitoring their thinking and was named “Monitoring thinking”, such as the following statement: “I didn’t change my thinking process”. The second subcategory was less frequent and included statements depicting that students not only monitored but also changed their thinking. For example, “I extensively changed the way I think during problem solving.” Thus, the subcategory was named “Monitoring and changing thinking”.
The fourth category, which was quite often coded, revealed that students engaged in the process of justifying their ideas. Therefore, we named this category as “Justification of ideas”. Three subcategories were merged under this higher-order category revealing that students justified their ideas on external sources (e.g., their instructor), such as the following student’s response: “I justify my opinion on the knowledge I have acquired while attending the course ‘Teaching approaches of the Environmental Study’”, on the scenario of the case studies per se, such as “I justify my ideas on the information of the case study”, and their intuitions or beliefs. One such example was the following response: “I justify my ideas on my belief that misconceptions should not be perpetuated.” To depict these differences, we named the subcategories as “Justification of ideas on external sources”, “Justification of ideas on the scenario”, and “Justification of ideas on intuitions and beliefs”, accordingly.
The fifth category identified in the data included students’ statements highlighting that they could or could not categorize the information provided in the case study. In the case that students categorized information, it was evident that they often completed the categorization inadequately. This category was named “Categorizing information” and included three subcategories. The most frequently coded subcategory revealed that students categorized the case study information insufficiently. For instance, a student mentioned “Relevant information: Getting to know the animals, 10 boys and 10 girls, cognitive and emotional objective, the zoo, the song, the working groups, the worksheets, the products, home (of the animals). Irrelevant information: the name of the school, “He will have asked … the animals”, camera.” Thus, we named it “Inadequate categorization of information”. The following two subcategories were not so often identified among the data. They depicted that students either categorized sufficiently the information of the case studies, such as the following response: “Relevant information: The cognitive objective of the student, The (teaching) method chosen., The activity of the discussion, The instructor’s suggestions, The student’s reluctance to accept the instructor’s suggestions., Irrelevant information: The teaching is part of a practical exercise., The school in which it will take place., The number of pupils in the classroom, The details of what is ‘student-centered teaching.” or avoided conducting any categorization of information, expressing a type of opinion such as the next response: “The problem as presented here is that the guide, in answering the student, reproduced a well-known misconception associated with the Theory of Evolution. He did not phrase the answer correctly. As a professional guide he should have known the (appropriate) answer for a 4th grade elementary school student. I believe all the information given is relevant to the problem.” Therefore, we named them “Adequate categorization of information” and “Lack of categorization of information”, respectively.
The sixth and seventh categories had the same frequency among the data. The sixth category included students’ statements highlighting that they approached the case study by suggesting solutions for the case study or by repeating information from the case study. However, these ideas were unclarified or initial ideas that would require further elaboration to be considered solutions for the case studies. The category was named “Initial approach to the case study” and included two subcategories. The majority of statements were included in the first subcategory and denoted that students directly suggested an unjustified solution to the case study. For example, an indicative answer was “The student should accept the professor’s suggestion because firstly, the professor pointed it out to him, and he must have a point. Secondly, as we understand from reading the text, his lesson plan is incomplete.” Hence, we named the subcategory as “Suggesting a solution for the case study”. In addition, we identified a few statements highlighting that students’ ideas for solving the case study were, in fact, a repetition of ideas presented in the case study. To illustrate, “In my opinion, the professor is partially right and partially wrong at the same time. The professor suggests that the student reconsider the choice of the activities included in the lesson plan as the information included in the worksheet will not help the pupils achieve the cognitive learning objective stated in the plan.” Thus, we named this subcategory “Repeating case studies’ information”.
In the seventh category, we included statements showing that students suggested solutions to the case studies, and we named this category “Suggesting solutions for the case study”. In this specific category, we included three subcategories, which will be presented in frequency order. Specifically, the first one included students’ statements suggesting one or multiple solutions for the case studies. In some cases, the solutions were justified, and in some other cases, they were unjustified. A respective example is the following: “The proposed solution is to revise the lesson plan, because this will meet the criteria of effective teaching of this course”. Therefore, this subcategory was named “Suggesting one or multiple solutions for the case studies”. In the second subcategory, statements depicting that students suggested their initial ideas as solutions to the case studies were included. The ideas that have been suggested as final solutions were in some cases provided with explanations. Such a statement was the following: “I would advise the student to review the terms of the learning objective, the method, and the proposed activity. This is because only saying that a student-centered approach will be used in instruction, does not imply that active action and free expression of the students will be ensured. Also, I do not think that socratic dialogue could be used feasibly for third grade students, as it is more advanced than their developmental level”. This subcategory was named “Accepting initial ideas as final solutions to the case study”. Finally, there was one statement identified where no solution was provided. Instead, the student suggested a general opinion on how problems related to lesson planning should be solved. This subcategory was named “Lack of suggesting a solution”.
Finally, the last category identified in the data was the least frequently coded and referred to the inquiry that students were, in some cases, engaged to gather the information that would foster the suggestion of a solution to the problem. We named the category “Inquiry of information”. This category included three subcategories. The first one included statements revealing that students identified gaps and recognized the information they needed, but they engaged with no inquiry. For example, “I will look for information on teaching strategies used in the “Study of the Environment”. I will seek information about the purpose and objective of the particular content and the verbs that can be used (in the formulation of the objectives).” Thus, we named this category as “Identifying gaps but avoiding inquiry”. The second subcategory denoted that students realized there was no need for searching for information. In addition, students’ statements included in this subcategory repeated information from the case studies. For instance, “All the necessary information for solving the problem is given in the text.” Hence, we named this subcategory “Lack of inquisitiveness”. The last subcategory included only two statements from students who searched for further information and provided examples of the information they enquired about. Therefore, the subcategory was named “Engaging in inquiry of information”.

3.2. What Is the CT Quality of Student Teachers’ Responses when Approaching Case Studies on “Teaching Approaches of the Environmental Study”?

A rubric-based assessment was followed to answer the second part of the research question. Students’ responses were classified into three levels indicating a different quality of students’ CT responses. According to the level of students’ classification, a profile was sketched. In Table 2, we present the results of students’ CT quality responses to the four case studies. Overall, the quality of the students’ responses revealed that the students were primarily categorized in Level 1 of the rubric. Still, some scarce Level 2 classifications were evident.
In the first level were classified responses below or merely meeting the expectations. In particular, students’ Level 1 responses reflected students’ inability to categorize information effectively, misinterpreting problem details, and weak analysis of arguments with the exploitation of limited or no evidence. Moreover, the responses demonstrated students’ inability to identify gaps and deficiencies in logical reasoning. They lacked self-awareness, exhibited bias, and failed to correct errors or reflect on their thinking process. The majority of students fell under this category, and students displaying the qualities mentioned above were perceived as “Deficient Critical Thinkers” (see Table 2).
Responses that met the expectations were classified in the second level of the rubric. Such responses were evidenced by students’ ability to categorize information accurately, decode problem data effectively, and offer reasonable interpretations. Further, they demonstrated adequate analysis of ideas and arguments, which were supported by sufficient evidence and well-structured reasoning. Additionally, they displayed an ability to identify gaps, generate plausible alternatives, draw logical conclusions, and present well-justified procedures. Their assessments considered credibility as a valuable criterion. Although they avoided biases, they reflected occasionally, leading to sporadic self-correction and infrequent reflection on outcomes. Only a few students were classified in Level 2 and they were characterized as “Competent Critical Thinkers” (see Table 3).
Responses categorized in the third level were perceived as exceeding expectations. Still, no response was classified at this level. Students’ responses that could have been categorized at this level would be expected to exhibit thorough categorization of information, insightful decoding of problem data, and comprehensive interpretation of information. Moreover, the responses would reflect rigorous examination of ideas, articulation, and analysis of arguments with compelling evidence, consistent gap identification, and suggestions of meaningful alternatives. Further, students in Level 3 would be able to consistently make well-founded conclusions and present persuasive, structured arguments with nuanced logical reasoning. Students would consistently assess credibility, avoid biases, and provide insightful evaluations with cogent reasoning. Finally, students would be expected to engage in systematic self-correction, unbiased thinking, and thoughtful reflection. Thus, they could be characterized as “Proficient Critical Thinkers”.
Taking into account the complexity of the case studies, it was evident that four out of the nine students managed to display an improvement in their CT skills when answering the third case study. Nevertheless, only “student 6” managed to retain this improvement and transfer the way of thinking to the fourth case study, which was the most complicated. No other pattern was identified in the data regarding the effect of the case studies’ complexity on students’ quality of CT responses.
We then further examined students’ responses, which were classified at Level 2 of the CTQRR, to identify any marginal classification. For that reason, the scores assigned by the raters for each student and each scenario were considered. The analysis revealed that for Students 6 and 7, a clearer score that fell under Level 2 of the CTQRR was assigned. However, Students 1, 2, and 3 (see Table 4) were marginally classified as Level 2. It was evident that the raters had scored students’ answers with a mixed approach, namely most of the indicators were assigned one point (Level 1), while some were assigned two points (Level 2). This finding reveals that some students had a profile indicating their CT skills development. Although their CT skills were closer to Level 1, some (e.g., analysis, evaluation) were classified as Level 2. Accordingly, we decided to sketch another profile between the “Deficient Critical Thinker” and the “Competent Critical Thinker”. This profile was named the “Emerging Critical Thinker”. Students in this profile show some promising growth in CT. Still, they demonstrate an inability to categorize information effectively or interpret problem data. Notably, their ability to evaluate and analyze arguments has improved, supported by the utilization of evidence. Nevertheless, gaps in comprehension arise, as well as an inability to address biases and demonstrate efforts in reflective practices (see Table 5).

4. Discussion

4.1. How Do Student Teachers Approach Case Studies on “Teaching Approaches of the Environmental Study”?

A content analysis was carried out to answer the first research question of the current study. The macroscopic content analysis, namely the higher-order categories that emerged, contributes to our understanding of how the student teachers in our study approach case studies. Particularly, they revealed that the current pre-service teachers’ approach to the case studies aligned with the conceptualization of CT according to scholars like Dewey, Brookfield, and Garrison. According to [21,22], CT is an ongoing thinking process with specific steps, including the triggering event or problem identification, the appraisal of the situation or problem definition, the exploratory phase, the development of alternatives or applicability, and the integration of alternatives into ways of thinking or acting. In our study, similar steps of the thinking process were revealed. For instance, the pre-service teachers in our study sample engaged in organizing information on the problem, which can be realized as the problem identification phase according to Garrison. Then, they clarified and justified concepts and ideas, which we can argue are in line with the problem definition phase. Then, an exploratory phase followed in which the students in our study participated in the information inquiry. Further, student teachers in our study suggested initial ideas for solving the case study, which can be perceived as the phase of developing alternatives. Moreover, the integration of alternatives into ways of thinking or acting in our case was realized through the suggestion of final solutions for the case study. Prior studies have provided similar results. For instance, [72], by employing, among others, Garrison’s framework of five stages of CT, offered a set of indicators for measuring CT in face-to-face learning and computer conference seminars. Additionally, [73] indicated that medical students’ answers in a problem-based learning discourse could be coded following the CT framework of Garrison.
Another line of relevance of the current findings lies in the fact that the microscopic content analysis, namely the emerged subcategories, revealed that some students in our study did not engage effectively in the phases of the CT cycle, as suggested by Garrison or Brookfield. To illustrate, subcategories such as “Avoiding clarifying concepts and ideas”, “Lack of categorization of information”, “Inadequate categorization of information”, “Unjustified solution for the case study”, “Solution repeating case studies’ ideas” indicate that some students were deficient or emerging critical thinkers. In his study, [72] indicated that some students did not engage in CT. Those students were perceived as “uncritical thinkers”. Similarly, [74] argued in their literature review that not all students may be good at CT, suggesting eight learner types who present deficits in CT: (1) those acting without thinking (impulsive thinking); (2) need help at each step (overdependent); (3) use goal-incompatible strategies (do not perceive cause–effect relationships); (4) have difficulty with comprehension (miss meaning); (5) are convinced of the “rightness” of their beliefs (dogmatism); (6) operate within narrow rule sets (rigidity/inflexibility); (7) are fearful (not confident); and (8) condemn good thinking as a waste of time (anti-intellectual). The previous research could support our findings suggesting that not all student teachers engaged in the cyclical model of CT when approaching case studies.
In the previous conceptualizations of CT, there is no explicit reference to reflection as a step in the thinking cycle; nonetheless, our analysis revealed one respective category. Still, regarding our study’s student teachers’, answers categorized under this category indicated that they only monitored and failed to examine their thinking process, resulting in a change in their conceptual perspectives. There were only a few cases where the students in the current study monitored their thinking and changed their perspectives, providing examples to justify this change. Hence, we cannot argue with confidence that the students participated in our study engaged in reflection as well as that, in our study, reflection was an additional and explicit phase of the iterative thinking cycle of CT. Nevertheless, monitoring and changing conceptual perspectives or beliefs could impact prospective teachers’ problem-solving skills. Still, teaching for (critical) reflection would require the exploitation of explicit strategies that support reflection and render student teachers aware and conscious of their thinking processes, perspectives, or beliefs [75].
So far, we provided insights into how student teachers approach case studies and engage in CT as far as the current sample is concerned. Later, we will attempt to present a deeper interpretation of the content analysis results by highlighting potential challenges that hindered our student teachers’ CT while approaching case studies. Moreover, the practical implications of these findings on teaching practices or curriculum development will be discussed.
One unexpected finding of the content analysis was that almost one-third of the responses revealed a lack of students’ engagement with the case studies’ questions. This finding could be attributed to multiple factors. First, the case studies or the concept of CT, per se, were perceived by the pre-service teachers as more complex than expected, which could lead to students’ disengagement with the task. According to [76], if students experience too much or persistent confusion when engaging with learning tasks or concepts, they are more likely to feel frustration, hopelessness, and boredom and give up the task. Second, there is a likelihood that if the material provided to the students was perceived as challenging and time-consuming, then it might also be perceived as less appealing [77]. Third, there is a possibility that pre-service students in our study considered the case studies or the content as over- or under-challenging and lacked perceived value of the tasks and content for their professional development, experiencing, as a result, academic boredom [78]. Finally, there is a chance that students experience intellectual laziness, namely a tendency to give up quickly when faced with an intellectually challenging task [79]. Learners experiencing intellectual laziness can be reluctant to put in any effort, refrain from challenging tasks, and prefer easy or passive activities. Thus, constant disengagement from academic tasks could hinder student teachers’ intellectual growth and CT. Nonetheless, further research would be required to examine the real reasons behind prospective teachers’ disengagement in the current study.
Our findings suggest that student teachers in the current sample faced a significant challenge that hindered their CT, primarily due to their naive epistemological beliefs. Specifically, our analysis of the “Justification of ideas” category revealed that the student teachers in our sample tended to base their ideas on external sources or authorities (such as instructors), the specific case study they were working on, or their personal beliefs and intuitions. Relying on external sources, personal beliefs, or intuitions for idea validation indicates a perception of knowledge as fixed and unquestionable [80]. Such a mindset often leads to passive learning and a failure to recognize that knowledge should be derived from empirical evidence and logical reasoning [81]. Previous research has shown that these naive epistemological beliefs can predict lower performance in evaluative thinking, closed-mindedness, and overall cognitive ability, all of which can hinder CT [82].
Our content analysis also revealed that the prospective teachers in our study were unlikely to seek out additional information or consider alternative viewpoints or evidence to support their ideas. This tendency can be attributed to their perception of information and knowledge as absolute and unchanging, which aligns with their naive epistemological beliefs. Previous studies have shown that when students approach problem-solving without engaging in critical analysis, interpretation, or evaluation, their epistemological beliefs tend to be characterized by an uncritical acceptance of authoritative sources and a lack of critical evaluation, which is considered naive [83]. Addressing these naive epistemological beliefs among student teachers should be a top priority in teacher education. Higher education instructors can incorporate activities into their teaching methods that encourage students to question the sources of knowledge, test their beliefs in real-world situations, engage in peer discussions, and utilize resources such as augmented activation and refutational texts to promote CT [84,85].
The current results highlight an additional challenge related to the subskill of comprehension among student teachers engaged in the present study, particularly in terms of their ability to clarify concepts and ideas and categorize information. Our findings indicated that, on one hand, some students were able to clarify concepts and ideas by drawing upon the case study or their prior knowledge. Clarification involves breaking down complex concepts into simpler, more digestible components. However, this process also necessitates the learner to construct a mental representation of the concept and identify potential connections with their existing knowledge. This approach can facilitate a deeper understanding of the concept. Therefore, the fact that student teachers in our study used the case study or their previous knowledge to clarify the case study’s concepts can be seen as an initial step in the clarification process. Nonetheless, it revealed their limited awareness of strategies that can enhance clarification and comprehension, such as re-representation, questioning and explanation, concept mapping, and spatial representation of thought [49]. On the other hand, some student teachers in our study avoided clarification altogether. Instead, they focused directly on proposing solutions for the case study or emphasized the case study’s significance for their professional development. This observation may suggest that when learners are not aware of the importance of clarification or lack appropriate strategies, they might lose sight of the task’s objective or engage in a superficial thinking process. Teacher education programs could benefit from offering explicit instruction on argument structure and providing clear guidance on how to justify ideas and solutions, which could help students enhance their argumentation skills.
Further, our results revealed that the majority of student teachers included in the sample of the present study partially or to no extent engaged in the categorization of information. The inadequate categorization can hinder student teachers’ ability to identify the core components and nature of a problem, leading them to misdiagnosis or overlooking critical aspects of the issue impeding adequate comprehension. Moreover, research in cognitive psychology suggests that when individuals are confronted with unorganized information, it can lead to increased cognitive load, making it harder to process and understand a problem [86]. This cognitive load can impede effective problem comprehension. Hence, it seems crucial to support student teachers while working on complex learning tasks (i.e., problem-solving). This support may involve coaching through the provision of hints, prompts, and feedback; modelling the utilization of cognitive strategies by thinking aloud; offering cue cards, checklists, and process worksheets; posing guiding questions; and providing partial solutions [87].
Finally, another finding that stands out from the current results revealed that most prospective teachers encounter challenges in providing justified ideas or solutions for the case studies. This finding outlines a gap in the argumentation skills of student teachers of the present study. Future teachers expressed an opinion, belief, or claim but do not recognize the importance of providing additional evidence to support them. Previous research has identified learners’ difficulty distinguishing between their beliefs and evidence [88]. Justification refers to providing reasons, evidence, or support for a conclusion or hypothesis. Justification is necessary because CT often deals with complex or ill-defined problems where conclusions cannot be easily tested, so it is essential to demonstrate the plausibility of one’s position through well-reasoned arguments and supporting evidence [89]. Still, the inability of the student teachers engaged in the current study to offer justified ideas or solutions indicates that they require additional support and instruction in developing their justification skills [90].

4.2. What Is the CT Quality of Student Teachers’ Responses when Approaching Case Studies on “Teaching Approaches of the Environmental Study”?

In order to answer the second research question of the current study, we engaged in a rubric assessment of student-teacher quality of CT responses. From the assessment, three profiles emerged: the “Deficient Critical Thinkers”, the “Emerging Critical Thinkers,” and the “Competent Critical Thinkers”. Our assessment revealed that “Deficient Critical Thinkers” lack or display limited ability to categorize information, clarify problem information, analyze argumentation, justify ideas or solutions, identify gaps or deficiencies in reasoning, exhibit self-awareness, or reflect on their thinking process. “Emerging Critical Thinkers” were deficient in some CT skills, such as categorization and interpretation of information as well as reflection, but displayed some competency in other CT skills, including argument analysis, evidence-based justification and evaluation, and justification. Only a few “Competent Critical Thinkers” were identified among the study participants, whose profile indicated that they categorized information accurately, decoded problem data effectively, offered reasonable interpretations, demonstrated adequate analysis of ideas or arguments, and employed evidence-based and well-structured reasoning. Moreover, those student teachers characterized as “Competent Critical Thinkers” occasionally examined and exploited the thinking processes, resulting in a conceptual perspective change.
Initially, we had expected another profile to emerge, namely the “Proficient Critical Thinkers”. Still, this expectation was not met. Nevertheless, this finding is not surprising. In particular, the results of the first research question revealed that student teachers faced numerous challenges with the CT. Thus, the predominance of the “Deficient Critical Thinkers” profile and the absence of the “Proficient Critical Thinkers” profile are justified. Although previous studies have indicated that explicit instruction of CT [91,92,93] and case-based teaching can prove beneficial for CT [68,94], more guided and structured activities could have been required to scaffold participants towards achieving a better quality of CT. Moreover, the results from previous meta-analysis indicate that CT can be achieved with a medium or more extended length intervention, implying that a more targeted holistic educational approach could be required [95]. Finally, the complexity of the case studies could have been an inhibiting factor for transferring the acquired CT from one case study to the next.
Further, the current study identified three profiles. These profiles showcase that learners can enhance their CT, a finding that aligns with previous research [96]. Specifically, Paul and Elder suggest that the development of a CT thinker requires an individual’s commitment and conscious effort in moving from one stage to the next (Stage 1 = The Unreflective Thinker, 6 = The Master Thinker). We argue that apart from learners’ commitment and conscious effort, carefully designed and well-articulated interventions should be implemented to meet the learning needs of each CT profile.

4.3. Limitations and Future Research

This study involved a small sample of students, of primarily one gender and in one discipline. Thus, the current findings should be considered in caution and with respect to the context of the specific participants. Future studies should examine how a larger number of gender-balanced participants across various disciplines approach case studies and how their CT quality is affected. In addition, in the current study, CT dispositions were not considered. Our current results regarding student teachers’ disengagement during case-based teaching might indicate that disengagement is a dispositional affecting their CT. In addition, previous studies have indicated that CT dispositions mediate students’ problem-solving skills [97]. Therefore, we argue that future research should consider student teachers’ CT dispositions and their role in approaching case studies. Moreover, a longitudinal study, extending in a longer period than an academic semester, could better allow us to track the development of CT skills. In some cases, a timeline of up to one or more than one academic semester is proven efficient for CT skills development [95]. Further, studies could examine the impact of more structured teaching interventions on student teachers’ CT. Finally, in future studies, the discipline content could also be assessed through the use of rubrics in order to examine whether it mediates the development of CT.

5. Conclusions

The current study explored how prospective teachers approach case studies focused on the “Teaching approaches of the Environmental Study” and the quality of their CT responses through a rubric-based assessment. The findings from this study could have practical implications for teacher education programs. For instance, it was evident that several factors hindered our pre-service teachers’ engagement with the case studies. Therefore, higher education instructors could address these factors by designing targeted teaching interventions aiming at the sophistication of student teachers’ epistemological beliefs, as well as the improvement of comprehension and argumentation skills. Moreover, the rubric assessment underscored the need for more structured CT interventions and suggested that CT development requires ongoing efforts and commitment not only on behalf of the learners but also on behalf of the instructors.

Author Contributions

Conceptualization, P.C. and A.P.; methodology, P.C. and A.P.; formal analysis, P.C. and A.P.; investigation, A.P.; resources, P.C. and A.P.; data curation, P.C.; writing—original draft preparation, P.C.; writing—review and editing, P.C. and A.P.; visualization, P.C.; supervision, P.C.; project administration, P.C.; funding acquisition, P.C. All authors have read and agreed to the published version of the manuscript. All authors agree to be personally accountable for their contributions and for ensuring that questions related to the accuracy or integrity of any part of the work, even ones in which the authors were not personally involved, are appropriately investigated, resolved, and documented in the literature. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the “Critical Thinking for Successful Jobs—Think4Jobs” Project, with grant number 2020-1-EL01-KA203078797, funded by the European Commission/EACEA, through the ERASMUS + Programme. The European Commission support for the production of this publication does not constitute an endorsement of the contents, which reflect the views only of the authors, and the Commission cannot be held responsible for any use, which may be made, of the information contained therein.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki. In addition, the Ethics Committee of the University of Western Macedonia approved the study (Reg. No.: 230-2023/26 May 2023).

Informed Consent Statement

Informed consent was obtained from all participants involved in the study.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Acknowledgments

We would like to acknowledge the contribution of Dimitrios Pnevmatikos for the constructive comments on a previous version of the manuscript. Also, we would like to thank the two reviewers of the Critical Thinking Quality of Response Rubric, namely Angeliki Lithoxoidou and Triantafyllia Georgiadou, for the validation of the rubric and its improvement.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. The Critical Thinking Quality of Response Rubric.
Table A1. The Critical Thinking Quality of Response Rubric.
SkillBelow or Merely Meets ExpectationMeets ExpectationExceeds Expectation
InterpretationFails to categorize information or categorizes some concepts of the problem.Adequately categorizes information or concepts of the problem.Thoroughly categorizes information or concepts of the problem.
Struggles to clarify meaning or decode the significance of data included in the problem.Adequately clarifies meaning and decodes the significance of data included in the problem.Thoroughly clarifies meaning and decodes the significance of data included in the problem.
Misinterprets or misunderstands problem information.Demonstrates adequate interpretation of problem information.Thoroughly interprets the information of a problem.
AnalysisFails to examine ideas thoroughly or in a systematic manner.Adequately analyzes ideas with some depth and structure.Thoroughly examines ideas in a systematic and rigorous manner.
Struggles to identify arguments within a given context. Or does not identify at all.Adequately identifies arguments with reasonable accuracy.Recognizes and articulates arguments thoroughly.
Weakly/never analyzes arguments, providing limited or no supporting evidence.Adequately analyzes arguments with sufficient supporting evidence.Critically analyzes arguments with compelling evidence.
InferenceRarely/Never queries evidence or lacks the ability to identify gaps.Adequately queries evidence and identifies some gaps.Consistently queries evidence and identifies significant gaps.
Offers few (or no) or irrelevant conjectures about possible alternatives.Adequately generates reasonable conjectures about alternatives.Consistently formulates insightful conjectures about meaningful alternatives.
Draws unsubstantiated or weak conclusions. Or draws no conclusions at all.Adequately draws logical and well-supported conclusions.Consistently draws sound and compelling conclusions.
ExplanationStruggles to state results or justify procedures coherently.Adequately states results and justifies procedures with some clarity.Consistently states results and justifies procedures effectively.
Presents weak or incomplete arguments to support claims. Or presents no arguments at all.Presents arguments that support claims adequately.Consistently presents well-structured and persuasive arguments to support claims.
Lacks consistency in presenting logical reasoning.Adequately presents logical reasoning consistently and coherently.Consistently presents compelling and nuanced logical reasoning.
EvaluationRarely/Never assesses the credibility or validity of claims.Adequately assesses claims for credibility and validity to some extent.Assesses claims for credibility and validity all the time in a consistent way.
Assesses arguments in a biased manner (influenced by beliefs, etc.). Or does not assess at all.Adequately assesses arguments avoiding personal biases.Consistently assesses arguments avoiding personal biases.
Provides limited or shallow reasoning in evaluations. Or presents no reasoning at all. Uses intuition.Offers adequately well-reasoned evaluations with some depth.Consistently provides insightful and nuanced evaluations with cogent reasoning.
Self-regulationShows little or no self-examination or awareness of biases.Demonstrates some self-examination and awareness of biases.Exhibits consistent self-examination and unbiased thinking.
Rarely/Never corrects errors or modifies thinking when needed.Occasional self-correction and modification of thinking.Systematically engages in self-correction and adapts thinking effectively.
ReflectionFails to internally examine and explore the thinking process and result in a change in conceptual perspective. Occasionally examines internally and explores the thinking process, resulting in a change in conceptual perspective. Engages systematically in deeper reflection over a thinking process, resulting in beliefs transformation.

Appendix B

Table A2. The categories, subcategories, codes, and indicative units of analysis from the conducted content analysis
Table A2. The categories, subcategories, codes, and indicative units of analysis from the conducted content analysis
CategorySubcategoryCodeIndicative Unit of Analysis
Disengagement from the case studyDisengagement from the case studyDisengagement from the case studyNo response was provided to the case study’s question(s).
Clarifying concepts and ideasClarifying concepts and ideas drawing from the case study or previous knowledgeClarifying concepts and ideas drawing from the case study The student is not relying on a credible source, and no reference is made to human activities.
Clarifying concepts and ideas drawing from previous knowledgeAlso, if the information the student has gathered does not meet the learning objective set, the student must either modify the objective or gather additional information.
Avoiding clarifying concepts and ideasFocusing on the solution of the problemMy opinion about the student’s problem is that the student should listen to the professor’s opinion and suggestion.
Focusing on the importance of the case study for the teaching profession It’s something that can happen in my professional life, and I have to take action.
ReflectionMonitoring of the thinking processNo change in the thinking processI didn’t change my thinking process
Monitoring and changing their thinking processChange in the thinking processI extensively changed the way I think during problem solving.
Justifications of ideasJustification of ideas on external sourcesJustification of ideas on an external source (e.g., instructor, previous knowledge, previous experience)I justify my opinion on the knowledge I have acquired while attending the course “Teaching approaches of the Environmental Study”.
Justification of ideas on the scenarioJustification of ideas on the scenarioI justify my ideas on the information of the case study.
Justification of ideas on intuitions and beliefsJustification of ideas on intuitions and/or beliefsI justify my ideas on my belief that misconceptions should not be perpetuated.
Categorizing informationInadequate categorization of informationIncomplete organization of information and difficulty in detecting and categorizing informationRelevant information:
Getting to know the animals, 10 boys and 10 girls, cognitive and emotional objective, the zoo, the song, the working groups, the worksheets, the products, home (of the animals)
Irrelevant information:
the name of the school, “He will have asked … the animals”, camera.
Organization of relevant and irrelevant information but with no explicit reference to the information, per seIrrelevant information:
that the teaching will take place in the context of an internship,
the name of the school,
the 4th grade class consists of 10 boys and 10 girls.
Relevant information:
All others not mentioned above.
Adequate categorization of informationComplete organization of the problem informationRelevant information:
The cognitive objective of the student
The (teaching) method chosen
The activity of the discussion
The instructor’s suggestions
The student’s reluctance to accept the instructor’s suggestions
Irrelevant information:
The teaching is part of a practical exercise.
The school in which it will take place
The number of pupils in the classroom
The details of what is ‘student-centered teaching’
Lack of categorization of informationNo categorization of information but a personal view of the problem and of a solutionThe problem as presented here is that the guide, in answering the student, reproduced a well-known misconception associated with the Theory of Evolution. He did not phrase the answer correctly. As a professional guide he should have known the (appropriate) answer for a 4th grade elementary school student. I believe all the information given is relevant to the problem.
Initial approach of the case studySuggesting a solution for the case studySuggesting a solution for the case studyThe student should accept the professor’s suggestion because firstly, the professor pointed it out to him and he must have a point. Secondly, as we understand from reading the text, his lesson plan is incomplete.
Repeating information from the case study Repeating information from the case study without adding new ideasIn my opinion, the professor is partially right and partially wrong at the same time. The professor suggests that the student reconsider the choice of the activities included in the lesson plan as the information included in the worksheet will not help the pupils achieve the cognitive learning objective stated in the plan.
Suggesting solutions for the case studySuggesting one or multiple solutions for the case studyProposing an unjustified solutionThe proposed solution is to revise the lesson plan, because this will meet the criteria of effective teaching of this course.
Proposing multiple solutions without indicating the most appropriate oneThe student should think again about the validity of information provided in the study he found. It would be better to organize his lesson plan based on valid information.
Accepting initial ideas as final solutions to the case studyAccepting the first proposed idea as a solution to the problem without any justificationA suggested solution is that upon class return the teacher could encourage a class discussion about the students’ tour impressions. The teacher should then inform the students that a mistaken statement about the weasel was proposed by the tour guide. In that way we stimulate the students’ interest to undertake a project, which will eventually solve the question of the evolution of the weasel and its characteristics. At the end of the process and presentation of the results, the students themselves will correct the tour guide’s misconception regarding the weasel.
Acceptance of the first proposed idea as a solution to the problem along with a justificationI would advise the student to review the terms of the learning objective, the method and the proposed activity. This is because only saying that a student-centered approach will be used in instruction, does not imply that active action and free expression of the students will be ensured. Also, I do not think that socratic dialogue could be used feasibly for third grade students, as it is more advanced than their developmental level.
Lack of a suggested solutionNo solution was suggestedThe combination of respect, attention and tolerance against the words and opinions of the professor, the arguments that support his ideas, and the flexibility of the student-teacher are important elements in order to reach a solution to the problem.
Inquiry of informationIdentifying gaps but avoiding inquiryIdentifying knowledge gaps without searching for information I will look for information on teaching strategies used in the “Environmental Study”. I will seek information about the purpose and objective of the particular content and the verbs that can be used (in the formulation of the objectives).
Lack of inquisitivenessRepeating information of the problem All the necessary information for solving the problem is given in the text.
Engaging in inquiry of informationConducting inquiry by providing the information Here is some necessary information that I need:
https://www.tanea.gr/2008/04/25/greece/toksiko-aera-anapneoyn-6-ellinikes-poleis/ (accessed on 4 October 2023)
Manolis Voutirakis (Environmentalist): “The impact of pollution on human health” at www.ecocrete.gr (accessed on 4 October 2023)

References

  1. UNESCO. Education for Sustainable Development Goals: Learning Objectives; UNESCO: Paris, France, 2017; ISBN 978-92-3-100209-0. [Google Scholar]
  2. Corcoran, P.B.; Wals, A.E.J. Higher Education and the Challenge of Sustainability: Problematics, Promise, and Practice; Kluwer Academic Publishers: Dordrecht, The Netherlands; Boston, MA, USA, 2004; ISBN 978-1-4020-2134-3. [Google Scholar]
  3. Eilam, E.; Trop, T. ESD Pedagogy: A Guide for the Perplexed. J. Environ. Educ. 2010, 42, 43–64. [Google Scholar] [CrossRef]
  4. Iwińska, K.; Jones, M.; KraszewskaI, M. (Eds.) WISE Handbook; Collegium Civitas: Warsaw, Poland, 2017; pp. 28–31. [Google Scholar]
  5. Vasconcelos, C.; Silva, J.; Calheiros, C.S.C.; Mikusiński, G.; Iwińska, K.; Skaltsa, I.G.; Krakowska, K. Teaching Sustainable Development Goals to University Students: A Cross-Country Case-Based Study. Sustainability 2022, 14, 1593. [Google Scholar] [CrossRef]
  6. Abrami, P.C.; Bernard, R.M.; Borokhovski, E.; Waddington, D.I.; Wade, C.A.; Persson, T. Strategies for Teaching Students to Think Critically: A Meta-Analysis. Rev. Educ. Res. 2015, 85, 275–314. [Google Scholar] [CrossRef]
  7. Loyens, S.M.M.; Van Meerten, J.E.; Schaap, L.; Wijnia, L. Situating Higher-Order, Critical, and Critical-Analytic Thinking in Problem- and Project-Based Learning Environments: A Systematic Review. Educ. Psychol. Rev. 2023, 35, 39. [Google Scholar] [CrossRef]
  8. Straková, Z.; Cimermanová, I. Critical Thinking Development—A Necessary Step in Higher Education Transformation towards Sustainability. Sustainability 2018, 10, 3366. [Google Scholar] [CrossRef]
  9. United Nations Sustainable Development. Promoting Education, Public Awareness and Training. In United Nations Conference on Environment & Development (UNCED), Rio de Janerio, Brazil, 3–14 June 1992; Agenda 21; United Nations Sustainable Development: New York, NY, USA, 1992; Chapter 36. [Google Scholar]
  10. Scoullos, M.J. (Ed.) Environment and Society: Education and Public Awareness for Sustainability. In Proceedings of the Thessaloniki International Conference, Thessaloniki, Greece, 8–12 December 1997; UNESCO: Paris, France, 1997. [Google Scholar]
  11. Buckler, C.; Creech, H. Shaping the Future We Want: UN Decade of Education for Sustainable Development (2005–2014): Final Report; UNESCO: Paris, France, 2014; ISBN 978-92-3-100053-9. [Google Scholar]
  12. UNESCO Education Strategy 2014–2021; UNESCO: Paris, France, 2014; 63p.
  13. United Nations (UN). Transforming Our World: The 2030 Agenda for Sustainable Development; United Nations: New York, NY, USA, 2015. [Google Scholar]
  14. Evans, N.; Stevenson, R.B.; Lasen, M.; Ferreira, J.-A.; Davis, J. Approaches to Embedding Sustainability in Teacher Education: A Synthesis of the Literature. Teach. Teach. Educ. 2017, 63, 405–417. [Google Scholar] [CrossRef]
  15. Bertschy, F.; Künzli, C.; Lehmann, M. Teachers’ Competencies for the Implementation of Educational Offers in the Field of Education for Sustainable Development. Sustainability 2013, 5, 5067–5080. [Google Scholar] [CrossRef]
  16. The Government of the Hellenic Republic. Greek Government Gazette: Part 2, 2003, No. 303; Greek National Printing House: Athens, Greece, 2003. (In Greek) [Google Scholar]
  17. Ennis, R.H. A Concept of Critical Thinking. Harv. Educ. Rev. 1962, 32, 81–111. [Google Scholar]
  18. Facione, P.A. Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction—Research Findings and Recommendations; American Philosophical Association: Newark, DE, USA, 1990; 112p. [Google Scholar]
  19. Paul, R.; Elder, L. The Miniature Guide to Critical Thinking Concepts and Tools; Rowman & Littlefield: Lanham, MD, USA, 2019; ISBN 978-1-5381-3495-5. [Google Scholar]
  20. Dewey, J. How We Think; D.C. Heath & Co.: Boston, MA, USA, 1983. [Google Scholar]
  21. Brookfield, S.D. Developing Critical Thinkers: Challenging Adults to Explore Alternative Ways of Thinking and Acting; Jossey-Bass: San Francisco, CA, USA, 1987; pp. xvi, 293. ISBN 978-1-55542-055-0. [Google Scholar]
  22. Garrison, D.R. Critical Thinking and Adult Education: A Conceptual Model for Developing Critical Thinking in Adult Learners. Int. J. Lifelong Educ. 1991, 10, 287–303. [Google Scholar] [CrossRef]
  23. Rieckmann, M. Learning to Transform the World: Key Competencies in Education for Sustainable Development. In Issues and Trends in Education for Sustainable Development; UNESCO: Paris, France, 2018; pp. 39–59. ISBN 978-92-3-100244-1. [Google Scholar]
  24. Orhan, A. Critical Thinking Dispositions as a Predictor for High School Students’ Environmental Attitudes. J. Educ. Sci. Environ. Health 2022, 8, 75–85. [Google Scholar] [CrossRef]
  25. Stevenson, R.B. Schooling and Environmental/Sustainability Education: From Discourses of Policy and Practice to Discourses of Professional Learning. Environ. Educ. Res. 2007, 13, 265–285. [Google Scholar] [CrossRef]
  26. Tilbury, D.; Wortman, D. Engaging People in Sustainability; IUCN: Gland, Switzerland, 2004; ISBN 978-2-8317-0823-2. [Google Scholar]
  27. Munkebye, E.; Gericke, N. Primary School Teachers’ Understanding of Critical Thinking in the Context of Education for Sustainable Development. In Critical Thinking in Biology and Environmental Education: Facing Challenges in a Post-Truth World; Puig, B., Jiménez-Aleixandre, M.P., Eds.; Contributions from Biology Education Research Series; Springer International Publishing: Cham, Switzerland, 2022; pp. 249–266. ISBN 978-3-030-92006-7. [Google Scholar]
  28. Day, B.A.; Monroe, M.C. Environmental Education & Communication for a Sustainable World: Handbook for International Practitioners; Academy for Educational Development: Washington, DC, USA, 2000. [Google Scholar]
  29. Pegalajar-Palomino, M.D.C.; Burgos-García, A.; Martinez-Valdivia, E. What Does Education for Sustainable Development Offer in Initial Teacher Training? A Systematic Review. J. Teach. Educ. Sustain. 2021, 23, 99–114. [Google Scholar] [CrossRef]
  30. Howlett, C.; Ferreira, J.-A.; Blomfield, J. Teaching Sustainable Development in Higher Education Building Critical, Reflective Thinkers through an Interdisciplinary Approach. Int. J. Sustain. High. Educ. 2016, 17, 305–321. [Google Scholar] [CrossRef]
  31. Scherak, L.; Rieckmann, M. Developing ESD Competences in Higher Education Institutions—Staff Training at the University of Vechta. Sustainability 2020, 12, 10336. [Google Scholar] [CrossRef]
  32. Valderrama-Hernández, R.; Sánchez-Carracedo, F.; Alcántara Rubio, L.; Limón-Domínguez, D. Methodology to Analyze the Effectiveness of ESD in a Higher Degree in Education. A Case Study. Sustainability 2019, 12, 222. [Google Scholar] [CrossRef]
  33. Wells, M. Elements of Effective and Sustainable Professional Learning. Prof. Dev. Educ. 2014, 40, 488–504. [Google Scholar] [CrossRef]
  34. Alexander, L.; Julia, H.; Byun, W.J. Issues and Trends in Education for Sustainable Development; UNESCO: Paris, France, 2018; ISBN 978-92-3-100244-1. [Google Scholar]
  35. Willingham, D.T. Critical Thinking: Why Is It So Hard to Teach? Arts Educ. Policy Rev. 2008, 109, 21–32. [Google Scholar] [CrossRef]
  36. Paaske, D.M.; Segura-Bonilla, O.; Hernandez-Milian, J. ESD for Managers in the Danish Lower Secondary Educational Curriculum. JWAM 2021, 13, 154–166. [Google Scholar] [CrossRef]
  37. Barnett, R. Higher Education: A Critical Business; McGraw-Hill Education: London, UK, 1997; ISBN 978-0-335-23065-5. [Google Scholar]
  38. Davies, M. A Model of Critical Thinking in Higher Education. In Higher Education: Handbook of Theory and Research: Volume 30; Paulsen, M.B., Ed.; Springer International Publishing: Cham, Switzerland, 2015; pp. 41–92. ISBN 978-3-319-12835-1. [Google Scholar]
  39. Paul, R. Critical Thinking, Moral Integrity, and Citizenship: Teaching for the Intellectual Virtues. In The Social Worlds of Higher Education: Handbook for Teaching in A New Century; Pine Forge Press: Thousand Oaks, CA, USA, 1999; ISBN 978-0-7619-8613-3. [Google Scholar]
  40. Harrington, H.L.; Garrison, J.W. Cases as Shared Inquiry: A Dialogical Model of Teacher Preparation. Am. Educ. Res. J. 1992, 29, 715–735. [Google Scholar] [CrossRef]
  41. Harrington, H.L. Fostering Reasoned Decisions: Case-Based Pedagogy and the Professional Development of Teachers. Teach. Teach. Educ. 1995, 11, 203–214. [Google Scholar] [CrossRef]
  42. Shulman, L. Knowledge and Teaching: Foundations of the New Reform. Harv. Educ. Rev. 1987, 57, 1–23. [Google Scholar] [CrossRef]
  43. Sykes, G.; Bird, T. Teacher Education and the Case Idea. Rev. Res. Educ. 1992, 18, 457–521. [Google Scholar] [CrossRef]
  44. Helleve, I.; Eide, L.; Ulvik, M. Case-Based Teacher Education Preparing for Diagnostic Judgement. Eur. J. Teach. Educ. 2023, 46, 50–66. [Google Scholar] [CrossRef]
  45. Gravett, S.; De Beer, J.; Odendaal-Kroon, R.; Merseth, K.K. The Affordances of Case-Based Teaching for the Professional Learning of Student-Teachers. J. Curric. Stud. 2017, 49, 369–390. [Google Scholar] [CrossRef]
  46. Giangrande, N.; White, R.M.; East, M.; Jackson, R.; Clarke, T.; Saloff Coste, M.; Penha-Lopes, G. A Competency Framework to Assess and Activate Education for Sustainable Development: Addressing the UN Sustainable Development Goals 4.7 Challenge. Sustainability 2019, 11, 2832. [Google Scholar] [CrossRef]
  47. McWhirter, N.; Shealy, T. Case-Based Flipped Classroom Approach to Teach Sustainable Infrastructure and Decision-Making. Int. J. Constr. Educ. Res. 2020, 16, 3–23. [Google Scholar] [CrossRef]
  48. McDade, S.A. Case Study Pedagogy to Advance Critical Thinking. Teach. Psychol. 1995, 22, 9–10. [Google Scholar] [CrossRef]
  49. Halpern, D.F. Thought and Knowledge: An Introduction to Critical Thinking; Psychology Press: New York, NY, USA, 2013; ISBN 978-1-134-63793-5. [Google Scholar]
  50. Rear, D. One Size Fits All? The Limitations of Standardised Assessment in Critical Thinking. Assess. Eval. High. Educ. 2019, 44, 664–675. [Google Scholar] [CrossRef]
  51. Liu, O.L.; Frankel, L.; Roohr, K.C. Assessing Critical Thinking in Higher Education: Current State and Directions for Next-Generation Assessment. ETS Res. Rep. Ser. 2014, 2014, 1–23. [Google Scholar] [CrossRef]
  52. Verburgh, A.; François, S.; Elen, J.; Janssen, R. The Assessment of Critical Thinking Critically Assessed in Higher Education: A Validation Study of the CCTT and the HCTA. Educ. Res. Int. 2013, 2013, e198920. [Google Scholar] [CrossRef]
  53. Vincent-Lancrin, S. Fostering and Assessing Student Critical Thinking: From Theory to Teaching Practice. Eur. J. Educ. 2023, 58, 354–368. [Google Scholar] [CrossRef]
  54. Shavelson, R.J.; Zlatkin-Troitschanskaia, O.; Beck, K.; Schmidt, S.; Marino, J.P. Assessment of University Students’ Critical Thinking: Next Generation Performance Assessment. Int. J. Test. 2019, 19, 337–362. [Google Scholar] [CrossRef]
  55. Brookhart, S.M.; Chen, F. The Quality and Effectiveness of Descriptive Rubrics. Educ. Rev. 2015, 67, 343–368. [Google Scholar] [CrossRef]
  56. Pui, P.; Yuen, B.; Goh, H. Using a Criterion-Referenced Rubric to Enhance Student Learning: A Case Study in a Critical Thinking and Writing Module. High. Educ. Res. Dev. 2021, 40, 1056–1069. [Google Scholar] [CrossRef]
  57. Jonsson, A.; Svingby, G. The Use of Scoring Rubrics: Reliability, Validity and Educational Consequences. Educ. Res. Rev. 2007, 2, 130–144. [Google Scholar] [CrossRef]
  58. Smit, R.; Birri, T. Assuring the Quality of Standards-Oriented Classroom Assessment with Rubrics for Complex Competencies. Stud. Educ. Eval. 2014, 43, 5–13. [Google Scholar] [CrossRef]
  59. Reynders, G.; Lantz, J.; Ruder, S.M.; Stanford, C.L.; Cole, R.S. Rubrics to Assess Critical Thinking and Information Processing in Undergraduate STEM Courses. Int. J. STEM Educ. 2020, 7, 9. [Google Scholar] [CrossRef]
  60. Facione, P.A. Using the Holistic Critical Thinking. In Critical Thinking and Clinical Reasoning in the Health Sciences; California Academic Press: Millbrae, CA, USA, 1994. [Google Scholar]
  61. Bissell, A.N.; Lemons, P.P. A New Method for Assessing Critical Thinking in the Classroom. BioScience 2006, 56, 66–72. [Google Scholar] [CrossRef]
  62. Cargas, S.; Williams, S.; Rosenberg, M. An Approach to Teaching Critical Thinking across Disciplines Using Performance Tasks with a Common Rubric. Think. Ski. Creat. 2017, 26, 24–37. [Google Scholar] [CrossRef]
  63. Hohmann, J.W.; Grillo, M.C. Using Critical Thinking Rubrics to Increase Academic Performance. J. Coll. Read. Learn. 2014, 45, 35–51. [Google Scholar] [CrossRef]
  64. Bryman, A. Social Research Methods; Oxford University Press: Oxford, UK, 2016; ISBN 978-0-19-968945-3. [Google Scholar]
  65. Etikan, I. Comparison of Convenience Sampling and Purposive Sampling. Am. J. Theor. Appl. Stat. 2016, 5, 1–4. [Google Scholar] [CrossRef]
  66. Ennis, R.H. A Taxonomy of Critical Thinking Dispositions and Abilities. In Teaching Thinking Skills: Theory and Practice; Series of Books in Psychology; W H Freeman & Co: New York, NY, USA, 1987; pp. 9–26. ISBN 978-0-7167-1789-8. [Google Scholar]
  67. Pnevmatikos, D.; Christodoulou, P.; Georgiadou, T.; Lithoxoidou, A.; Dimitriadou, C.; Payan Carreira, R.; Simões, M.; Ferreira, D.; Rebelo, H.; Sebastião, L.; et al. THINK4JOBS Training: Critical Thinking Training Packages for Higher Education Instructors and Labour Market Tutors; University of Western Macedonia: Kozani, Greece, 2021; ISBN 978-618-5613-02-0. [Google Scholar]
  68. Kaddoura, M.A. Critical Thinking Skills of Nursing Students in Lecture-Based Teaching and Case-Based Learning. Int. J. Scholarsh. Teach. Learn. 2011, 5, 20. [Google Scholar] [CrossRef]
  69. Schön, D. The Reflective Turn: Case Studies in and on Educational Practice; Teachers College Press Columbia University: New York, NY, USA, 1991. [Google Scholar]
  70. Lorencová, H.; Jarošová, E.; Avgitidou, S.; Dimitriadou, C. Critical Thinking Practices in Teacher Education Programmes: A Systematic Review. Stud. High. Educ. 2019, 44, 844–859. [Google Scholar] [CrossRef]
  71. Gill, P.; Stewart, K.; Treasure, E.; Chadwick, B. Methods of Data Collection in Qualitative Research: Interviews and Focus Groups. Br. Dent. J. 2008, 204, 291–295. [Google Scholar] [CrossRef] [PubMed]
  72. Newman, D.R. A Content Analysis Method to Measure Critical Thinking in Face-to-Face and Computer Supported Group Learning. Interpers. Comput. Technol. J. 1995, 3, 56–77. [Google Scholar]
  73. Kamin, C.S.; O’Sullivan, P.S.; Younger, M.; Deterding, R. Measuring Critical Thinking in Problem-Based Learning Discourse. Teach. Learn. Med. 2001, 13, 27–35. [Google Scholar] [CrossRef] [PubMed]
  74. Pithers, R.T.; Soden, R. Critical Thinking in Education: A Review. Educ. Res. 2000, 42, 237–249. [Google Scholar] [CrossRef]
  75. Pnevmatikos, D.; Christodoulou, P.; Lithoxoidou, A.; Georgiadou, T. Designing Critical Thinking Blended Apprenticeships Curricula to Promote Reflective Thinking in Higher Education. In Technology and Innovation in Learning, Teaching and Education, Proceedings of the 3rd International Conference (TECH-EDU 2022), Lisbon, Portugal, 31 August–2 September 2022; Reis, A., Barroso, J., Martins, P., Jimoyiannis, A., Huang, R.Y.-M., Henriques, R., Eds.; Springer: Cham, Switzerland, 2022; pp. 316–328. [Google Scholar]
  76. Lodge, J.M.; Kennedy, G.; Lockyer, L.; Arguel, A.; Pachman, M. Understanding Difficulties and Resulting Confusion in Learning: An Integrative Review. Front. Educ. 2018, 3, 49. [Google Scholar] [CrossRef]
  77. Arum, R.; Roksa, J. Limited Learning on College Campuses. Society 2011, 48, 203–207. [Google Scholar] [CrossRef]
  78. Pekrun, R.; Goetz, T.; Daniels, L.M.; Stupnisky, R.H.; Perry, R.P. Boredom in Achievement Settings: Exploring Control–Value Antecedents and Performance Outcomes of a Neglected Emotion. J. Educ. Psychol. 2010, 102, 531–549. [Google Scholar] [CrossRef]
  79. Elder, L.; Paul, R. Critical Thinking: Tools for Taking Charge of Your Learning and Your Life; Rowman & Littlefield: Lanham, MD, USA, 2020; ISBN 978-1-5381-3949-3. [Google Scholar]
  80. Kuhn, D. A Developmental Model of Critical Thinking. Educ. Res. 1999, 28, 16–46. [Google Scholar] [CrossRef]
  81. Cheng, M.M.H.; Chan, K.-W.; Tang, S.Y.F.; Cheng, A.Y.N. Pre-Service Teacher Education Students’ Epistemological Beliefs and Their Conceptions of Teaching. Teach. Teach. Educ. 2009, 25, 319–327. [Google Scholar] [CrossRef]
  82. Chan, N.-M.; Ho, I.T.; Ku, K.Y.L. Epistemic Beliefs and Critical Thinking of Chinese Students. Learn. Individ. Differ. 2011, 21, 67–77. [Google Scholar] [CrossRef]
  83. Hyytinen, H.; Holma, K.; Toom, A.; Shavelson, R.J.; Lindblom-Ylänne, S. The Complex Relationship between Students’ Critical Thinking and Epistemological Beliefs in the Context of Problem Solving. Frontline Learn. Res. 2014, 2, 1–25. [Google Scholar]
  84. Gill, M.G.; Ashton, P.T.; Algina, J. Changing Preservice Teachers’ Epistemological Beliefs about Teaching and Learning in Mathematics: An Intervention Study. Contemp. Educ. Psychol. 2004, 29, 164–185. [Google Scholar] [CrossRef]
  85. Valcke, M.; Sang, G.; Rots, I.; Hermans, R. Taking Prospective Teachers’ Beliefs into Account in Teacher Education. In International Encyclopedia of Education; Elsevier: Amsterdam, The Netherlands, 2010; pp. 622–628. ISBN 978-0-08-044894-7. [Google Scholar]
  86. Sweller, J. Cognitive Load during Problem Solving: Effects on Learning. Cogn. Sci. 1988, 12, 257–285. [Google Scholar] [CrossRef]
  87. van Merrienboer, J.J.G.; Kirschner, P.A.; Kester, L. Taking the Load Off a Learner’s Mind: Instructional Design for Complex Learning. Educ. Psychol. 2003, 38, 5–13. [Google Scholar] [CrossRef]
  88. Kuhn, D. Science as Argument: Implications for Teaching and Learning Scientific Thinking. Sci. Ed. 1993, 77, 319–337. [Google Scholar] [CrossRef]
  89. Kurfiss, J.G. Critical Thinking: Theory, Research, Practice, and Possibilities; ASHE-ERIC Higher Education Report No. 2; Association for the Study of Higher Education: Washington, DC, USA, 1988. [Google Scholar]
  90. Acar, O.; Patton, B.R.; White, A.L. Prospective Secondary Science Teachers’ Argumentation Skills and the Interaction of These Skills with Their Conceptual Knowledge. Aust. J. Teach. Educ. 2020, 40, 132–156. [Google Scholar] [CrossRef]
  91. Abrami, P.C.; Bernard, R.M.; Borokhovski, E.; Wade, A.; Surkes, M.A.; Tamim, R.; Zhang, D. Instructional Interventions Affecting Critical Thinking Skills and Dispositions: A Stage 1 Meta-Analysis. Rev. Educ. Res. 2008, 78, 1102–1134. [Google Scholar] [CrossRef]
  92. El Soufi, N.; See, B.H. Does Explicit Teaching of Critical Thinking Improve Critical Thinking Skills of English Language Learners in Higher Education? A Critical Review of Causal Evidence. Stud. Educ. Eval. 2019, 60, 140–162. [Google Scholar] [CrossRef]
  93. Alan Bensley, D.; Spero, R.A. Improving Critical Thinking Skills and Metacognitive Monitoring through Direct Infusion. Think. Ski. Creat. 2014, 12, 55–68. [Google Scholar] [CrossRef]
  94. Li, S.; Ye, X.; Chen, W. Practice and Effectiveness of “Nursing Case-Based Learning” Course on Nursing Student’s Critical Thinking Ability: A Comparative Study. Nurse Educ. Pract. 2019, 36, 91–96. [Google Scholar] [CrossRef]
  95. Liu, Y.; Pásztor, A. Effects of Problem-Based Learning Instructional Intervention on Critical Thinking in Higher Education: A Meta-Analysis. Think. Ski. Creat. 2022, 45, 101069. [Google Scholar] [CrossRef]
  96. Paul, R.; Elder, L. Critical Thinking Development: A Stage Theory With Implications for Instruction; The Foundation for Critical Thinking: Santa Barbara, CA, USA, 1996. [Google Scholar]
  97. Tasgin, A.; Dilek, C. The Mediating Role of Critical Thinking Dispositions between Secondary School Student’s Self-Efficacy and Problem-Solving Skills. Think. Ski. Creat. 2023, 50, 101400. [Google Scholar] [CrossRef]
Figure 1. The course structure and data collection process.
Figure 1. The course structure and data collection process.
Education 13 01187 g001
Figure 2. The categories and subcategories emerged from the data analysis of the answers provided to the case studies.
Figure 2. The categories and subcategories emerged from the data analysis of the answers provided to the case studies.
Education 13 01187 g002
Table 1. The questions included at each case study.
Table 1. The questions included at each case study.
No.Case Study Questions
1Read and comprehend the problem. Then, draw a table that organizes the information provided by the case you have read. Identify which of the information presented in the scenario is not relevant or does not affect the problem.
2What is my opinion about the problem?
3How do I justify this opinion?
4Write down your intuitive proposed position on the problem question and explain your choice.
5Search and find the information you need to solve the problem.
6Formulate your proposed solution to the problem and explain your answer.
7Did I change my way of thinking about the problem?
Table 2. The answers provided per question in the fourth case study by Student 4, who was assessed as a Deficient Critical Thinker.
Table 2. The answers provided per question in the fourth case study by Student 4, who was assessed as a Deficient Critical Thinker.
Case Study QuestionsAnswers to the Case Study Questions
Read and comprehend the problem. Then, draw a table that organizes the information provided by the case you have read. Identify which of the information presented in the scenario is not relevant or does not affect the problem.Relevant information: teaching “air pollution”, 4th grade, cognitive objective: “to make students aware of human activities that cause air pollution.”, she will share relevant information she found in a 2012 publication from a personal blog (plus all the information she mentions below).
Irrelevant information: number of boys and girls in class, 5th primary school of Florina.
What is my opinion about the problem?I believe that the problem posed by the professor is logical and correct.
How do I justify this opinion?The activity chosen by the student, although it partly serves the goal he has set, is not entirely suitable for children in 4th grade.
Write down your intuitive proposed position on the problem question and explain your choice.My intuitive suggested position on the question is what I stated above, namely that the problem posed by the teacher is reasonable and correct because the activity chosen by the student, while partially serving the goal the student has set, is not entirely appropriate for 4th graders.
Search and find the information you need to solve the problem.No response.
Formulate your proposed solution to the problem and explain your answer.I would create and present to the students a simple, understandable and enjoyable video, enriched with images, containing a variety of sources of air pollution (e.g., transport, households, industries, fossil fuel combustion & waste management). I would then divide them into 3 groups, and each group would be responsible for presenting one of the sources of air pollution they observed in the video and propose a solution.
Did I change my way of thinking about the problem?No I didn’t.
Table 3. The answers provided per question in the fourth case study by Student 7, who was assessed as a Competent Critical Thinker.
Table 3. The answers provided per question in the fourth case study by Student 7, who was assessed as a Competent Critical Thinker.
Case Study QuestionsAnswers to the Case Study Questions
Read and comprehend the problem. Then, draw a table that organizes the information provided by the case you have read. Identify which of the information presented in the scenario is not relevant or does not affect the problem.No response.
What is my opinion about the problem?I believe that the student should follow the professor’s suggestion, because on the one hand he has more experience than him and on the other hand I also believe that the cognitive objective he has set will not be achieved with this activity because the existence of factories is not the only cause of air pollution but there are other factors that pollute the atmosphere such as means of transport, chimneys of fireplaces etc.
How do I justify this opinion?I support my opinion on my beliefs, my personal experiences and my previous knowledge.
Write down your intuitive proposed position on the problem question and explain your choice.The problem is challenging to solve. The student needs to be convinced with an appropriate argumentation that in order to have a better result in his teaching, he should modify the activity he has thought of and obey the professor’s suggestion as he has more experience than the student and on the other hand I also think that the cognitive objective he has set is not going to be achieved with this activity because the existence of factories is not the only cause of air pollution but other factors pollute the atmosphere such as the increasing amount of pollution in the atmosphere. Therefore, if he continues to support his viewpoint categorically, unfortunately, his teaching will not provide students with a comprehensive presentation of the subject of ‘air pollution’ but only a part of it. Personally, I believe that the student will consider both views equally and will come to the decision that is more correct for him, which is to change the activity.
Search and find the information you need to solve the problem.I would search for information to answer the following questions: Are only the specific areas of Greece (Ptolemaida—Kozani, Megalopolis, Lesvos) with high levels of air pollution?
Is air pollution caused solely by industries/factories? Or are there other contributing causes?
Formulate your proposed solution to the problem and explain your answer.This blog in fact, should not be the student’s only source for his/her teaching topic, because it is not an authoritative source to obtain information on his/her topic. Well, in order to express a more in-depth opinion, it would be advisable for him to read some books, articles, journals, encyclopedias, etc. related to his topic of “Atmospheric Pollution” and then try to reformulate his activity. Having a very good knowledge of the subject, the student will feel confident and able to modify his activity to achieve his cognitive objective and also be ready to answer and support any argument against the students’ questions.
Did I change my way of thinking about the problem?Yes, I changed my way of thinking about the problem.
Table 4. The quality of students’ responses regarding CT across the four case studies.
Table 4. The quality of students’ responses regarding CT across the four case studies.
StudentsCase Study 1Case Study 2Case Study 3Case Study 4
Student 1Level 1Level 1Level 1Level 2 *
Student 2Level 1Level 1Level 2 *Level 1
Student 3Level 2 *Level 1Level 2 *Level 1
Student 4Level 1Level 1Level 1Level 1
Student 5Level 1Level 1 Level 1Level 1
Student 6Level 1Level 1Level 2Level 2
Student 7Level 1Level 1Level 2Level 1
Student 8Level 1Level 1Level 1Level 1
Student 9Level 1Level 1Level 1 -
* Marginal classification in Level 2 with a total score between 19 and 22.
Table 5. The answers provided per question in the fourth case study by Student 3, who was assessed as an Emerging Critical Thinker.
Table 5. The answers provided per question in the fourth case study by Student 3, who was assessed as an Emerging Critical Thinker.
Case Study QuestionsAnswers to the Case Study Questions
Read and comprehend the problem. Then, draw a table that organizes the information provided by the case you have read. Identify which of the information presented in the scenario is not relevant or does not affect the problem.Relevant information: The instruction topic “Air pollution”, 4th grade in a Primary School in Florina, the cognitive objective set: “To make students aware of human activities that cause air pollution”, The activity that relates to this objective is the student teacher to share with all students’ information found in a 2012 publication from a personal blog. This information states that “the area of Ptolemaida, Kozani has high air pollution values due to the power plants and high apnea, that the area around the power plant in the area of Megalopolis in the prefecture of Arcadia also has a significant problem, and then lists several areas in Greece that have air pollution problems due to industrial plants (e.g., Lesvos: lime kilns and kernel oil mills at the entrance to the city, Syros and Neoreio (Cyclades): a power station, etc.).
Irrelevant information: the instruction will take place in the context of practicum, 5th Primary School, 10 boys and 10 girls.
What is my opinion about the problem?It is an issue that may arise during lesson planning. I believe that reflection and, more generally, the observations of the teacher are parameters that must be taken into account in order to implement a “good” instruction.
How do I justify this opinion?I support my opinion on my personal experience in designing lesson plans.
Write down your intuitive proposed position on the problem question and explain your choice.The student should accept the teacher’s suggestions, as the material is not reliable, the proposed activities do not achieve the objective set and, in general, I do not believe that the student will have the learning outcomes aiming for.
Search and find the information you need to solve the problem.I would need the lesson plan of the student to be able to comprehend the information provided by the instructor fully.
Formulate your proposed solution to the problem and explain your answer.My solution to the problem is for the student to accept the professor’s proposed changes.
Did I change my way of thinking about the problem?No, I didn’t change my way of thinking about the problem.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Christodoulou, P.; Papanikolaou, A. Examining Pre-Service Teachers’ Critical Thinking Competences within the Framework of Education for Sustainable Development: A Qualitative Analysis. Educ. Sci. 2023, 13, 1187. https://0-doi-org.brum.beds.ac.uk/10.3390/educsci13121187

AMA Style

Christodoulou P, Papanikolaou A. Examining Pre-Service Teachers’ Critical Thinking Competences within the Framework of Education for Sustainable Development: A Qualitative Analysis. Education Sciences. 2023; 13(12):1187. https://0-doi-org.brum.beds.ac.uk/10.3390/educsci13121187

Chicago/Turabian Style

Christodoulou, Panagiota, and Anastasios Papanikolaou. 2023. "Examining Pre-Service Teachers’ Critical Thinking Competences within the Framework of Education for Sustainable Development: A Qualitative Analysis" Education Sciences 13, no. 12: 1187. https://0-doi-org.brum.beds.ac.uk/10.3390/educsci13121187

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop