Next Article in Journal
What Do You Meme, Professor? An Experiment Using “Memes” in Pharmacy Education
Next Article in Special Issue
Knowledge and Attitudes of Student Pharmacists Regarding Polypharmacy and Deprescribing: A Cross-Sectional Study
Previous Article in Journal
PRN Medicines Optimization and Nurse Education
Previous Article in Special Issue
The Pharmacy Game-GIMMICS® a Simulation Game for Competency-Based Education
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Longitudinal Changes of Deep and Surface Learning in a Constructivist Pharmacy Curriculum

by
Andries S. Koster
1,* and
Jan D. Vermunt
2
1
Department of Pharmaceutical Sciences, Utrecht University, Universiteitsweg 99, 3584 CG Utrecht, The Netherlands
2
School of Education, Eindhoven University of Technology, Groene Loper, 5612 AE Eindhoven, The Netherlands
*
Author to whom correspondence should be addressed.
Submission received: 20 September 2020 / Revised: 20 October 2020 / Accepted: 22 October 2020 / Published: 26 October 2020
(This article belongs to the Special Issue Pharmacy Curriculum Development)

Abstract

:
In the undergraduate Pharmacy program at the department of Pharmaceutical Sciences, Utrecht University, an educational model is used that is aimed at the development of deep and self-regulating learning. It is, however, unknown whether these objectives are realized. The aim of this study was to assess longitudinal changes in processing and regulation strategies of student learning during their progression in the curriculum, that is explicitly based on constructivist principles. Processing strategies (deep vs. stepwise), regulation strategies (self- vs. external), conceptions of learning and orientations to learning were measured with the Inventory of Learning patterns of Students (ILS). Longitudinal data are reported here for students, of which data are available for year 1/2 and year 4/5 (n = 90). The results demonstrate that the use of deep processing (critical thinking in particular, effect size = 0.94), stepwise processing (analyzing in particular, effect size = 0.55) and concrete processing strategies (effect size = 0.78) increases between the bachelor phase (year 1/2) and the master phase (year 4/5). This change is based on the students having a constructivist view about the nature of learning and is mediated through a relatively large increase in the use of self-regulating strategies (effect size = 0.75). We conclude that this six-year undergraduate Pharmacy program effectively stimulates the development of deep and self-regulated learning strategies in pharmacy students.

1. Introduction

Pharmacy education, similar to other health care education programs, ultimately aims for the development of a reflective, self-directed practitioner that is committed to life-long learning, is well embedded in a professional environment, and who can bear independent responsibility for pharmaceutical patient care [1,2]. In order to become a ‘reflective practitioner’, students need to adopt deep, reflective learning approaches [3,4], which requires making a transition from dualistic ways of thinking to contextual relativistic reasoning [5] (reviewed by [6,7,8]).
In higher education, the epistemic cognitive development of students from dualism to contextual relativism typically occurs during the progression of students in undergraduate education [5], with the crucial transition to early contextual relativistic thinking at the advanced bachelor or early master level [9,10,11]. Developmental trajectories for individual students can be very different from each other, resulting in large inter-individual variation [9,10] and recent studies have demonstrated that characteristics of the teaching/learning environment, including the role of teachers, can influence the development of student thinking [12,13,14].
It is often stated that study programs, which are designed on constructivist principles, are effective in stimulating the cognitive development of students from dualism to contextual relativism [3,15] and an early empirical study by Muis and Duffy [12] suggests that this is indeed happening. In recent studies, where conventional, lecture-based, teacher-centered medical curricula were compared with more innovative, problem-based and/or integrated, student-centered curricula, it was demonstrated that deep learning and self-regulation processes are stimulated in the innovative curricula, compared to the conventional curricula [16,17,18]. The crucial idea of a constructivist curriculum is that knowledge is built by the students themselves using a deep, reflective learning process and that the teaching/learning environment accommodates, guides or ‘forces’ students along this pathway [19,20]. An analysis by Alt [21] identified eight essential elements of a social constructivist curriculum (Table 1), which nicely illustrates the importance of deep, reflective learning by the students in a teaching/learning environment where mutual interaction among students and between students and teachers is deemed important (see also [20]). Only a carefully designed teaching/learning environment can accommodate or facilitate deep learning and the cognitive development of students in an optimal way [22].
The cognitive development of pharmacy students has been studied in a limited number of cases. An early longitudinal study in the Finnish context [23] confirmed that a surface approach to learning and external regulation of learning by students correlated with having dualistic epistemic beliefs and with the belief that learning equates to intake of knowledge (summarized as reproduction orientation or surface learning). On the other hand, a deep approach to learning and self-regulation of learning correlated with having a constructivist view of the nature of learning (summarized as meaning orientation or deep learning). During the three years of this program, reproduction orientation decreased (effect size = 0.68), but meaning orientation did not increase in a statistically significant way. Follow-up studies in large-scale, lecture-based, teacher-centered courses of the same program demonstrated that adoption of deep or surface approaches to learning was dependent on students’ self-regulatory skills and their perception of the teaching/learning environment [24,25]. Statistically significant changes in deep and surface approaches were seen at the group level (due to the large sample size), but extensive inter-individual differences (between students) and within-student changes (between beginning and end of the course) were underlying these findings. In cross-sectional and longitudinal studies from an Australian university, only minor changes in deep and surface approaches were found during a 4 year undergraduate bachelor program [26,27].
Since the year 2000, a pharmacy curriculum has been developed at Utrecht University that is explicitly based on constructivist principles [28,29]. The educational model used for this curriculum aimed at facilitating the development of deep and self-regulated learning, but at the start of the new program, it was unknown whether this objective would be reached. It was, therefore, decided to investigate the learning approaches of students in a longitudinal way. More specifically, processing and regulation strategies of students and their underlying conceptions of learning were investigated using the Inventory of Learning patterns in Students (ILS) [30,31,32].

2. Context: The Undergraduate Curriculum

The undergraduate pharmacy program consists of separate bachelor and master programs, according to the principles of the Bologna agreement; in the Netherlands both programs last 3 years. The bachelor and master programs in Utrecht are designed as a continuum, where similar teaching- and learning principles are used (see the second table in ref. [29]). In the bachelor program, the scientific foundation is formed; in the master program, the focus shifts to the application of scientific principles in patient-oriented care (Figure 1). The transition from university-based education to workplace-based practice is made in the master program and subsequent postgraduate programs ([33], this volume).
The bachelor and master curriculums are based on constructivist principles (see Table 1) and use problem-based and project-based education as basic educational formats. Many courses are designed as integrated, thematic, or methodological courses (see Figure 1). In the integrated courses, scientific content is presented by teachers from at least two different disciplines (e.g., medicinal chemistry, pharmacology, and pharmaceutics in the course Binding and action of medicines in year 1). In thematic courses, the presentation of disciplinary content is limited to knowledge that is relevant for the theme only, while the emphasis is on the application of procedures and methods rather than on the science content in methodological courses. Skills are taught and practiced during the whole curriculum, but integrated in the courses (not shown explicitly in the figure). The development of skills is structured along different lines (e.g., pharmaceutical calculations, oral communication, and management) and students’ outcomes are recorded in an electronic portfolio; additional training and practicing for underperforming students is offered in skills labs. Approximately 25–40% of the time allotted to a course is used for student–teacher contact—partially in the form of plenary lectures (up to a maximum of 30 h for a course of 200 h) and partially in the form of small group sessions (5–15 students, for problem-based or project-based work) and lab sessions, practical experiments, or training (up to 30 students per group). The remainder of the course time is available for working on assignments or projects and for individual study. Exams and assessments of skills are integrated within the courses, with opportunities for additional testing outside the planned courses. Every student has a personal tutor, who guides the student in making choices and helps them in reflecting on their skills development and study progress.

3. Methods

For the purpose of this study, data were extracted from a larger dataset, collected in the years 2005 to 2014. Every year (March–May), all students were asked to fill in the 120-item Dutch version of the ILS [30] during class hours; response rates varied between 20 and 74%. Because we wanted to make paired (within-student) comparisons, results of every year for the same students were combined based on student registration numbers. Within the whole dataset, data of 90 students were available for year 1 and/or 2 (bachelor) and year 4 and/or 5 (master). If data were available for the same student from year 1 and year 2, the results were averaged; the same was performed if data from year 4 and year 5 were available. The final dataset contained the results of students who started their study in September 2005, 2006 or 2008. The sample is comparable (in terms of gender composition and study results in the first year of study) to a larger dataset collected in the years 2005 to 2010 (n = 491; data not shown).
In the ILS, five processing strategies (ils01 = relating and structuring, ils02 = critical processing, ils03 = memorizing and rehearsing, ils04 = analyzing, and ils05 = concrete processing), five regulation strategies (ils06 = self-regulation (learning process and outcomes), ils07 = self-regulation (learning contents), ils08 = external regulation (learning process), ils09 = external regulation (learning outcomes), and ils10 = Lack of regulation), five conceptions of learning (ils11 = construction of knowledge, ils12 = intake of knowledge, ils13 = use of knowledge, ils14 = stimulating education, and ils15 = cooperative learning) and five learning orientations (ils16 = personally interested, ils17 = certificate oriented, ils18 = self-test oriented, ils19 = vocation oriented, and ils20 = ambivalent) are probed [30,31]. All items were scored on 5-point Likert scales (1–5). Scale scores of the ILS were calculated by averaging the scores of the constituent items; Cronbach’s alpha varied between 0.64 and 0.85. In two cases (ils04 in year 1/2 and ils03 in year 4/5), Cronbach’s alpha was lower, 0.57 and 0.40, respectively.
Because we were mainly interested in how deep and surface learning are linked to regulation of learning and the underlying conceptions of learning, processing and regulation scales were combined to higher-order scales as follows (illustrated in Table 2 and detailed in Appendix A):
  • ils0102: Deep processing was calculated as the average of ils01 (relating and structuring) and ils02 (critical processing);
  • ils0304: Stepwise processing was calculated as the average of ils03 (memorizing and rehearsing) and ils04 (analyzing);
  • ils0607: Self-regulation was calculated as the average of ils06 (self-regulation of learning process and outcomes) and ils07 (self-regulation of learning contents);
  • ils0809: External regulation was calculated as the average of ils08 (external regulation of learning process) and ils09 (external regulation of learning outcomes).
Scores for all ILS scales in the bachelor program (year 1 and/or 2) were compared to scores in the master program (year 4 and/or 5) using Student’s paired t-test. Effect sizes (Cohen’s d) were calculated as the mean difference between the bachelor and master scores, divided by the standard deviation. Effect sizes were considered small (0.2 to 0.5), medium (0.5 and 0.8) or large (0.8 and larger), according to Cohen [34].
Functional relationships between conceptions of learning, regulation strategies and processing strategies were mapped using path analysis. With this technique, it is possible to estimate a network of interdependent relationships, based on the correlation matrix of the measured variables; the best-fitting model is selected on statistical arguments. SPSS (version 25; IBM corporation, Armonk, USA) was used for basic statistical analysis (t-test, correlations); Systat-13 (Evanston, IL, USA) was used for path analysis, using the RAMONA routine.

4. Results

From the data (Table 3), it is clear that important changes occur in the learning approach of students when they move from the bachelor program (year 1 and/or 2) to the master program (year 4 and/or 5). In contrast to cross-sectional studies, relatively small intra-individual changes reach statistical significance due to the paired setup of the design of this study. In order to obtain a large enough sample, data of year 1 had to be combined with data of year 2, and data of year 4 were combined with data of year 5. This means that the observed changes can be two (n = 36), three (n = 47) or four (n = 7) years apart from each other for an individual student. Nevertheless, the results give a clear picture about the medium- to long-term changes in student learning.
A statistically significant increase in deep approach to learning, expressed as an increase in deep processing (ils0102, effect size = 0.55) and self-regulation (ils0607, effect size = 0.75) is clearly observed. When analyzed on a deeper level, the change in deep processing appears to be exclusively a result of a change in critical processing (ils02, large effect size); no change is seen in the ils01 scale relating and structuring. In contrast, relatively minor changes are seen in the surface approach to learning, as expressed by a small increase in stepwise processing (ils0304), which is caused by an increase in analyzing (ils04) rather than an increase in memorizing and rehearsing (ils03).
Both deep processing and stepwise processing increase between the bachelor and master programs. The balance between the deep and stepwise learning process does not change when students move from the bachelor to the master program. Self-regulation with respect to the learning contents increases strongly (effect size = 0.92), but self-regulation with respect to the process of learning changes less (effect size = 0.31). This means that a change in supposed metacognitive activities of the students is mainly concerned with the outcome of their learning, but that relatively minor changes in reflection on the learning process itself seem to occur in this stage of their study.
The variability between students in processing and regulation strategies is extensive, as can be seen already from the large standard deviations (Table 3). This phenomenon is further illustrated by the results of eleven individual students, of which data of four study years were available (Figure 2). Within-student changes between year 1, 2, 4 and 5 are present but are minor compared to the inter-student variability. It can also be seen that year-to-year changes do occur, but that the position of an individual student (indicated by a unique color in the figure), when compared to other students, is remarkably stable. Finally, it is suggested that changes in deep processing are mainly occurring between year 4 and year 5, while changes in self-regulation are occurring between year 2 and year 4, i.e., in the second half of the bachelor program.
In the first two years, pharmacy students appear to have mixed conceptions of learning. The conceptions that learning consists of intake of knowledge (ils12), use of knowledge (ils13) or construction of knowledge (ils11) have more or less equal weight in the beginning of the bachelor program and do not change considerably (see Table 3). A relatively small increase in the idea that learning consists of construction of knowledge is seen (ils11, effect size = 0.39). Remarkably, at the same time, it can be observed that the idea of learning being use of knowledge decreases (ils13, effect size = 0.38) between the beginning of the bachelor and the beginning of the master programs. This may be related to the science-based nature of the bachelor program. Students are becoming less vocation oriented (ils19) concomitantly. An increase in the self-test-oriented learning orientation (ils18) is consistent with the increase in a deep learning approach (i.e., deep processing and self-regulation).
The relationships between the three main learning conceptions and regulation and processing strategies were further investigated using path analysis of the correlations between scale scores (Appendix B). For the bachelor phase, the best-fitting model established clear relationships between a constructivist learning conception, self-regulation, and deep processing (Figure 3, left panel). This means that students who score higher on the scale of construction of knowledge (ils11) tend to also score higher on the scale of self-regulation (ils0607) and the scale of deep processing (ils0102). Forty percent of the variance in the self-regulation score and 29% of the variability in the deep processing score can be explained in terms of the underlying, in this case constructivist, conception of learning. In contrast, 32% of the variance in stepwise processing (ils0304) can be explained in terms of a combination of self-regulation (ils0607) and external regulation (ils0809). External regulation of student learning is dependent on the students having a dual conception of learning, where both construction of knowledge (ils11) and intake of knowledge (ils12) contribute; together, these two variables explain 16% of the variance in the external regulation score.
When students move from the bachelor program to the master program, two subtle changes in the relationships between their conceptions of learning, regulation strategies and processing strategies occur (Figure 3, right panel). External regulation is no longer dependent on having intake of knowledge (ils12) as a conception of learning, but is now influenced by having use of knowledge (ils13) as a learning conception (19% of the variance explained). The variance in deep processing strategy is no longer explained in terms of self-regulation (ils0607) only, but is also influenced by external regulation (ils0809). In view of the observation that external regulation of the learning process (ils08) increases between the bachelor and master phases, while external regulation of learning outcomes (ils09) decreases (see Table 3), this probably means that characteristics of the teaching/learning environment (e.g., teacher behavior or assignments) have an increasing impact on the learning process of students, while students become more and more dependent on self-regulation as far as the content of learning is concerned. The deep processing learning strategy and part of the stepwise processing learning strategy during the master phase remain dependent on self-regulation and on having a constructivist view of the nature of learning. The strength of the influence of self-regulation on stepwise processing increases in the master program (path coefficient = 0.78), compared to the bachelor program (path coefficient = 0.24).

5. Discussion

In this study, it has been possible to demonstrate statistically significant longitudinal changes in the processing and regulation of many learning strategies in addition to changes in the relationships between processing strategies, regulation strategies and the underlying conceptions of learning. In earlier studies, it has been difficult to unambiguously demonstrate increases in the deep learning approaches of students in higher education, which are theoretically supposed to occur [35]. This may be caused by earlier studies being performed in conventional, teacher-centered curricula [17,23,24], but also by large inter- and intra-individual differences [24,25]. Comparable large inter-individual variations were found in this study, expressed as large standard deviations, and paired comparisons between the bachelor and master phases could be made due to the availability of longitudinal data. It was shown that changes in learning approaches, with medium to large effect sizes, can be demonstrated. The conclusions may be weakened somewhat because of a highly variable response rate between years and between courses, but the paired measurement is not affected by this (as a cross-sectional, non-paired measurement would have been). Two further limitations are the sample size (small compared to the total number of students) and a relatively low reliability of 2 out of 40 measurements scales (see Methods). We estimate that these limitations will not be so large as to compromise our results and conclusions.
From the results of this study, it can be concluded that constructivist opinions and self-regulation have an overall importance for explaining variability in learning processes both in the bachelor and the master phase of this curriculum. Already in the bachelor phase, student views about the nature of learning as construction of knowledge are reasonably high (3.25 ± 0.46, mean ± s.d.), in addition to the opinion of learning being intake of knowledge (3.72 ± 0.43) or use of knowledge (3.68 ± 0.45). A small, but statistically significant increase (effect size = 0.39) in the constructivist opinion is seen two to four years later, when students progress to the master phase of the program. Self-regulation of learning is strongly dependent on having a constructivist opinion: 40% (the bachelor phase) or more (the master phase) of the variance in self-regulation is explained by the constructivist conception of learning. Both deep and stepwise processing of learning, in turn, are influenced by self-regulation characteristics of the students. The increase in self-regulation between the bachelor and master phases, mostly with respect to the content of learning, explains important changes in deep processing strategies (effect size = 0.55), mainly as a change in critical processing (effect size = 0.94).
The overall conclusion must be that pharmacy students in this curriculum use deep learning approaches (deep processing and self-regulation, based on constructivist opinions) already in the bachelor phase and that these deep learning approaches are further enhanced between the bachelor and the master phase. In this respect, the results compare favorably with earlier studies from the Australian and Finnish contexts. In a 4 year program at the University of Sydney, measures of the meaning-directed approach decreased during the first half of the curriculum, while only a ‘recovery’ was seen during the second half of the curriculum [26,27]. Measures of meaning-directed orientation, deep approach, self-regulation and a constructivist conception of learning did not change in a statistically significant way in a 3 year undergraduate program at the University of Helsinki [23]. In longitudinal studies of medical curricula in California (USA) and Edinburgh (UK), no statistically significant changes in deep approach were seen between year 1 and year 4 or 5, but this was interpreted as students already having a relatively deep approach at the beginning of the curriculum due to the constructivist nature of those curricula [36,37]. We cannot be certain that the absence of changes in the Finnish and Australian contexts were due to the conventional, lecture-based, teacher-centered, character of the curricula, but it should be mentioned that extensive curriculum change processes are being effected in Helsinki in more recent years [3,38].
A second result of this study is that surface learning, expressed as stepwise processing and external regulation, also appears to be influenced by the constructivist conception of learning. In both the bachelor and the master phases, stepwise processing is dependent on seeing learning as construction of knowledge. This is effected indirectly via two pathways and mediated by the effect of a constructivist view of external regulation and the effect of self-regulation on stepwise processing. Changes in surface learning between the bachelor and master phases are relatively minor and consist of a small increase in stepwise processing (effect size = 0.30, caused by a change in the analyzing score), a decrease in external regulation of learning outcomes (effect size = 0.60) and an increase in external regulation of the learning process (effect size = 0.50). This could be interpreted as a result of the way the curriculum is organized, where attention for the process of learning in the form of instructions, tasks, assignments, and teacher roles can be perceived by the students as external regulation of the learning process.
A last result of this study is that deep processing in the master phase becomes partly dependent on external regulation (path coefficient = 0.25) in addition to the dependency on self-regulation (path coefficient = 0.49). This can also be interpreted as a result of the curriculum, where assignments are explicitly formulated in such a way that deep processing, consisting of relating and structuring and critical processing, is stimulated. The way in which problem-based and project-based education is organized could be perceived as external regulation by the students.
The results of this study confirm that the conceptual understanding of students about the nature of learning affects their learning strategies, and that this relationship is mediated via the regulation of learning. Having a constructivist understanding (i.e., seeing learning as knowledge construction) appears to be particularly important for self-regulation of learning, as this influences all aspects of deep learning (relating and structuring and critical processing) and stepwise learning (memorizing and rehearsing and analyzing) investigated in this study. Constructivist opinions have a secondary effect on stepwise learning, which is mediated via external regulation of learning, together with the contribution of other conceptions of learning (intake of knowledge during the bachelor phase or use of knowledge during the master phase). These relationships between conceptions of learning, regulation strategies and processing strategies are consistent with observations in post-secondary education in Hong Kong [39] and advanced psychology students in the Netherlands [40]. The functional relationships between conceptions of learning, regulation strategies and processing strategies have been synthesized in an integrated model of student learning [30], which has subsequently been found useful in numerous contexts (reviewed by Vermunt and Donche [31]). It is now confirmed that in the context of pharmacy education, essentially the same relationships between conceptual understanding of learning, regulation of learning and processing of learning exist, and that substantial changes in deep learning (characterized by self-regulation and deep processing) can occur when students advance from the bachelor phase to the master phase.
In the investigated curriculum, students develop a higher degree of self-regulation (effect size = 0.75), in particular with respect to the content of learning, and they perceive higher degrees of critical processing (effect size = 0.94; an aspect of deep processing), analyzing (effect size = 0.55; an aspect of stepwise processing) and concrete processing (effect size = 0.78) during the master phase, compared to the bachelor phase 2–4 years before. We do not know whether students are developing this increased self-regulation and change in learning processes as a result of characteristics of the teaching/learning environment or whether the teaching/learning environment only facilitates or accommodates an endogenous cognitive development process. It is highly likely that the cognitive development of students from dualistic thinking to contextual relativism is ongoing [7,8,10,11] and that this development is strengthened by characteristics of the teaching/learning environment. In particular, the integration of course content and the use of problem- and project-based learning can be important [18,41]. Integrative teaching of content in student-activating educational formats such as problem-based and project-based learning can be effective in stimulating deep learning by creating cognitive frictions [42]. Student–student interaction, while working on projects, and student–teacher interactions, during problem-based learning sessions and in individual tutorials, can contribute to developing multiple perspectives and cooperative dialogues (compare Table 1). These curricular aspects appear to more effective in stimulating deep, reflective learning when introduced in a curriculum-wide—systematic—way [16,41], where contextual factors and student characteristics are taken into account [22]. The conclusion from our study can be that several design elements of the curriculum contribute to the observed changes in self-regulation and deep and stepwise learning processes.
The importance of designing a teaching/learning environment, that accommodates and strengthens the appropriate cognitive development of students can be illustrated as follows (Figure 4). The scheme assumes that the cognitive development of students from dualistic to contextual relativistic thinking is endogenous and can be strengthened by the way in which the teaching/learning environment is constructed and/or implemented [29]. In a constructivist curriculum, the cognitive development of students, expressed as deep, self-regulated and reflective learning, is fostered by characteristics of the teaching/learning environment. The teaching/learning environment can be more (or less) stimulating for this development depending on whether the content is delivered in an integrated or non-integrated way, the choices for educational formats and the way student–student and student–teacher interactions are organized. Whether the full potential of a curriculum is achieved will also depend on many contextual and student characteristics [22], in particular their critical reflection and metacognitive capabilities.

6. Conclusions

The result of this study demonstrates that the use of deep processing (in particular critical thinking), stepwise processing (in particular analyzing) and concrete processing learning strategies increases in the undergraduate pharmacy curriculum of Utrecht University between the bachelor phase (year 1/2) and the master phase (year 4/5). This change is based on an increase in constructivist views about the nature of learning and mediated through a relatively large increase in the use of self-regulating strategies. These changes are most likely a reflection of endogenous cognitive development, which is strengthened by characteristics of the teaching/learning environment that is explicitly based on constructivist principles.

Author Contributions

Conceptualization, A.S.K.; methodology, A.S.K. and J.D.V.; software, A.S.K.; formal analysis, A.S.K.; investigation, A.S.K.; resources, A.S.K.; data curation, A.S.K.; writing—Original draft preparation, A.S.K.; writing—Review and editing, J.D.V. and A.S.K.; visualization, A.S.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Acknowledgments

The help of course coordinators of the Department of Pharmaceutical Sciences, Utrecht University, in collecting the original data is gratefully acknowledged.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

In this appendix a detailed description of the ILS scales is given (Table A1), together with example items from the original questionnaire (reproduced from [31] and adapted from [30], respectively). The questionnaire is presented to students in the format of 120 questions, divided into three sections—study activities (items 1–55), study motives (items 56–80) and study views (items 81–120). Within each section, the items are presented in a randomized order. All items are scored on a 5-point Likert scale (for study activities: I do this seldom or never, I do this sometimes, I do this regularly, I do this often, and I do this almost always; for study motives and study views: disagree entirely, disagree for the most part, agree as much as disagree, agree for the most part, and agree entirely). The original questionnaire and scoring list can be obtained from the second author (J.D.V.).
Table A1. Processing strategies, regulation strategies, conceptions of learning and learning orientations of students, as assessed by the Inventory of Learning patterns of Students (ILS).
Table A1. Processing strategies, regulation strategies, conceptions of learning and learning orientations of students, as assessed by the Inventory of Learning patterns of Students (ILS).
Scale (# of Items)
Scale Name
Scale Description
Example Item
Processing Strategies
ils01 (7 items)
Relating and structuring
Relating elements of the subject matter to each other and to prior knowledge; structuring these elements into a whole.
I try to discover the similarities and differences between the theories that are dealt with in a course.
ils02 (4 items)
Critical processing
Forming one’s own view of the subjects that are dealt with, drawing one’s own conclusions, and being critical of the conclusions drawn by textbook authors and teachers.
I check whether the conclusions drawn by the authors of a textbook follow the facts on which they are based logically.
ils03 (5 items)
Memorizing and rehearsing
Learning facts, definitions, lists of characteristics, and the like by heart by rehearsing them.
I repeat the main parts of the subject matter until I know them by heart.
ils04 (6 items)
Analyzing
Going through the subject matter in a stepwise fashion and studying the separate elements thoroughly, in detail and one by one.
I work through a chapter in a textbook item by item and I study each part separately.
ils05 (5 items)
Concrete processing
Concretizing and applying subject matter by connecting it to one’s own experiences and by using in practice what one learns in a course.
I pay particular attention to those parts of a course that have practical utility.
scale (# of items)
Scale name
Scale description
Example item
Regulation strategies
ils06 (7 items)
Self-regulation
Learning process and outcomes
Regulating one’s own learning processes through regulation activities like planning learning activities, monitoring progress, diagnosing problems, testing one’s outcomes, adjusting, and reflecting.
To test my learning progress when I have studied a textbook, I try to formulate the main points in my own words.
ils07 (4 items)
Self-regulation
Learning contents
Consulting literature and sources outside the syllabus.
If I do not understand a study text well, I try to find other literature about the subject concerned.
ils08 (6 items)
External regulation
Learning process
Letting one’s own learning processes be regulated by external sources, such as introductions, learning objectives, directions, questions, or assignments of teachers or textbook authors.
I study the subject matter in the same sequence as it is dealt with in the course.
ils09 (5 items)
External regulation
Learning outcomes
Testing one’s learning outcomes by external means, such as the tests, assignments, and questions provided.
If I am able to complete all the assignments given in the study materials or by the teacher, I decide that I have a good command of the subject matter.
ils10 (6 items)
Lack of regulation
Monitoring difficulties with the regulation of one’s own learning processes.
I notice that it is difficult for me to determine whether I have mastered the subject matter sufficiently.
Conceptions of learning
ils11 (9 items)
Construction of knowledge
Learning viewed as constructing one’s own knowledge and insights. Most learning activities are seen as tasks of students.
If I have difficulty understanding a particular topic, I should consult other books of my own accord.
ils12 (9 items)
Intake of knowledge
Learning viewed as taking in knowledge provided by education through memorizing and reproducing; other learning activities are tasks of teachers.
For me, learning means trying to remember the subject matter I am given.
ils13 (6 items)
Use of knowledge
Learning viewed as acquiring knowledge that can be used by means of concretising and applying. These activities are seen as tasks of both students and teachers.
The things I learn have to be useful for solving practical problems.
ils14 (8 items)
Stimulating education
Learning activities are viewed as tasks of students, but teachers and textbook authors should continuously stimulate students to use these activities.
The course team should encourage me to compare the various theories that are dealt with in a course.
ils15 (8 items)
Cooperative learning
Attaching a lot of value to learning in co-operation with fellow students and sharing the tasks of learning with them.
I have the need to work together with other students in my studies.
scale (# of items)
Scale name
Scale description
Example item
Learning orientations
ils16 (5 items)
Personally interested
Studying out of interest in the course subjects and to develop oneself as a person.
I do these studies out of sheer interest in the topics that are dealt with.
ils17 (5 items)
Certificate oriented
Striving for high study achievements; studying to pass examinations and to obtain certificates, credit points, and a degree.
I study above all to pass the exam.
ils18 (5 items)
Selftest oriented
Studying to test one’s own capabilities and to prove to oneself and others that one is able to cope with the demands of higher education
I want to test myself to see whether I am capable of doing studies in higher education.
ils19 (5 items)
Vocation oriented
Studying to acquire professional skill and to obtain a(nother) job.
I have chosen this subject area because I am highly interested in the type of work for which it prepares.
ils20 (5 items)
Ambivalent
A doubtful, uncertain attitude toward the studies, one’s own capabilities, the chosen subject area, the type of education, etc.
I am afraid these studies are too demanding for me.

Appendix B

Table A2. Pearson correlation matrix used in path analysis of the bachelor phase (year 1/2) data.
Table A2. Pearson correlation matrix used in path analysis of the bachelor phase (year 1/2) data.
ils0102ils0304ils0607ils0809ils11ils12ils13
ils01021.000
ils03040.1911.000
ils06070.539 ***0.438 ***1.000
ils08090.1460.481 ***0.300 **1.000
ils110.344 ***0.287 **0.628 ***0.254 *1.000
ils12−0.1680.535 ***−0.0090.340 ***0.1611.000
ils130.0360.1000.1850.1710.434 ***0.1081.000
Statistical significance is indicated as * p < 0.05, ** p < 0.01 or *** p < 0.001.
Table A3. Pearson correlation matrix used in path analysis of the master phase (year 4/5) data.
Table A3. Pearson correlation matrix used in path analysis of the master phase (year 4/5) data.
ils0102ils0304ils0607ils0809ils11ils12ils13
ils01021.000
ils03040.324 **1.000
ils06070.468 ***0.357 ***1.000
ils08090.420 ***0.369 ***0.2101.000
ils110.454 ***0.261 *0.673 ***0.1731.000
ils12−0.1160.375 ***0.0510.218 *−0.0261.000
ils130.331 **0.136−0.0680.427 ***0.1580.0111.000
Statistical significance is indicated as * p < 0.05, ** p < 0.01 or *** p < 0.001.

References

  1. Van Mil, J.W.F.; Schulz, M.; Tromp, T.F.J. Pharmaceutical Care, European Developments in Concepts, Implementation, Teaching, and Research: A Review. Pharm. Worlds Sci. 2004, 26, 303–311. [Google Scholar] [CrossRef]
  2. Edwards, R. Policy and Professionalism in Pharmacy Education. Pharm. Educ. 2011, 11, 209–211. [Google Scholar]
  3. Kaartinen-Koutaniemi, M.; Katajavuori, N. Enhancing the Development of Pharmacy Education by Changing Pharmacy Teaching. Pharm. Educ. 2006, 6, 197–208. [Google Scholar] [CrossRef]
  4. Phanudulkitti, C.; Farris, K.B.; Makmee, P.; Kittisopee, T. Deep Approach to Learning of Pharmacy Students: A Multilevel Analysis. Pharm. Educ. 2018, 18, 99–109. [Google Scholar]
  5. Perry, W.G. Forms of Intellectual and Ethical Development in the College Years: A Scheme; Holt, Rinehart and Winston: New York, NY, USA, 1970. [Google Scholar]
  6. Felder, R.M.; Brent, R. The Intellectual Development of Science and Engineering Students. Part 1: Models and Challenges. J. Eng. Educ. 2004, 93, 269–277. [Google Scholar] [CrossRef]
  7. King, P.M. Principles of Development and Developmental Change Underlying Theories of Cognitive and Moral Development. J. Coll. Stud. Dev. 2009, 50, 597–620. [Google Scholar] [CrossRef]
  8. Richardson, J.T.E. Epistemological Development in Higher Education. Educ. Res. Rev. 2013, 9, 191–206. [Google Scholar] [CrossRef]
  9. Wise, J.C.; Lee, S.H.; Litzinger, T.; Marra, R.M.; Palmer, B. A Report on a Four-year Longitudinal Study of Intellectual Development of Engineering Undergraduates. J. Adult Dev. 2004, 11, 103–110. [Google Scholar] [CrossRef]
  10. Marra, R.; Palmer, B. Encouraging Intellectual Growth: Senior College Student Profiles. J. Adult Dev. 2004, 11, 111–122. [Google Scholar] [CrossRef]
  11. Lonka, K.; Lindblom-Ylänne, S. Epistemologies, Conceptions of Learning, and Study Practices in Medicine and Psychology. High. Educ. 1996, 31, 5–24. [Google Scholar] [CrossRef]
  12. Muis, K.R.; Duffy, M.C. Epistemic Climate and Epistemic Change: Instruction Designed to Change Students’ Beliefs and Learning Strategies and Improve Achievement. J. Educ. Psychol. 2013, 105, 213–225. [Google Scholar] [CrossRef]
  13. Päuler-Kuppinger, L.; Jucks, R. Perspectives on Teaching: Conceptions of Teaching and Epistemological Beliefs of University Academics and Students in Different Domains. Act. Learn. High. Educ. 2017, 18, 63–76. [Google Scholar] [CrossRef]
  14. Lonka, K.; Ketonen, E.; Vermunt, J.D. University Students’ Epistemic Profiles, Conceptions of Learning, and Academic Performance. High. Educ. 2020. [Google Scholar] [CrossRef]
  15. Felder, R.M.; Brent, R. The Intellectual Development of Science and Engineering Students. Part 2: Teaching to Promote Growth. J. Eng. Educ. 2004, 93, 279–291. [Google Scholar] [CrossRef]
  16. Van Der Veken, J.; Valcke, M.; De Maeseneer, J.; Derese, A. Impact of the Transition from a Conventional to an Integrated Contextual Medical Curriculum on Students’ Learning Patterns: A Longitudinal Study. Med. Teach. 2009, 31, 433–441. [Google Scholar] [CrossRef] [PubMed]
  17. Van der Veken, J.; Valcke, M.; Muijtjens, A.; De Maeseneer, J.; Derese, A. The Potential of the Inventory of Learning Styles to Study Students’ Learning Patterns in Three Types of Medical Curricula. Med. Teach. 2008, 30, 863–869. [Google Scholar] [CrossRef]
  18. Gustin, M.; Abbiati, M.; Bonvin, R.; Gerbase, M.W.; Baroffio, A. Integrated Problem-Based Learning Versus Lectures: A Path Analysis Modelling of the Relationships between Educational Context and Learning Approaches. Med. Educ. Online 2018, 23, 1489690. [Google Scholar] [CrossRef]
  19. Tynjälä, P. Towards Expert Knowledge? A Comparison between a Constructivist and a Traditional Learning Environment in the University. Int. J. Educ. Res. 1999, 31, 357–442. [Google Scholar] [CrossRef]
  20. Loyens, S.M.M.; Gijbels, D. Understanding the Effects of Constructivist Learning Environments: Introducing a Multi-Directional Approach. Instr. Sci. 2008, 36, 351–357. [Google Scholar] [CrossRef] [Green Version]
  21. Alt, D. The Construction and Validation of a New Scale for Measuring Features of Constructivist Learning Environments in Higher Education. Frontline Learn. Res. 2014, 5, 1–28. [Google Scholar]
  22. Baeten, M.; Kyndt, E.; Struyven, K.; Dochy, F. Using Student-Centred Learning Environments to Stimulate Deep Approaches to Learning: Factors Encouraging Or Discouraging their Effectiveness. Educ. Res. Rev. 2010, 5, 243–260. [Google Scholar] [CrossRef]
  23. Nieminen, J.; Lindblom-Ylänne, S.; Lonka, K. The Development of Study Orientations and Study Success in Students of Pharmacy. Instr. Sci. 2004, 32, 387–417. [Google Scholar] [CrossRef]
  24. Varunki, M.; Katajavuori, N.; Postareff, L. First-Year Students’ Approaches to Learning, and Factors Related to Change Or Stability in their Deep Approach during a Pharmacy Course. Stud. High. Educ. 2017, 42, 331–353. [Google Scholar] [CrossRef]
  25. Postareff, L.; Mattsson, M.; Parpala, A. The Effect of Perceptions of the Teaching-Learning Environment on the Variation in Approaches to Learning—between-Student Differences and within-Student Variation. Learn. Individ. Differ. 2018, 68, 96–107. [Google Scholar] [CrossRef] [Green Version]
  26. Smith, L.; Saini, B.; Krass, I.; Chen, T.; Bosnic-Anticevich, S.; Sainsbury, E. Pharmacy Students’ Approaches to Learning in an Australian University. Am. J. Pharm. Educ. 2007, 71, 120. [Google Scholar] [CrossRef] [Green Version]
  27. Smith, L.; Krass, I.; Sainsbury, E.; Rose, G. Pharmacy Students’ Approaches to Learning in Undergraduate and Graduate Entry Programs. Am. J. Pharm. Educ. 2010, 74, 106. [Google Scholar] [CrossRef] [Green Version]
  28. Koster, A.S.; Meijerman, I.; Blom, L.T.G.; Schalekamp, T. Pharmacy Education at Utrecht University: An Educational Continuum. Dosis 2009, 25, 85–93. [Google Scholar]
  29. Koster, A.S.; Schalekamp, T.; Meijerman, I. Implementation of Competency-Based Pharmacy Education (CBPE). Pharmacy 2017, 5, 10. [Google Scholar] [CrossRef]
  30. Vermunt, J.D. The Regulation of Constructive Learning Processes. Br. J. Educ. Psychol. 1998, 68, 149–171. [Google Scholar] [CrossRef]
  31. Vermunt, J.D.; Donche, V. A Learning Patterns Perspective on Student Learning in Higher Education: State of the Art and Moving Forward. Educ. Psychol. Rev. 2017, 29, 269–299. [Google Scholar] [CrossRef]
  32. Vermunt, J.D. Surveys and Retrospective Self-Reports to Measure Strategies and Strategic Processing. In Handbook of Strategies and Strategic Processing; Dinsmore, D.L., Fryer, L.K., Parkinson, M.M., Eds.; Routledge: New York, NY, USA, 2020; pp. 259–274. [Google Scholar]
  33. Koster, A.S.; Mantel-Teeuwisse, A.K.; Woerdenbag, H.J.; Mulder, W.M.C.; Wilffert, B.; Schalekamp, T.; Buurma, H.; Wilting, I.; Westein, M.P.D. Alingment of CanMEDS-Based Undergraduate and Postgraduate Pharmacy Curricula in the Netherlands. Pharmacy 2020, 8, 117. [Google Scholar] [CrossRef] [PubMed]
  34. Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Lawrence Erlbaum Associates Ltd.: Mahwah, NJ, USA, 1988. [Google Scholar]
  35. Asikainen, H.; Gijbels, D. Do Students Develop Towards More Deep Approaches to Learning during Studies? A Systematic Review on the Development of Students’ Deep and Surface Approaches to Learning in Higher Education. Educ. Psychol. Rev. 2017, 29, 205–234. [Google Scholar] [CrossRef]
  36. Reid, W.A.; Evans, P.; Duvall, E. Medical Students’ Approaches to Learning Over a Full Degree Programme. Med. Educ. Online 2012, 17. [Google Scholar] [CrossRef]
  37. Chung, E.-K.; Elliott, D.; Fisher, D.; May, W. A Comparison of Medical Students’ Learning Approaches between the First and Fourth Years. South. Med. J. 2015, 108, 207–210. [Google Scholar] [CrossRef]
  38. Katajavuori, N.; Hakkarainen, K.; Kuosa, T.; Airaksinen, M.; Hirvonen, J.; Holm, Y. Curriculum Reform in Finnish Pharmacy Education. Am. J. Pharm. Educ. 2009, 73, 151. [Google Scholar] [CrossRef] [Green Version]
  39. Law, D.C.; Meyer, J.H. Initial Investigation of Hong Kong Post-Secondary Students’ Learning Patterns. Qual. Assur. Educ. 2011, 19, 335–356. [Google Scholar] [CrossRef]
  40. Loyens, S.M.M.; Rikers, R.M.J.P.; Schmidt, H.G. Relationships between Students’ Conceptions of Constructivist Learning and their Regulation and Processing Strategies. Instr. Sci. 2008, 36, 445–462. [Google Scholar] [CrossRef] [Green Version]
  41. Dolmans, D.H.J.M.; Loyens, S.M.M.; Marcq, H.; Gijbels, D. Deep and Surface Learning in Problem-Based Learning: A Review of the Literature. Adv. Health Sci. Educ. 2016, 21, 1087–1112. [Google Scholar] [CrossRef] [Green Version]
  42. Vermunt, J.D.; Verloop, N. Congruence and Friction between Learning and Teaching. Learn. Instr. 1999, 9, 257–280. [Google Scholar] [CrossRef]
Figure 1. Schematic representation of the bachelor and master curriculums, years 1–6. The curriculum consists mainly of courses, where content of different disciplines is integrated (I, white color) or where relevant themes are used as organizing principles (T, green color); only a few courses in year 1 are monodisciplinary (D, blue color). Other courses emphasize methodological aspects (procedures) rather than content (M, grey color). Internships in community and hospital pharmacy (W, salmon color) are scheduled in the master program.
Figure 1. Schematic representation of the bachelor and master curriculums, years 1–6. The curriculum consists mainly of courses, where content of different disciplines is integrated (I, white color) or where relevant themes are used as organizing principles (T, green color); only a few courses in year 1 are monodisciplinary (D, blue color). Other courses emphasize methodological aspects (procedures) rather than content (M, grey color). Internships in community and hospital pharmacy (W, salmon color) are scheduled in the master program.
Pharmacy 08 00200 g001
Figure 2. Differences between individual students in deep and surface learning. Scale scores (Y axis) for processing and regulation strategies in year 1, 2, 4 and 5 of eleven individual students are plotted in the figure. Each unique color represents the data of one-and-the-same student.
Figure 2. Differences between individual students in deep and surface learning. Scale scores (Y axis) for processing and regulation strategies in year 1, 2, 4 and 5 of eleven individual students are plotted in the figure. Each unique color represents the data of one-and-the-same student.
Pharmacy 08 00200 g002
Figure 3. Relations between conceptions of learning, regulation strategies and processing strategies in the bachelor and master programs. Statistically significant positive path coefficients (* p < 0.05 or ** p < 0.01) are represented by the blue arrows; non-significant paths were excluded. The percentage of explained variances for each for the processing and regulation strategies is indicated on top of the relevant boxes. The fit of both path models was good (RMSEA < 0.05).
Figure 3. Relations between conceptions of learning, regulation strategies and processing strategies in the bachelor and master programs. Statistically significant positive path coefficients (* p < 0.05 or ** p < 0.01) are represented by the blue arrows; non-significant paths were excluded. The percentage of explained variances for each for the processing and regulation strategies is indicated on top of the relevant boxes. The fit of both path models was good (RMSEA < 0.05).
Pharmacy 08 00200 g003
Figure 4. A model for stimulating cognitive development in a constructivist teaching/learning environment (TLE). The longitudinal cognitive development of students (symbolized by the left-hand arrow) is supposed to increase in a curriculum (bottom to top). In a constructivist curriculum, the cognitive development of students, expressed as reflective, deep, and self-regulated learning, is fostered by characteristics of the TLE, which can stimulate cognitive development to a small or larger extent, as symbolized by the slope of the diagonal line (one or two arrows, respectively). Whether the full potential of a curriculum is achieved also depends on the ‘reflective capability’ of the student involved.
Figure 4. A model for stimulating cognitive development in a constructivist teaching/learning environment (TLE). The longitudinal cognitive development of students (symbolized by the left-hand arrow) is supposed to increase in a curriculum (bottom to top). In a constructivist curriculum, the cognitive development of students, expressed as reflective, deep, and self-regulated learning, is fostered by characteristics of the TLE, which can stimulate cognitive development to a small or larger extent, as symbolized by the slope of the diagonal line (one or two arrows, respectively). Whether the full potential of a curriculum is achieved also depends on the ‘reflective capability’ of the student involved.
Pharmacy 08 00200 g004
Table 1. Characteristic elements of a constructivist curriculum (after Alt [21]).
Table 1. Characteristic elements of a constructivist curriculum (after Alt [21]).
1.
Knowledge construction. This element describes multiple opportunities given to students to investigate real problems, raise questions and search for possible explanations while using various methodological approaches.
2.
In-depth learning. This category pertains to the extent to which students are given opportunities to deeply explore a certain subject matter, rather than engaging them in surface learning.
3.
Authenticity. This element deals with giving relevant meaning to the learned concepts and addressing real-life and interesting events, which are related to the studied topic.
4.
Multiple perspectives. This category refers to presenting complex ideas from several points of view.
5.
Prior knowledge. This element primarily deals with connecting the subject materials in individual courses to other course topics.
6.
Teacher-student interaction. This element refers to the teacher role, which includes guidance toward reflection on learning processes.
7.
Cooperative dialogue. This element refers to dialogical activities during the lesson, in which students can express opinions and original ideas.
8.
Social interaction. This element includes a variety of learning activities with other students, not necessarily during a lesson.
Table 2. Characteristics of deep and surface learning.
Table 2. Characteristics of deep and surface learning.
Processing StrategiesRegulation Strategies
Deep learningDeep processing
scale 01: Relating and structuring
scale 02: Critical processing
Self-regulation
scale 06: Learning process and outcomes
scale 07: Learning contents
Item examplesI try to combine subjects that are dealt with separately in the course into one whole
I compare my view of a course topic with the views of textbook authors
To test my learning, I try to answer questions about the subject matter which I make up myself
In addition to the syllabus, I study other related literature
Surface learningStepwise processing
scale 03: Memorizing and rehearsing
scale 04: Analyzing
External regulation
scale 08: Learning process
scale 09: Learning outcomes
Item examplesI memorize lists of characteristics of a phenomenon
I analyze the separate components of a theory step by step
I study according to the instructions in the course manual
I test my learning solely by completing the questions, tasks, and self-tests in the course material
In the ILS, each scale is represented by 4 to 8 items; representative Item examples (in italics) of the main processing and regulation scales are taken from the questionnaire, used in this study.
Table 3. Processing strategies, regulation strategies, conceptions of learning and learning orientations of students in the bachelor and master programs.
Table 3. Processing strategies, regulation strategies, conceptions of learning and learning orientations of students in the bachelor and master programs.
ILS ScaleBachelor
(year 1/2)
Master
(year 4/5)
p
(Paired t-Test)
Effect Size
Processing Strategies
ils0102Deep processing2.72 ± 0.523.05 ± 0.68< 0.001 ***0.55↑↑
ils01Relating and structuring3.17 ± 0.603.18 ± 0.770.860.01
ils02Critical processing2.27 ± 0.582.92 ± 0.80< 0.001 ***0.94↑↑↑
ils0304Stepwise processing2.82 ± 0.572.98 ± 0.49< 0.014 *0.30
ils03Memorizing and rehearsing2.90 ± 0.812.91 ± 0.750.910.01
ils04Analyzing2.74 ± 0.513.04 ± 0.58< 0.001 ***0.55↑↑
ils05Concrete processing2.62 ± 0.633.12 ± 0.65< 0.001 ***0.78↑↑
Regulation Strategies
ils0607Self-regulation2.49 ± 0.582.92 ± 0.56< 0.001 ***0.75↑↑
ils06Learning process2.57 ± 0.652.78 ± 0.720.015 *0.31
ils07Contents2.31 ± 0.662.96 ± 0.75< 0.001 ***0.92↑↑↑
ils0809External regulation3.24 ± 0.503.30 ± 0.480.372 0.12
ils08Learning process3.00 ± 0.533.29 ± 0.62< 0.001 ***0.50↑↑
ils09Learning outcomes3.49 ± 0.653.00 ± 0.98< 0.001 ***0.60↓↓
ils10Lack of regulation2.35 ± 0.662.97 ± 0.79< 0.001 ***0.86↑↑↑
Conceptions of Learning
ils11Construction of knowledge3.25 ± 0.463.45 ± 0.570.005 **0.39
ils12Intake of knowledge3.72 ± 0.433.58 ± 0.630.070.26
ils13Use of knowledge3.68 ± 0.453.44 ± 0.810.017 *0.38
ils14Stimulating education (teacher)3.08 ± 0.573.15 ± 0.570.320.12
ils15Cooperative learning (students)3.13 ± 0.613.07 ± 0.640.520.10
Learning Orientations
ils16Personally interested3.07 ± 0.463.17 ± 0.610.200.19
ils17Certificate oriented3.30 ± 0.563.19 ± 0.850.220.16
ils18Self-test oriented3.06 ± 0.813.49 ± 1.04< 0.001 ***0.46
ils19Vocation oriented3.95 ± 0.503.03 ± 1.32< 0.001 ***1.01↓↓↓
ils20Ambivalent2.02 ± 0.682.08 ± 0.920.580.08
Data are based on a sample of 90 students who started their bachelor of pharmacy program in September 2005, 2006 or 2008. Statistical significance of the comparison between the bachelor and master programs (Student’s paired t-test) is indicated as * p < 0.05, ** p < 0.01 or *** p < 0.001. Effect size [34] is considered small (>0.2; one arrow), medium (>0.5; two arrows) or large (>0.8; three arrows).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Koster, A.S.; Vermunt, J.D. Longitudinal Changes of Deep and Surface Learning in a Constructivist Pharmacy Curriculum. Pharmacy 2020, 8, 200. https://0-doi-org.brum.beds.ac.uk/10.3390/pharmacy8040200

AMA Style

Koster AS, Vermunt JD. Longitudinal Changes of Deep and Surface Learning in a Constructivist Pharmacy Curriculum. Pharmacy. 2020; 8(4):200. https://0-doi-org.brum.beds.ac.uk/10.3390/pharmacy8040200

Chicago/Turabian Style

Koster, Andries S., and Jan D. Vermunt. 2020. "Longitudinal Changes of Deep and Surface Learning in a Constructivist Pharmacy Curriculum" Pharmacy 8, no. 4: 200. https://0-doi-org.brum.beds.ac.uk/10.3390/pharmacy8040200

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop