Next Article in Journal
Digital Design in Artistic Education: An Overview of Research in the University Setting
Next Article in Special Issue
The Role of Competitive Robotics in Providing Context to Classroom Learning and Technical Skill Development in School Age Students—A Survey of Current Avenues, Assessment, and Path Forward with Systematic Implementation
Previous Article in Journal
Application of Virtual Reality in Computer Science Education: A Systemic Review Based on Bibliometric and Content Analysis Methods
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Supporting Undergraduate STEMM Education: Perspectives from Faculty Mentors and Learning Assistants in Calculus II

1
Department of Curriculum and Instruction, Texas Tech University, Lubbock, TX 79409, USA
2
Center for Transformative Undergraduate Experiences, Texas Tech University, Lubbock, TX 79409, USA
3
Department of Teaching and Learning, University of Iowa, Iowa City, IA 52242, USA
4
Department of Mathematics and Statistics, Texas Tech University, Lubbock, TX 79409, USA
5
Teaching, Learning, & Professional Development Center, Texas Tech University, Lubbock, TX 79409, USA
*
Author to whom correspondence should be addressed.
Submission received: 12 January 2021 / Revised: 18 March 2021 / Accepted: 20 March 2021 / Published: 23 March 2021

Abstract

:
In higher education, Learning Assistants (LAs)—a relatively recent evolution grounded in peer mentorship models—are gaining popularity in classrooms as universities strive to meet the needs of undergraduate learners. Unlike Teaching Assistants, LAs are undergraduate students who receive continuous training from faculty mentors in content-area coaching and pedagogical skills. As near-peers, they assist assigned groups of undergraduates (students) during class. Research on LAs suggests that they are significant in mitigating high Drop-Fail-Withdrawal rates of large enrollment undergraduate science, technology, engineering, mathematics, and medical (STEMM) courses. However, there is a dearth of description regarding the learning between LAs and STEMM faculty mentors. This paper reports on perspectives of faculty mentors and their cooperating LAs in regard to their learning relationships during a Calculus II at a research-oriented university during Spring of 2020. Using an exploratory-descriptive qualitative design, faculty (oral responses) and LAs (written responses) reflected on their relationship. Content analysis (coding) resulted in four salient categories (by faculty and LA percentages, respectively) in: Showing Care and Fostering Relationships (47%, 23%); Honing Pedagogical Skills (27%, 36%); Being Prepared for Class and Students (23%, 28%); and Developing Content Knowledge in Calculus (3%, 13%). Benefits of LAs to faculty and ways to commence LA programs at institutions are also discussed.

1. Introduction

There has been a shift in higher education to identify and implement improved supports for faculty teaching introductory-level, large enrollment courses for undergraduates, especially within the science, technology, engineering, mathematics and medical (STEMM) disciplines [1]. The initial credit-bearing college-level courses for degrees in STEMM are colloquially known as ‘gateway’ courses. Unfortunately, these foundational classes often bar students from progressing into future STEMM coursework or completing their STEMM degrees [2,3,4]. These gateway or barrier STEMM courses have had historically and persistently high Drop-Fail-Withdrawal (DFW) rates [5], which often dissuade undergraduates from continuing in their STEM majors or collegiate studies [6]. One such STEMM-based gateway course is calculus, in which up to one fourth of undergraduates fail and are unable to matriculate into further STEMM coursework, often leading them to longer degree completion [7] or causing to change majors and forgo their pursuit of a STEMM future [8,9]. Therefore, educators in tertiary education are seeking means to mitigate STEMM student attrition by improving undergraduates’ learning experiences in these foundational STEMM courses [10,11].
Research suggests that in-class experiences (e.g., active versus passive learning, lecture-driven versus activity-driven) and supports (greater interaction with more capable peers) can greatly influence students’ affective and learning experiences in STEMM [12,13,14], especially in Calculus [10,15], and among historically under-represented groups (e.g., first generation, racial, ethnic and gender minorities) in STEMM [16,17,18,19].
One common strategy among institutions of higher education to support undergraduate education in STEMM has been employing Teaching Assistants (TAs). In the United States, TAs are responsible for as much as 91% of undergraduate instruction in STEM courses [20], especially among the introductory (gateway) courses [21,22]. Typically, TAs are discipline-specific graduate students that assist faculty in STEMM courses by preparing answer keys or supplemental course materials, taking attendance, proctoring examinations, grading student assignments and tests, recordkeeping (e.g., taking attendance, posting scores), holding office hours, and/or assuming teaching responsibilities in laboratory or recitation sections [23,24,25,26,27]. Notably, few of the TAs’ duties take place during class when the faculty member is providing instruction directly to students. This note is important as studies indicate that TAs are most effective when they directly interact with students, either as content experts for tutoring or providing real-time affective encouragement [28]. Hazari et al. ([29], p. 27) similarly found that the greater interaction between TAs and students in class, led to more positive outcomes for students. They concluded that, “given sufficient knowledge of the material, TAs must be encouraged to be proactive in interacting with their students, and to pay attention to affective issues; friendliness, appropriate use of encouragement and language, exhibitions of interest or enthusiasm.” These aforementioned studies suggest that greater interaction between more capable peers and students is warranted. Rather than the ‘behind the scenes’ work of traditional TAs, there are needs in providing the content reinforcement and affective supports to best encourage and sustain undergraduate student learning in STEMM.
One such iteration of the TA model, which intends to address the needs for enhanced interaction between students and in-class, is the Learning Assistant (LA) program [30]. Originating out of the University of Colorado Boulder [31], LAs are ‘near peers,’ meaning, undergraduate students who recently completed a STEMM course successfully (evidenced by high grades or mastery of the course material) with an interest in growing their STEMM content knowledge and pedagogical skills. As such, they are mentored weekly on STEMM content by the professor of the course (content faculty mentor) and a second professor that coaches them on best practices in student-based, in-class supports (pedagogical faculty mentor). Herein, STEMM faculty members who work with LAs are referred to collectively as simply faculty mentors. Throughout the semester, LAs meet weekly with their faculty mentors and write weekly journal entries to discuss and reflect upon their experiences supporting their undergraduate STEMM students (therein simply ‘students’). Research on LAs indicates that they are effective in reducing DFW rates [32,33], enhancing student interaction and generative conversations in class [34], as well as improving both student satisfaction and achievement [35,36,37] in STEMM courses.
Further, it may be unsurprising that research has found additional positive outcomes for LAs as STEMM students beyond the obvious benefits for the peers they serve. Studies by Nadelson and Finnegan [38] as well as Close et al. [39] found through independent studies that undergraduates who had served as an LA held more generative perspectives on the purpose of learning (focusing on mastery of concepts than recitation of facts) and developed a strong professional identity in STEM as well as in their content area (of Physics), respectively. Some institutions are leveraging the LA program to prepare future STEMM teachers [40,41,42,43,44]. An important contributing element to these outcomes is the relationships between LAs and their faculty mentors. McHenry et al. ([45], p. 258) found in their preliminary study of LAs and faculty mentors that there was “a broadening of both the faculty and LA conceptions about teaching and learning,” suggesting a reciprocal nature of learning occurring between these two groups. Sabella et al. [46] in a self-study of the LA program at Chicago State University explored the nature of relationships between LAs and content faculty mentors, finding that faculty who were most willing to relinquish some degree of control over the classroom had the most collaborative partnerships with their LAs. They cautioned that the release of responsibility onto the LA for pedagogical decisions is difficult, yet necessary, for faculty to best utilize LAs in undergraduate STEMM courses. Conceptually, this trust is important between LAs and faculty because it is through close-knit and regular coaching, coupled with avenues to exercise agency, in which LAs gain ownership over their work with students. This ownership is a vital first step in having students gain not only autonomy, but also empowerment [47,48]. Thus, LAs are able to garner additional knowledge and skills through expanded avenues of access (in-class, with students) that enhance their ability to function [49] and remain committed to that work [50].
This research sought to extend the work of Sabella et al. by taking a deeper look into the learning that occurs from the relationships between faculty mentors and LAs. To that end, we qualified the types of learning (i.e., content and pedagogical strategies in teaching undergraduate STEMM students) that occurred between these groups by exploring mentor faculty’s and LAs’ perceptions of their professional relationship (i.e., educating STEMM undergraduate students). Through a faculty mentor focus group and data from LAs’ written reflections and open-ended questionnaire, we sought to categorize the learning that occurred between two STEMM faculty members and their 10 LAs supported Calculus II course at Texas Tech University in Spring of 2020, which began with face-to-face interactions and abruptly transitioned to an all-virtual format. By gathering data on the perspectives of faculty and LAs independently, we are able to categorize and juxtapose their perceived outcomes of the learning gained through their professional relationship, and evidenced by serving STEMM undergraduate students in the classroom. Findings of this research provide a greater visualization of the research-based affordances of the LA program to both STEMM students and LAs working with faculty mentors. Further, this research provides insight to best practices in most effectively relating to LAs for STEMM faculty members who are working in or considering LA programs at their institution.

2. Materials and Methods

To describe the nature of the learning between faculty mentors and their LAs, an exploratory-descriptive qualitative (EDQ) design was used to collect and analyze data [51]. EDQ is particularly useful to both explore and describe dual perspectives, like between nurse and patient, or in this case, STEMM faculty mentors and LAs. Since the work is exploratory and descriptive, a content analysis approach was selected as it is able to: (1) explore the commonalities within the data [52] and (2) provide “a descriptive approach in both coding of the data and its interpretation of quantitative counts of the codes” ([53], p. 400). Further, content analysis is a useful approach to analyze text-based data [54] to explore salient meanings (categories) and their frequency [55]. By engaging in a content analysis, textual information highlights relationships through the perspectives and thoughts within each group of participants of study [56]. Due to the exploratory and qualitative nature of the study, an inductive approach was selected to code the data [57].
Text data were comprised of responses from two groups: two STEMM faculty mentors (focus group) and 10 of their cooperating LAs (written reflections and an open-ended questionnaire). This group represents a portion of the LA program at Texas Tech University that serves STEMM undergraduate students for Calculus II and Chemistry II. These three qualitative sources of data were appropriate for a content analysis [58] and provided insight to the learning that occurred between these groups from each perspective. This study is a part of a larger set of studies about LAs [59], therefore, Institutional Review Board approval was sought and gained for the protection of research participants prior to data collection for analysis and interpretation.
STEMM faculty mentor data were sourced from a transcript of a 40 min online focus group (using video conference software) with STEMM faculty members, reflecting together on their experiences coaching and mentoring the Calculus II LAs in the Spring and Summer of 2020. Recall that the LA system consists of one faculty member serving as the content mentor and the other faculty member as a pedagogical mentor. Both faculty mentors were prompted during the focus group to discuss the types of coaching and mentoring they provided to LAs in Spring of 2020; they also co-constructed understandings of what they had learned, from LAs, during the process. One faculty member is a professor of mathematics with 20 years of experience at the University. He also serves as the department coordinator for Calculus II. The other faculty member teaches courses in cell biology, genetics, and human physiology; he serves as the director of a faculty development program for best practices in teaching STEM and the LA program within the university center for teaching and learning.
Text data from LAs were sourced from weekly written reflections that they had made as a part of their LA program and their responses to an online open-ended questionnaire after the course concluded in Summer of 2020. Ten LAs (out of 13 total LAs) participated in the study by both recording weekly reflections (emailed to mentor faculty and researchers) during the Spring term and responding to the open-ended questionnaire in the Summer term. The sampled LAs were all undergraduate students who had recently taken Calculus II, evidenced mastery of the material (achieving a grade of As and Bs in previous Calculus courses), and expressed interest in serving as an LA. Notably, LA applicants were screened for their responses to multiple open-ended questions. These questions were critical in determining the applicants’ abilities to communicate effectively [60]. Each participant was given a number for data curation purposes and to provide the reader evidence many different responses contributed to the data analysis. Among the four female LA participants, two identified as white (participants 1 and 2) and two as Latinas (participants 3 and 4). Among the six men, three identified as white (participants 5, 6, and 7), one as Latino (participant 8), one as African (participant 9), and one as Southeast Asian (participant 10).
Data (in transcript form) were read thrice to explore the texts’ descriptions of experiences of learning vis à vis from faculty mentors and/or LA relationships. From the first pass through the data (i.e., the preparation step of content analysis), 83 relevant pieces of data (i.e., statements from STEMM faculty mentors and writing from the LAs) were pulled into an excel sheet for researchers’ analyses, parsed by the faculty mentors’ (n = 30) and LAs’ (n = 53) responses. In the second pass (i.e., the organizing step of content analysis), four salient categories emerged. Per the content analysis method, categories express the descriptive or manifest content found within text [61], “based on the frequency of its occurrence in the text. This approach is objective, systematic, and concerned with the surface meaning of the document” ([53], p. 403). In the third pass, data were coded (by a single researcher) and then intercoded (by a second researcher). Frequencies of statements, per each category, were summed (frequency count) and averaged (for percentages). Data tables were produced to highlight the relationships that emerged from the data and to address the research purpose (see Table 1, Table 2, Table 3 and Table 4 in Section 3, the results).
Hunter et al. ([51], p. 7) have argued that the “criticality and integrity of EDQ can be enhanced by reflecting on researcher bias, respondent validation, and peer review,” which can be translated as elements of credibility, dependability, and confirmability of trustworthiness, respectively [62]. To meet the mandate of trustworthiness, the credibility of the EDQ design was met by collecting and analyzing the data per the three recommendations by Milne and Oberle ([63], p. 415) in “that (1) participants had the freedom to speak, (2) participants’ voices were heard, and (3) participants’ perceptions were accurately represented.” Each data type (i.e., focus group data and written reflections) both recorded and related participants’ voices and thoughts; hence, the group (rather than any one individual) was adequately represented in the analysis. In regard to dependability, a second researcher independently coded 67% of faculty mentor (n = 20) data and 75% of LA data (n = 40); as “it is widely acknowledged that intercoder reliability is a critical component of content analysis” ([64], p. 589). The intercoder analysis yielded a percent agreement of 85% and 83%, respectively, exceeding the 80% threshold for dependability values [65]. The intercoder’s disagreements were reviewed by the primary researcher, in which his feedback was incorporated into the final coding and codes. In regard to confirmability, an audit trail was established to demonstrate how representative the responses (i.e., representative responses) were among sampled participants in Table 1Table 2 and Table 3. Since there were only two faculty mentors interviewed, the audit trail consisted of time stamps made in their focus group. For the LAs, the audit trail consisted of use of their assigned number by data type (i.e., questionnaire in Table 2 and journal data in Table 3). Notably, both researchers who conducted the data analysis were external to (and not affiliated with) the Calculus II and LA programs, such to mitigate opportunities for bias.

3. Results

Table 1, Table 2, Table 3 and Table 4 display the four salient categories between STEMM faculty mentors (Table 1), LAs (Table 2 and Table 3). Each table is replete with frequency, percentage, and representative statements (Table 1), responses (Table 2), and passages (Table 3) (based upon the data types) to highlight the nature of the relationships and learning that occurred between sampled groups. Table 4 provides a juxtaposed view of all data (responses) to describe learning transfers between groups. Capital and italicized N represents the entire data set of statements (N = 83), whereas lowercase and italicized n is used to show the sub-sample size of statements by learning categories and participant groups.

3.1. STEMM Faculty Mentors’ Perspectives

The largest category discussed between the two STEMM faculty mentors was supporting LAs learning to show care for and foster relationships with their STEMM students (n = 14), followed by honing pedagogical skills (n = 8), being prepared for class and students (n = 7), and developing their content knowledge (n = 1). Table 1 provides descriptive statistics (i.e., frequency counts with percentages) and representative statements from the focus group that typified each of the categorizations.

3.2. STEMM LAs’ Perspectives

Table 2 and Table 3 describe the perspectives shared by LAs in regard to learning with and from their STEMM faculty mentors. Data from the open-ended questionnaire (Table 2) indicated that the largest category with almost half of the responses was honing pedagogical skills (n = 7). One fourth of responses were about the importance of showing care for and fostering relationships with their STEMM students (n = 4), followed by being prepared for class and students (n = 3), and developing their content knowledge (n = 2). Table 2 provides descriptive statistics and representative responses that typified the categorization.
Data from the weekly journal entries show that honing pedagogical skills (n = 12) and being prepared for class and students (n = 12) tied as the top category in the weekly journal data (Table 3). To a lesser extent, the LAs described the importance of learning to show care for and foster relationships with their STEMM students (n = 8) and developing their own content knowledge (n = 5). Table 3 provides representative passages pulled from LAs’ journal entries that typified the categorization with descriptive statistics.

3.3. Comparative Perspectives

Data from both groups are juxtaposed to display the categorizations (of learning) between STEMM faculty mentors and their LAs. Table 4 summarizes data from the previous three tables to provide a summary view of aggregated responses from both the faculty members and LAs. In total, three of the four categories had near equal representation in the total data set: honing pedagogical skills (n = 27); showing care and fostering relationships (n = 26); and being prepared for class and students (n = 22). Developing content knowledge had the least amount of representation (n = 8).

3.4. Limitations

Limitations of this study relate to the qualitative nature of the data and the choices for data analysis. With this study being a qualitative and perception-based, there is no impetus to generalize these results beyond the study context to a larger group of individuals. By taking an exploratory route, we strived to identify areas of research interest that can be addressed through larger, quantitative means. Second, by use of a categorical (rather than thematic) analysis, the descriptions are at face value (categories) rather than implying there are latent meanings or subtext (themes) [61]. Again, being an exploratory study, an open-ended coding schema [57] via content analysis [58] was the best analytical choice for the research design and questions. Therefore, it is presently unknown to what extent there are latent attributes within the data set.

4. Discussion

This study sought to explore and describe the perceptions of learning that occurred between STEMM mentor faculty’s and their LAs’ within a professional relationship of educating STEMM undergraduate students. The EDQ design and content analysis of data from faculty mentors (focus group) and their LAs (journal entries and open-ended questionnaire), suggests that the learning resulting from their relationship (in faculty and LA percentages) related to four salient categories: showing care and fostering relationships (47%, 23%); honing pedagogical skills (27%, 36%); being prepared for class and students (23%, 28%); and developing content knowledge in calculus (3%, 13%). This study suggests that within relationships that occur between STEMM faculty mentors and their LAs, their interactions (e.g., communication, correspondence, teaching and mentoring) were largely focused on developing relationships with students. Not only does this indicate that STEMM faculty mentors and their LAs have similar goals in their support paradigm for STEMM student success, but also indicate how they comparably assess their efficacy in the STEMM classroom. This has implications when selecting for LAs in STEMM subjects, meaning, a relationship-focused personality may be as important as advanced content knowledge. Although there was some variance between groups in category frequency (e.g., faculty mentors ranked showing care higher than pedagogical skills as compared to students); together, the frequencies of the first three categories were roughly equivalent. Notably, pedagogy and preparation together represent important elements for in-class STEMM learning. These findings track with previous research on LAs’ pedagogical expertise, that they need training and experiences in prompting students’ thinking through formative assessment [66]. Prior research and our findings suggest that the fact that LAs are still students themselves, which does not in-and-of-itself indicate that they understand the innerworkings of teaching and learning in higher education. A study by McHenry et al. [45] of an early LA program found that—despite being near-peers—LAs needed ongoing and on-the-job training to help their students learn STEMM content that they had already mastered. We recommend that greater opportunities be afforded to LAs to continue growing in their content knowledge, as it is situated within teaching and learning. This may explain why developing content knowledge, a positive and perhaps necessary component of learning as LA, had the fewest codes and frequency. Perhaps this is because having a high level of content knowledge (mastery) is a prerequisite skill for the LA program [30,31,67]. The faculty mentors’ statements (from Table 1) suggest that LAs would benefit from greater mentoring and coaching in STEMM content knowledge, and sampled LAs had identified that being an LA was an opportunity to grow in their content knowledge in STEMM (from Table 2 and Table 3). It is interesting to note that STEMM faculty mentors and LAs were in agreement that pedagogical knowledge was more important than extending one’s content knowledge. This finding emphasizes that despite LAs being selected for their prior knowledge in STEMM, there is an explicit need for opportunities among LAs to train and practice their nascent pedagogical skills in the undergraduate STEMM classroom. We recommend when selecting for LAs, the potential for pedagogical learning should be considered when selecting LAs that have STEMM content knowledge. We echo recommendations from the Learning Assistant Alliance that content (alongside pedagogical) coaching ensures LAs are receiving the needed background in STEMM content to feel and be effective with their undergraduate STEMM students [68].
The most salient category was showing care for and fostering relationships with students. This sole category was representative of nearly half of the mentor faculty’s data and one fourth of the LAs’ data. Similarly, Top’s ([69], p. iii) “research found that LAs bring class, content, and institutional knowledge into their interactions with students as well as cultivating personal relationships with students [emphasis added] and employing pedagogical skills in the classroom” as the three central components of her model for LA effectiveness. This indicates that LAs are moving beyond diffusing in-class conflicts [70], towards sources of genuine encouragement for STEMM students [30]. These types of discussions about supporting students, between faculty mentors and LAs, may also help to consolidate their purpose (in teaching) and forge their own relationships, affirming their values (to learning). Schick ([30], p. 24) concluded from her research on LAs at Montgomery College that “LAs form positive relationships with their faculty mentors, helping them to grow and mature along their academic paths. STEM classes are [thusly] transformed into more student-centered active learning and collaborative environments, increasing the potential for student success.” Hence, this research study contributes to the literature by emphasizing the prominent importance of cultivating relationships not only between faculty mentors and LAs, but also with undergraduate students themselves. In particular, this adds to the literature on peer-to-peer mentoring because these findings reinforce the importance of nurturing non-cognitive needs of students, from their LAs, in undergraduate STEMM support programs.
Prior research and the findings from this study suggest that the field may be viewing the mentor faculty-LA relationship in reverse. Rather than focusing on student success and moving backwards in developing LAs, we must first build foundational relationships between STEMM faculty mentors and LAs so LAs can feel supported and empowered in meeting the common goal of creating student-centered, active-learning environments with their STEMM faculty in undergraduate STEMM courses. Additionally, we should recruit LAs that not only have content knowledge, but also the potential for building pedagogical skills and valuing the importance of forging relationships with students. Sabella et al. [46] found that when faculty mentors actively collaborated with their LAs, those relationships yielded the best results for the parties involved as well as their STEMM students. We would suggest that relationship and community building is an important and mirrored—even perhaps reciprocal—type of learning that occurs between STEMM faculty mentors and their LAs. Further research is warranted to more deeply explore how categories of learning influence LA agency, learning, motivation, and persistence in the LA program, as well as moderating student learning outcomes in STEMM. For example, a longitudinal study on students’ STEMM learning outcomes when recruiting LAs through different selection factors (e.g., those with relationship-focused dispositions and a potential for garnering pedagogical expertise) than only content proficiency. Such a study would broaden participation of students in LA programs and strengthen claims that relational mindedness is a vital disposition among STEMM faculty mentors and LAs when effectively serving undergraduate STEMM students.

5. Conclusions

This study sought to explore the perceptions of learning that occurred between LAs and their STEMM faculty mentors from their professional working relationship and situated to a university-level mathematics course. We believe that these relationships are part of the larger conversation of mentoring in STEMM subjects [71]. Per the National Academies of Sciences, Engineering, and Medicine, effective mentorship primarily includes building supports and trust, openly communicating expectations, as well as engaging in ongoing education and self-reflection [72]. We found in this research study that STEMM faculty mentors and LAs engaged in such reciprocal activities, which led to relationships with learning in four areas: showing care and fostering relationships; honing pedagogical skills; being prepared for class and students; and developing content knowledge in their chosen STEMM area. We believe that it is through these strong and positive relationships that LAs (and also cooperating faculty mentors) engaged in learning [73], with a common cause in supporting undergraduate STEMM learners. We note that the effort and learning is not just one direction, from faculty mentors to LAs. Rather, research suggests that professors who worked alongside LAs had new insights to teaching and learning [45], developing richer activities to enhance student engagement and collaborative learning in their classrooms [30]. Notably, we found a large degree of agreement of this study’s findings with current literature, although our STEMM faculty mentors and LAs experienced a rapid transition from face-to-face instruction and mentoring to an all-virtual delivery. Despite this fundamental change in interaction modality, this did not change what mentor faculty and LAs valued and prioritized in their professional, working relationships. Moreover, we are appreciably careful with our language to indicate that LAs who are working in tandem with faculty mentors in LA programs should enhance instruction, rather than supplant or change the professor. We acknowledge that “there is a risk that participating faculty members may feel they are being unfairly categorized as traditional instructors who [for example] solely lecture. Such messages, whether intended or not, can be off-putting to faculty and thus counterproductive to catalyzing change” ([74], p. 625]. Therefore, we echo recommendations made by Sabella et al. [46] and Schick [30] that LA programs should start small, with motivated faculty (serving as faculty mentors) and LAs who are motivated by (per this study) a common goal of showing care and fostering relationships with undergraduate STEMM learners.

Author Contributions

Conceptualization, R.H., L.J., R.C.L.V.; methodology (data collection), R.C.L.V., L.J., G.B.W., K.G.; data curation, R.H., L.J.; formal analysis, R.H.; writing—original draft preparation, R.H.; writing—review and editing, L.J., R.C.L.V.; project administration, R.H.; funding acquisition, L.J. All authors have read and agreed to the published version of the manuscript.

Funding

This research and APC charges were funded by The Center for Transformative Undergraduate Experiences at Texas Tech University in Summer 2020, grant title “High Impact Spark Award: Impact of Learning Assistants in STEM Courses” and a supplement to the National Science Foundation Award, grant title “Leveraging Learning Assistantships, Mentoring, and Scholarships to Develop Self-Determined Mathematics Techers for West Texas” (#1852944).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board at Texas Tech University under IRB2020-373 (approved on 20 April 2020) and IRB2020-625 (approved on 6 August 2020).

Informed Consent Statement

Participant written consent was waived due to IRB approval as an Exempt study, presenting minimal risk to study participants.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

The Learning Assistants who participated in this research study and the Learning Assistant Program at Texas Tech University.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. National Academies of Sciences, Engineering, and Medicine. Indicators for Monitoring Undergraduate STEM Education; The National Academies Press: Washington, DC, USA, 2018; pp. 1–244. ISBN 978-0-309-46791-9. [Google Scholar] [CrossRef]
  2. Norton, P.; Bridges, W.; High, K. Impact of course policy changes on calculus I DFW rates. J. STEM Educ. 2018, 19, 1–10. [Google Scholar]
  3. Seymour, E.; Hewett, N.M. Talking about Leaving. Why Undergraduates Leave the Sciences; Westview Press: Boulder, CO, USA, 1997; pp. 1–52. ISBN 0-8133-8926-7. [Google Scholar] [CrossRef]
  4. Suresh, R. The relationship between barrier courses and persistence in engineering. J. Coll. Student Retent. Res. Theory Pract. 2006, 8, 215–239. [Google Scholar] [CrossRef]
  5. Webb, D.C.; Stade, E.; Grover, R. Rousing students’ minds in postsecondary mathematics: The undergraduate learning assistant model. J. Math. Educ. Teach. Coll. 2014, 5, 39–48. [Google Scholar] [CrossRef]
  6. Crisp, G.; Nora, A.; Taggart, A. Student characteristics, pre-college, college, and environmental factors as predictors of majoring in and earning a STEM degree: An analysis of students attending a Hispanic serving institution. Am. Educ. Res. J. 2009, 46, 924–942. [Google Scholar] [CrossRef]
  7. Chen, X.; Weko, T. Students Who Study Science, Technology, Engineering, and Mathematics (STEM) in Postsecondary Education (NCES 2009-161); Department of Education, National Center for Education Statistics (NCES): Washington, DC, USA, 2009; pp. 1–25. [Google Scholar]
  8. Bressoud, D.M.; Carlson, M.P.; Mesa, V.; Rasmussen, C. The calculus student: Insights from the Mathematical Association of America national study. Int. J. Math. Educ. Sci. Technol. 2013, 44, 685–698. [Google Scholar] [CrossRef]
  9. Rasmussen, C.; Ellis, J. Who is switching out of calculus and why. In Proceedings of the 37th Conference of the International Group for the Psychology of Mathematics Education, Kiel, Germany, 28 July–2 August 2013; Volume 4, pp. 73–80. [Google Scholar]
  10. National Academy of Engineering and National Research Council. Community Colleges in the Evolving STEM Education Landscape: Summary of a Summit; The National Academies Press: Washington, DC, USA, 2012; pp. 1–156. ISBN 978-0-309-25658-2. [Google Scholar] [CrossRef]
  11. National Academies of Science, Engineering, and Medicine. Imagining the Future of Undergraduate STEM Education Symposium. In Proceedings of the Imagining the Future of Undergraduate STEM Education Symposium, Washington, DC, USA, 12–13 November 2020. [Google Scholar]
  12. Freeman, S.; Eddy, S.; McDonough, M.; Smith, M.K.; Okoroafor, N.; Jordt, H.; Wenderoth, M.P. Active learning increases student performance in science, engineering, and mathematics. Proc. Natl. Acad. Sci. USA 2014, 111, 8410–8415. [Google Scholar] [CrossRef] [Green Version]
  13. National Academies of Science, Engineering, and Medicine. Barriers and Opportunities for 2-Year and 4-Year STEM Degrees: Systemic Change to Support Students’ Diverse Pathways; The National Academies Press: Washington, DC, USA, 2016; pp. 1–214. ISBN 978-0-309-37360-9. [Google Scholar] [CrossRef]
  14. Wu, X.; Deshler, J.; Fuller, E. The effects of different versions of a gateway STEM course on student attitudes and beliefs. Int. J. STEM Educ. 2018, 5, 1–12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Bertrand, E.; McArdle, D.T.; Thoma, L.; Wu, L. Implementing Online Programs in Gateway Mathematics Courses for Students with Prerequisite Deficiencies. PRIMUS 2021, 31, 119–132. [Google Scholar] [CrossRef]
  16. Ballen, C.J.; Wieman, C.; Salehi, S.; Searle, J.B.; Zamudio, K.R. Enhancing diversity in undergraduate science: Self-efficacy drives performance gains with active learning. CBE Life Sci. Educ. 2017, 16, ar56. [Google Scholar] [CrossRef] [PubMed]
  17. Chelberg, K.L.; Bosman, L.B. The role of faculty mentoring in improving retention and completion rates for historically underrepresented STEM students. Int. J. High. Educ. 2019, 8, 39–48. [Google Scholar] [CrossRef]
  18. Cole, D. The effects of student-faculty interactions on minority students’ college grades: Differences between aggregated and disaggregated data. J. Profr. 2010, 3, 137–160. [Google Scholar]
  19. National Academy of Sciences, National Academy of Engineering, and Institute of Medicine. Expanding Underrepresented Minority Participation: America’s Science and Technology Talent at the Crossroads; The National Academies Press: Washington, DC, USA, 2011; pp. 1–214. ISBN 978-0-309-37360-9. [Google Scholar] [CrossRef]
  20. Sundberg, M.D.; Armstrong, J.E.; Eischusen, E.W. A reappraisal of the status of introductory biology laboratory education in US colleges and universities. Am. Biol. Teach. 2005, 67, 525–529. [Google Scholar] [CrossRef]
  21. Gardner, G.E.; Jones, M.G. Pedagogical preparation of the science graduate teaching assistant: Challenges and implications. Sci. Educ. 2011, 20, 31–41. [Google Scholar]
  22. Wyse, S.A.; Long, T.M.; Ebert-May, D. Teaching assistant professional development in biology: Designed for and driven by multidimensional data. CBE—Life Sci. Educ. 2014, 13, 212–223. [Google Scholar] [CrossRef] [Green Version]
  23. TA Roles and Responsibilities. Available online: https://www.unl.edu/gtahandbook/ta-roles-and-responsibilities (accessed on 12 January 2021).
  24. Guidelines for Duties and Evaluation of Graduate Assistants. Available online: https://www.american.edu/provost/grad/upload/ga-guidelines.pdf (accessed on 12 January 2021).
  25. Teaching Assistant Duties and Responsibilities American Cultures Studies (ACS) at BGSU. Available online: https://www.bgsu.edu/content/dam/BGSU/college-of-arts-and-sciences/cultural-and-critical-studies/documents/teaching-assistantship.pdf (accessed on 12 January 2021).
  26. Responsibilities of Teaching Assistants. Available online: http://www.ece.ucsd.edu/graduate/responsibilities-of-teaching-assistants (accessed on 12 January 2021).
  27. Graduate Teaching Assistant/Associate (TA) Job Description. Available online: https://graduate.asu.edu/sites/default/files/teaching_assistant_associate_job_description.pdf (accessed on 12 January 2021).
  28. Wheeler, L.B.; Maeng, J.L.; Chiu, J.L.; Bell, R.L. Do teaching assistants matter? Investigating relationships between teaching assistants and student outcomes in undergraduate science laboratory classes. J. Res. Sci. Teach. 2017, 54, 463–492. [Google Scholar] [CrossRef]
  29. Hazari, Z.; Key, A.W.; Pitre, J. Interactive and affective behaviors of teaching assistants in a first year physics laboratory. Electron. J. Res. Sci. Math. Educ. 2003, 7, 1–38. [Google Scholar]
  30. Schick, C.P. Trying on Teaching: Transforming STEM Classrooms with a Learning Assistant Program. In Strategies Promoting Success of Two-Year College Students; Anna, L.J., Higgins, T.B., Palmer, A., Owens, K.S., Eds.; American Chemical Society: Washington, DC, USA, 2018; pp. 3–27. ISBN 9780841232914. [Google Scholar] [CrossRef] [Green Version]
  31. Learning Assistant Alliance. Available online: https://www.learningassistantalliance.org/ (accessed on 12 January 2021).
  32. Alzen, J.L.; Langdon, L.; Otero, V. The Learning Assistant model and DFW rates in introductory physics courses. In Proceedings of the 2017 Physics Education Research Conference; AIP Press: Melville, NY, USA, 2017; pp. 36–39. [Google Scholar] [CrossRef] [Green Version]
  33. Alzen, J.L.; Langdon, L.S.; Otero, V.K. A logistic regression investigation of the relationship between the Learning Assistant model and failure rates in introductory STEM courses. Int. J. STEM Educ. 2018, 5, 1–12. [Google Scholar] [CrossRef]
  34. Knight, J.K.; Wise, S.B.; Rentsch, J.; Furtak, E.M. Cues matter: Learning assistants influence introductory biology student interactions during clicker-question discussions. CBE Life Sci. Educ. 2015, 14, 1–14. [Google Scholar] [CrossRef] [Green Version]
  35. Talbot, R.M.; Hartley, L.M.; Marzetta, K.; Wee, B.S. Transforming undergraduate science education with learning assistants: Student satisfaction in large-enrollment courses. J. Coll. Sci. Teach. 2015, 44, 24–30. [Google Scholar]
  36. Thompson, M.M.; Garik, P. The effect of learning assistants on student learning outcomes and satisfaction in large science and engineering courses. In Proceedings of the Annual International Conference of the National Association of Research in Science Teaching 2015, Chicago, IL, USA, 11–14 April 2015. [Google Scholar]
  37. Sellami, N.; Shaked, S.; Laski, F.A.; Eagan, K.M.; Sanders, E.R. Implementation of a learning assistant program improves student performance on higher-order assessments. CBE Life Sci. Educ. 2017, 16, 1–10. [Google Scholar] [CrossRef] [Green Version]
  38. Nadelson, L.S.; Fannigan, J. Path Less Traveled: Fostering STEM Majors’ Professional Identity Development through Engagement as STEM Learning Assistants. J. High. Educ. Theory Pract. 2014, 14, 1–13. [Google Scholar]
  39. Close, E.W.; Conn, J.; Close, H.G. Becoming physics people: Development of integrated physics identity through the Learning Assistant experience. Phys. Rev. Phys. Educ. Res. 2016, 12, 010109. [Google Scholar] [CrossRef]
  40. Gray, K.E.; Webb, D.C.; Otero, V.K. Effects of the Learning Assistant Experience on In-Service Teachers’ Practices; American Institute of Physics: Washington, DC, USA, 2012; pp. 199–202. [Google Scholar] [CrossRef]
  41. Gray, K.E.; Webb, D.C.; Otero, V.K. Effects of the learning assistant model on teacher practice. Phys. Rev. Phys. Educ. Res. 2016, 12, 020126. [Google Scholar] [CrossRef] [Green Version]
  42. Otero, V.; Pollock, S.; Finkelstein, N. A physics department’s role in preparing physics teachers: The Colorado learning assistant model. Am. J. Phys. 2010, 78, 1218–1224. [Google Scholar] [CrossRef] [Green Version]
  43. Otero, V.; Pollock, S.; McCray, R.; Finkelstein, N. Who is responsible for preparing science teachers? Science 2006, 313, 445–446. [Google Scholar] [CrossRef] [Green Version]
  44. Leveraging Learning Assistantships, Mentoring, and Scholarships to Develop Self-Determined Mathematics Teachers for West Texas. Available online: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1852944&HistoricalAwards=false (accessed on 12 January 2021).
  45. McHenry, N.; Martin, A.; Castaldo, A.; Ziegenfuss, D. Learning Assistants Program: Faculty Development for Conceptual Change. Int. J. Teach. Learn. High. Educ. 2010, 22, 258–268. [Google Scholar]
  46. Sabella, M.S.; Van Duzor, A.G.; Davenport, F. Leveraging the expertise of the urban STEM student in developing an effective LA Program: LA and Instructor Partnerships. In Proceedings of the 2016 Physics Education Research Conference, Sacramento, CA, USA, 20–21 July 2016; pp. 1–4. [Google Scholar] [CrossRef] [Green Version]
  47. Price, S.; Wallace, K.; Verezub, E.; Sinchenko, E. Student learning assistants: The journey from learning advice to creating community. J. Furth. High. Educ. 2019, 43, 914–928. [Google Scholar] [CrossRef]
  48. Miller, K.A. Building Honors Contracts: Insights and Oversights; National Collegiate Honors Council Monograph Series: Lincoln, NE, USA, 2020; pp. 55–80. [Google Scholar]
  49. Chittum, J.R.; Jones, B.D.; Carter, D.M. A person-centered investigation of patterns in college students’ perceptions of motivation in a course. Learn. Individ. Differ. 2019, 69, 94–107. [Google Scholar] [CrossRef]
  50. Yeager, V.A.; Wisniewski, J.M. Factors that influence the recruitment and retention of nurses in public health agencies. Public Health Rep. 2017, 132, 556–562. [Google Scholar] [CrossRef] [PubMed]
  51. Hunter, D.; McCallum, J.; Howes, D. Defining Exploratory-Descriptive Qualitative (EDQ) research and considering its application to healthcare. J. Nurs. Health Care 2019, 4, 1–8. [Google Scholar]
  52. Green, J.; Thorogood, N. Analysing qualitative data. In Qualitative Methods for Health Research, 1st ed.; Silverman, D., Ed.; Sage Publications: London, UK, 2004; pp. 173–200. [Google Scholar]
  53. Vaismoradi, M.; Turunen, H.; Bondas, T. Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nurs. Health Sci. 2013, 15, 398–405. [Google Scholar] [CrossRef]
  54. Powers, B.; Knapp, T. Dictionary of Nursing Theory and Research, 4th ed.; Springer Publishing Company: New York, NY, USA, 2011; pp. 1–207. ISBN 978-0-8261-0666-7. [Google Scholar]
  55. Gbrich, C. Qualitative Data Analysis: An Introduction, 1st ed.; Sage Publications: London, UK, 2007; pp. 1–264. ISBN 978-1412921435. [Google Scholar]
  56. Bloor, M.; Wood, F. Keywords in Qualitative Methods: A Vocabulary of Research Concepts, 1st ed.; Sage Publications: London, UK, 2006; pp. 1–191. ISBN 10-0-7619-4331-5. [Google Scholar]
  57. Hsieh, H.F.; Shannon, S.E. Three approaches to qualitative content analysis. Qual. Health Res. 2005, 15, 1277–1288. [Google Scholar] [CrossRef] [PubMed]
  58. Bengtsson, M. How to plan and perform a qualitative study using content analysis. NursingPlus Open 2016, 2, 8–14. [Google Scholar] [CrossRef] [Green Version]
  59. Hite, R.; Childers, G.; Gottlieb, J.; Velasco, R.; Johnson, L.; Williams, B.; Griffith, K.; Dwyer, J. Shifts in Learning Assistants’ Self-Determination Due to COVID-19 Disruptions in Calculus II Course Delivery. Under review.
  60. STEP Learning Assistant Application. Available online: https://www.depts.ttu.edu/tlpdc/Programs/STEP/STEP_LA_Program/STEP_LA_App.php (accessed on 22 March 2021).
  61. Graneheim, U.; Lundman, B. Qualitative content analysis in nursing research: Concepts, procedures and measures to achieve trustworthiness. Nurse Educ. Today 2004, 24, 105–112. [Google Scholar] [CrossRef]
  62. Lincoln, Y.S.; Guba, E.G. Naturalistic Inquiry; Sage Publications: Newbury Park, CA, USA, 1985; pp. 1–416. ISBN 978-0803924314. [Google Scholar]
  63. Milne, J.; Oberle, K. Enhancing rigor in qualitative description: A case study. J. Wound Ostomy Cont. Nurs. 2005, 32, 413–420. [Google Scholar] [CrossRef] [PubMed]
  64. Lombard, M.; Snyder-Duch, J.; Bracken, C.C. Content analysis in mass communication: Assessment and reporting of intercoder reliability. Hum. Commun. Res. 2002, 28, 587–604. [Google Scholar] [CrossRef]
  65. Lavrakas, P.J. Encyclopedia of Survey Research Methods, 1st ed.; Sage Publications: Thousand Oaks, CA, USA, 2008; pp. 1–1072. ISBN 978-1412918084. [Google Scholar]
  66. Top, L.M.; Schoonraad, S.A.; Otero, V.K. Development of pedagogical knowledge among learning assistants. Int. J. STEM Educ. 2018, 5, 1–18. [Google Scholar] [CrossRef] [Green Version]
  67. The General Program Elements. Available online: https://www.learningassistantalliance.org/modules/public/gpe.php#gpe4 (accessed on 12 January 2021).
  68. STEP LA Program. Available online: https://www.depts.ttu.edu/tlpdc/Programs/STEP/STEP_LA_Program/index.php (accessed on 22 March 2021).
  69. Top, L.M. From Invitation to Integration: A Model for Why Learning Assistants Are Valued by Members of Communities within Institutions. Ph.D. Thesis, University of Colorado, Bolder, CO, USA, 2019. [Google Scholar]
  70. Groccia, J.E.; Miller, J.E. Collegiality in the classroom: The use of peer learning assistants in cooperative learning in introductory biology. Innov. High. Educ. 1996, 21, 87–100. [Google Scholar] [CrossRef]
  71. National Academies of Sciences, Engineering, and Medicine. The Science of Effective Mentorship in STEMM; The National Academies Press: Washington, DC, USA, 2019; pp. 1–306. ISBN 978-0-309-49732-9. [Google Scholar] [CrossRef]
  72. Consensus Study Report on the Science of Effective Mentorship in STEM. Available online: https://www.nap.edu/resource/25568/ReportHighlights_Mentoring.pdf (accessed on 12 January 2021).
  73. Hsieh, H.C.; Hsieh, H.L. Undergraduates’ out-of-class learning: Exploring EFL students’ autonomous learning behaviors and their usage of resources. Educ. Sci. 2019, 9, 159. [Google Scholar] [CrossRef] [Green Version]
  74. Smith, M.K.; Vinson, E.L.; Smith, J.A.; Lewin, J.D.; Stetzer, M.R. A campus-wide study of STEM courses: New perspectives on teaching practices and perceptions. CBE Life Sci. Educ. 2014, 13, 624–635. [Google Scholar] [CrossRef] [Green Version]
Table 1. STEMM faculty mentors coding: category, frequency, percentage of total and example responses (n = 30).
Table 1. STEMM faculty mentors coding: category, frequency, percentage of total and example responses (n = 30).
Salient CategoryFrequencyPercent Representative Statement(s)
Showing Care and
Fostering Relationships
1447%“And so it’s really about them [LAs] sharing being able to share their experiences with how they struggled and overcame barriers
to the learning when they were taking the class.” (1:17)
Honing
Pedagogical Skills
827%“We spent a lot of time talking about how you recognize a
student that needs help, what sort of questions you asked
to get them to tell you that they need help [such] to force them to,
I guess, admit that they’re stuck kind of thing. And so that was mostly what our weekly trainings were on the pedagogy side,
both pre [before] and post [after class].” (10:45)
Being Prepared for
Class, Students
723%“So we met as a group and I would go through the PowerPoint [lecture of what] we’re going to do that week; to sort of explain where the pitfalls were what to be careful about what to emphasize. [We] make sure they know how to do this [content] because this is going to kind of thing is going to be on the test.” (7:45)
Developing
Content Knowledge
13%“So the LAs always had those [content] videos to watch ahead of time to sort of make sure they knew how to do the [Calculus] problems. But even then, they still had lots of questions.” (8:02)
Table 2. LA coding: category, frequency, percentage of total and example responses from questionnaire data (n = 16).
Table 2. LA coding: category, frequency, percentage of total and example responses from questionnaire data (n = 16).
Salient CategoryFrequencyPercentRepresentative Response(s)
Honing
Pedagogical Skills
744%“We take note and adapt to the students taking the class and make many decisions on the fly as opposed to just simply giving them [students] the materials and answers.” (participant 8)
Showing Care and
Fostering Relationships
425%“The faculty genuinely care about the students here, which is something I never expected to happen. In a large classroom, the LAs are often compared to TAs in the sense that they speak to the students instead of the professor. But, this is not at all what’s been happening with this course, and I love that so much.”
(participant 1)
Being Prepared for
Class, Students
319%“It is important to be prepared. Discussing with [faculty mentors] beforehand [has] really helped me out.” (participant 10)
Developing
Content Knowledge
212%“My knowledge on the content is limited. This is especially the case compared to my professor, but more importantly, each of the learning assistants seem to have their own perspectives as well. This is probably because we all mostly learned calculus in different places. Through this, my knowledge of the content has certainly become more diverse.” (participant 7)
Table 3. LA coding: category, frequency, percentage of total and example responses from journal data (n = 37).
Table 3. LA coding: category, frequency, percentage of total and example responses from journal data (n = 37).
Salient CategoryFrequencyPercent Representative Passage(s)
Honing
Pedagogical Skills
1232%“The quality of mentorship during this transition I believe has increased because I was able to witness how professors handled the stress of transitioning while maintaining calmness.” (participant 5)
Being Prepared for
Class, Students
1232%“I encourage active learning through the online modality by using verbal prompting and referring to examples that [faculty mentors] covered in [LA meeting and class] to answer their [students’] questions.” (participant 3)
Showing Care and
Fostering Relationships
822%“I am a fan of [Content Faculty Mentor]’s stories, and I love that he is trying to build a persona for the students to be comfortable with.” (participant 9)
Developing
Content Knowledge
514%“[Being an LA] has helped me grow in my
mathematics abilities.” (participant 6)
Table 4. Summary table of STEMM faculty and LA coding by salient categories (N = 83).
Table 4. Summary table of STEMM faculty and LA coding by salient categories (N = 83).
Study ParticipantsHoning Pedagogical Skills Showing Care and
Fostering Relationships
Being
Prepared for Class, Students
Developing
Content Knowledge
Two Faculty Members
(n = 30)
8 (27%)14 (47%)7 (23%)1 (3%)
Ten Learning Assistants
(n = 53)
19 (36%)12 (23%)15 (28%)7 (13%)
Total (N = 83)27 (33%)26 (31%)22 (27%)8 (9%)
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hite, R.; Johnson, L.; Velasco, R.C.L.; Williams, G.B.; Griffith, K. Supporting Undergraduate STEMM Education: Perspectives from Faculty Mentors and Learning Assistants in Calculus II. Educ. Sci. 2021, 11, 143. https://0-doi-org.brum.beds.ac.uk/10.3390/educsci11030143

AMA Style

Hite R, Johnson L, Velasco RCL, Williams GB, Griffith K. Supporting Undergraduate STEMM Education: Perspectives from Faculty Mentors and Learning Assistants in Calculus II. Education Sciences. 2021; 11(3):143. https://0-doi-org.brum.beds.ac.uk/10.3390/educsci11030143

Chicago/Turabian Style

Hite, Rebecca, Levi Johnson, Richard Carlos L. Velasco, G. Brock Williams, and Ken Griffith. 2021. "Supporting Undergraduate STEMM Education: Perspectives from Faculty Mentors and Learning Assistants in Calculus II" Education Sciences 11, no. 3: 143. https://0-doi-org.brum.beds.ac.uk/10.3390/educsci11030143

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop