Online Learning Research
Enhancing quality assurance in continuing education through an organisational cultural change
Article written by Clelia Paraluppi, Patricia Mancebo May, Ceyrine Pellikaan and Naomi Wahls and published in the European Journal of University Lifelong Learning (EJULL) as part of the EUCEN Conference 2023.
Abstract
The TU Delft Extension School for Continuing Education underwent a collaborative process
to strengthen its quality culture involving professionals and leaders working on designing,
developing and delivering its online courses. In this paper we describe the steps taken
towards an enhanced Quality Assurance (QA) system. A key part of the Extension School’s
strategy to guarantee excellence in its online courses is the continuous training provided for
instructors and teaching assistants who form the course teams. This is delivered in several
ways: specialised hands-on courses and dedicated portals, personal guidance throughout
the entire course development process, and an extensive offer of short trainings. This
approach contributes both to higher quality for our online courses and to the professional
development of our teaching staff, who bring their newly acquired experience and online
materials back to their in-campus courses. In this paper, we share the lessons learned on
establishing an organisational quality culture, defining QA standards and processes, and we
showcase how the professionalisation of instructors plays a pivotal role in offering high-quality education.
Keywords
Quality assurance, quality culture, continuing education, professional development, course development
Reference
Paraluppi, C., Mancebo May, P., Pellikaan, C. & Wahls, N. (2023) ENHANCING QUALITY ASSURANCE IN CONTINUING EDUCATION THROUGH AN ORGANISATIONAL CULTURAL CHANGE. European
Journal of University Lifelong Learning, 7(2), pp. 89-96. © eucen, 2023.
https://doi.org/10.53807/0702ADf6
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by-nc-sa/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator, the purposes are non-commercial and distribution of remixed, adapted or build upon material should be released under the same license.
Impact of MOOC and other online course development on campus education
Short paper written by Selma van Esveld, Nardo de Vries, Sibilla Becchetti, Sofia Dopper, and Willem van Valkenburg and presented by Selma van Esveld at EMOOCs 2023 in Potsdam, Germany. Article was published in the Proceedings of the Eighth EMOOCs Conference (EMOOCs 2023).
Abstract
The TU Delft Extension School for Continuing Education develops and delivers MOOCs, programs and other online courses for lifelong learners and professionals worldwide focused on Science, Engineering & Design. At the beginning of 2022, we started a project to examine whether creating an online course had any impact on TU Delft campus education. Through a survey, we collected feedback from 68 TU Delft lecturers involved in developing and offering online courses and programs for lifelong learners and professionals. The lecturers reported on the impact of developing an online course on a personal and curricular level. The results showed that the developed online materials, and the acquired skills and experiences from creating online courses, were beneficial for campus education, especially during the transition to remote emergency teaching in the COVID-19 lockdown periods. In this short paper, we will describe the responses in detail and map the benefits and challenges experienced by lecturers when implementing their online course materials and newly acquired educational skills on campus. Finally, we will explore future possibilities to extend the reported, already relevant, impact of MOOCs and of other online courses on campus education.
Keywords
COVID, impact of MOOCs, campus education, lifelong learning, teacher skills, open educational resources
Reference
van Esveld, S.; de Vries, N.; Becchetti, S.; Dopper, S.; van Valkenburg, W. (2023). EMOOCS 2023: POST-COVID PROSPECTS FOR MASSIVE OPEN ONLINE COURSES – BOOST OR BACKLASH? Proceedings of the Eighth EMOOCs Conference. https://doi.org/10.25932/publishup-57645 (page 1-8)
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
Online professional development across institutions and borders
Article written by Bart Rienties, Blazenka Divjak, Michael Eichhorn, Francisco Iniesto, Gillian Saunders-Smits, Barbi Svetec, Alexander Tillmann and Mirza Zizak and published in the International Journal of Educational Technology in Higher Education as part of the EU-funded project ‘RAPIDE’.
Abstract
Professional development (PD) is a key element for enhancing the quality of academic teaching. An increasing number of PD activities have moved to blended and online formats, especially since the COVID-19 pandemic. Due to the desire, potential, and need for collaboration among educators to learn from innovative and best practices, several institutions have started to pool their resources and expertise together and have started to implement cross-institutional and cross-national online professional development (OPD). The questions of what type of a (cross-)institutional OPD educators might prefer, and whether educators learn effectively from (and with) peers in such cross-cultural context have not been adequately explored empirically. In this case-study across three European countries, we explored the lived experiences of 86 educators as a result of a cross-institutional OPD. Using a mixed methods design approach our pre-post findings indicated that, on average, participants made substantial gains in knowledge. In addition, several cultural differences were evident in the expectations and lived experiences in ODP, as well as the intention to transfer what had been learned into one’s own practice of action. This study indicates that while substantial economic and pedagogical affordances are provided with cross-institutional OPD, cultural differences in context might impact the extent to which educators implement lessons learned from OPD.
Keywords
Online professional development, Cross-institutional, Cultural, Mixed method, Innovative pedagogy, Higher education
Reference
Rienties, B., Divjak, B., Eichhorn, M., Iniesto, F., Saunders-Smits, G., Svetec, B., Tillmann, A., & Zizak, M. (2023). ONLINE PROFESSIONAL DEVELOPMENT ACROSS INSTITUTIONS AND BORDERS. International Journal of Educational Technology in Higher Education, 20(1), 30. https://doi.org/10.1186/s41239-023-00399-1
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
The Use of Digital Peer Assessment in Higher Education: An Umbrella Review of Literature
Article written by G. van Helden, V. van der Werf, G. Saunders-Smits, M.M. Specht and published in the Journal IEEE Access.
Abstract
Increasing student numbers in higher education, particularly in engineering and computer science, make it difficult for motivated lecturers to continue engaging in active teaching methods such as Flipped Classrooms and Work-Based Learning. In these settings, digital Peer Assessment can be one approach to provide effective and scalable feedback. In Peer Assessment, students assess each other’s performance whilst gaining useful reflection and judgment skills at the same time. This umbrella review of 14 review papers on the use of (digital) Peer Assessment in education provides a comprehensive overview of design choices and their consequences open to educational practitioners wishing to implement digital Peer Assessment in their courses, the type of tooling available and the possible effects of these choices on the learning outcomes as well as potential pitfalls and challenges when implementing Peer Assessment. The paper will inform and assist educators in finding or developing a tool that fits their needs.
Keywords
Digital education, educational technology, engineering education, peer assessment
Reference
van Helden, G., van der Werf, V., Saunders-Smits, G., & Specht, M. M. (2023). THE USE OF DIGITAL PEER ASSESSMENT IN HIGHER EDUCATION: AN UMBRELLA REVIEW OF LITERATURE. IEEE Access, 11, 22948-22960. https://doi.org/10.1109/ACCESS.2023.3252914
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of IEEE Access must be obtained for commercial re-use or in order to create a derivative work.
Using peer assessment in inclusive digital education
Article written by G. Saunders-Smits, G. van Helden, V. van der Werf, M. M. Specht and published in the Proceedings of the 50th Annual Conference Universitat Politècnica de Catalunya · BarcelonaTech (UPC).
Abstract
This workshop is part of the ERASMUS+ project: RAPIDE: on Relevant Assessment and pedagogies for Inclusive Digital Education (https://rapide-project.eu) and is open to anyone who is interested in implementing or improving peer assessment in their courses. At the end of the workshop, participants will be able to make an informed decision on a suitable form of Peer Assessment for their courses. Over the past few years, many of us have faced operating in a frequently changing teaching environment which has made evaluating and assessing students’ learning outcomes and more importantly giving students feedback on their learning much more complicated. One pedagogical tool that has been increasingly used is that of peer assessments where students give each other feedback and assess each other’s work. In this workshop, participants will be introduced to many different types of peer assessment that can be used in engineering education, such as peer reviewing (each other’s work), peer grading(continuous feedback on mastery), and peer evaluation (group work) whether face-to-face, hybrid or in a fully online environment and how to do so in an inclusive way thus maintaining the important safe place that education should be. Participants will then in small groups discuss what types of peer evaluations they use or want to use in their courses and brainstorm on ideas for implementation in their own specific case or for one of the general cases that the facilitators will have available. At the end of the workshop participants will present their main findings back to the whole group so that they may also learn from each other. We aim for participants to leave feeling inspired at the end of the workshop to implement or improve peer assessment in their own courses. The aggregated main findings and ideas contrived in the workshop on how to implement peer assessment will also be shared with a wider audience through the conference proceedings and the RAPIDE project website.
Keywords
Focus groups, course design, team based learning, project based learning, learning technology
Reference
Saunders-Smits, G., van Helden, G., van der Werf, V., & Specht, M. M. (2022). USING PEER ASSESSMENT IN INCLUSIVE DIGITAL EDUCATION. In H-M. Jarvinen, S. Silvestre, A. Llorens, & B. V. Nagy (Eds.), Proceedings of the 50th Annual Conference Universitat Politècnica de Catalunya · BarcelonaTech (UPC) (pp. 2305-2308). (SEFI 2022 – 50th Annual Conference of the European Society for Engineering Education, Proceedings). https://doi.org/10.5821/conference-9788412322262.1369
Download
Enhancing Students’ Global Perspective-Taking to Improve Virtual Team Performance: A Swift Trust Theory Perspective
Article written by Michael A. Erskine, Sam Zaza, Rafael D. Araújo, Flávio E. A. Horita and Naomi Wahls and published in the Proceedings of the XVIII Brazilian Symposium on Information Systems, Curitiba, Brazil.
Abstract
Context: Contemporary organizations rely on global virtual teams. This trend, exasperated due to the Covid-19 pandemic, aligns with ongoing globalization and digital transformation efforts. The information system (IS) scholarship has a strong interest in studying groups that develop digital technologies with a frequent focus on global virtual teams. Such teams, which frequently form ad hoc, require a swift formation of trust to be effective. Global-perspective taking overcomes intercultural trust barriers and presents an opportunity for more effective teams.
Problem: However, academic IS programs traditionally do not teach or assess concepts such as global-perspective in their students. Our study assesses whether university IS educators can impart global perspective-taking through online intercultural exchanges (OIEs).
Theoretical reference: We examine the effects of global perspective-taking (comprising cultural intelligence, global citizenship, and civic-mindedness) on the effectiveness of global virtual teams through the lens of swift trust theory.
Method: We conducted an exploratory study by creating OIEs in the context of web development coursework between students in the United States and Brazil (N=131).
Results: We found that an OIE environment led to enhanced global perspective-taking and improved student outcomes. The swift trust theory suggests that such outcomes would ultimately enhance virtual team performance.
Impact on the IS area: We contribute to the IS scholarship by extending the swift trust theory to include global perspective-taking and provide practical suggestions to academic IS programs on implementing effective OIE practices. We also report the benefits of global perspective-taking on international virtual team performance, which is of interest to hiring organizations.
Reference
Erskine, M. A., Zaza, S., Araújo, R. D., Horita, F. E. A., & Wahls, N. (2022). ENHANCING STUDENTS’ GLOBAL PERSPECTIVE-TAKING TO IMPROVE VIRTUAL TEAM PERFORMANCE: A SWIFT TRUST THEORY PERSPECTIVE Proceedings of the XVIII Brazilian Symposium on Information Systems, Curitiba, Brazil. https://doi.org/10.1145/3535511.3535535
Download
Using Social Network Analysis to explore Learning networks in MOOCs discussion forums
Article written by Ali Soleymani, Laure Itard, Maarten de Laat, Manuel Valle Torre, and Marcus Specht and published in the Proceedings of the CLIMA 2022 Conference.
Abstract
Learning and educational challenges in the field of indoor climate and building services like energy systems are mainly due to the transformation of professional practices and learning networks, a big shift in the way in which people work, communicate, and share their knowledge and the need for additional workforce, either juniors or coming from other disciplines. One of the most important factors that highly influence professional development and workplace learning is networked learning. Our goal in this study, is understanding the learning networks characteristics and patterns of interaction using Social Network Analysis techniques in three MOOCs discussion forums. The result of this study shows not only the importance of Learning networks and peer support on professionalization of learners, but also how pedagogical approach of instructors in MOOCs can foster learning networks. This novel approach in developing learning networks and communities is not only able to help connect young professionals and experienced practitioners digitally, but also it can promote professional development and innovation in the energy installation sector.
Keywords
Professional learning networks, social network analysis, lifelong learning, Massive Online Open Courses
Reference
Soleymani, A., Itard, L., de Laat, M., Valle Torre, M., & Specht, M. (2022). USING SOCIAL NETWORK ANALYSIS TO EXPLORE LEARNING NETWORKS IN MOOCS DISCUSSION FORUMS. CLIMA 2022 Conference. https://doi.org/10.34641/clima.2022.300
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
Blending Your Education: Lessons Learned During COVID
Article written by Naomi Wahls, Wiebe Dijkstra, and Martijn Ouwehand and published by EADTU as part of the EU project ‘Digitel Pro’.
Abstract
This article is a concise analysis of the current COVID situation taking into account the needs of teaching staff and support staff in an emergency situation (IO1) and conditions for change management (IO6) to the design and develop blended education. TU Delft is partner of the EU project ‘Digitel Pro’ in collaboration with DCU, KU Leuven, UOC, and EADTU. This is an analysis (a) completing the literature review from 2018 on and (b) refocusing the conclusions on the COVID 19 needs as the Digitel Pro partners have already made a comprehensive analysis for the EMBED project. Best Practices for Blended Learning during COVID times are still emerging. It is unclear if everyone truly uses the same definition for blended and hybrid teaching within the literature produced during COVID times because not all authors provide a definition in their articles. Some of the authors who published in 2020 and 2021 are completely new to online teaching. Although online education has been around since at least 2003, it is surprising to see authors mention that distance learning is still in developmental stages in 2021. Distance learning will continue to develop, however distance learning is well established as an educational mode with various formats such as online, blended, hybrid, and virtual exchange. Perhaps new during COVID times was that all courses had to face distance learning and prior to COVID, some educators could avoid online formats entirely. The original plan pre-COVID for implementing Blended Learning throughout an entire campus was realized in the document: Research report on state of the art in blended learning and innovation (Goeman, Poelmans, & Van Rompaey, 2018), found here: https://embed.eadtu.eu/results. This article expands on that Research report by explaining the COVID scenarios and what emerged as the secondary or emergency plan, as well as best practices noted by instructors for education during rapid changes for COVID restrictions.
Reference
Wahls, N. L., Dijkstra, W. P., & Ouwehand, G. M. (2022). BLENDING YOUR EDUCATION: LESSONS LEARNED DURING COVID. (v. 9.3.2022 ed.) EADTU. https://digitelpro.eadtu.eu/images/Blending_Your_Education__Lessons_Learned_During_COVID.pdf
Download
The effect of the COVID-19 pandemic on a MOOC in Aerospace Structures and Materials
Article written by Ioana Jivet and Gillian N. Saunders-Smits and published in the Proceedings of the SEFI 49th Annual Conference.
Abstract
In March 2020 COVID-19 brought the world and with that aviation to a standstill. Also in March 2020, the third run of the DelftX MOOC Introduction to Aerospace Structures and Materials started on edX. This MOOC generally attracts a mixture of young aviation enthusiasts (often students) and aviation professionals. Given the large interest MOOCs have received as the pandemic hit, we investigate how the new global context affected the motivation and the way learners interact with our course material. For this project, we will use learning analytics approaches to analyse the log data available from the edX platform and the data from pre- and post-course evaluations of two runs of the same MOOC (2019 and 2020). With the insights gathered through this analysis, we wish to better understand our learners and adjust the learning design of the course to better suit their needs. Our paper will present the first insights of this analysis.
Keywords
MOOC, Aerospace Engineering, Learning Analytics, Lifelong Learning
Reference
Jivet, I., & Saunders-Smits, G. (2021). THE EFFECT OF THE COVID-19 PANDAMIC ON A MOOC IN AEROSPACE STRUCTURES AND MATERIALS. In H-U. Heiß, H-M. Järvinen, A. Mayer, & A. Schulz (Eds.), Blended Learning in Engineering Education: challenging, enlightening – and lasting? (pp. 258-267)
Download
Presentation
Presentation of the work of dr. ir. I. Jivet and dr.ir. Gillian N. Saunders-Smits at the 49th Annual SEFI conference held online from 13-16 September 2021 hosted by TU Berlin:
Shifting from Blended to Online Learning: Students’ and Teachers’ Perspectives
Article written by Esra Polat, Sonja van Dam and Conny Bakker and published in the Proceedings of the Design Society.
Abstract
The Covid-19 outbreak forced many universities across the world to transition from a traditional or blended format to fully online education. This paper presents a case study on the transition to an online education format for a circular design course. Both quantitative and qualitative data were collected through a survey with 26 students and interviews with six course teachers. The findings revealed that students preferred the on-campus versions over the online course components. They indicated the perceived lack of motivation, lack of sense of community, and a high workload as influencing factors. Teachers indicated the lack of connection with students as a drawback to online education but identified advantages to their teaching and the student’s learning experience. Suggestions for addressing an optimal blended course format are provided.
Keywords
Design education, Online learning, Circular economy, Case study, Covid-19
Reference
Polat, E., Van Dam, S., & Bakker, C. (2021). SHIFTING FROM BLENDED TO ONLINE LEARNING: STUDENTS’ AND TEACHERS’ PERSPECTIVES. Proceedings of the Design Society, 1, 2651-2660. doi:10.1017/pds.2021.526
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.