Online Learning Research
Exploring Personal Experience and Value Creation in Postdigital Education: Insights from a Large-Scale MOOC Survey.
Article written by Ali Soleymani, Maarten De Laat and Marcus Specht. This is a preprint (version 1); it has not been peer reviewed by a journal.
Abstract
This study investigates students’ online learning experiences based on their perception of the value this course creates for them through a comprehensive analysis of responses from 1227 participants in MOOCs offered by the Extension School of the Technical University of Delft. Utilizing the value creation framework by Wenger, Trayner, and De Laat (2011) , the research explores the immediate, potential, applied, realized, and transformative value creation cycles. Our findings reveal significant insights into the multifaceted impacts of study behavior on learners’ perceptions. Participants reported benefits such as skill acquisition, professional development, and enhanced confidence while highlighting areas needing improvement, such as practical application opportunities and course relevance. This study highlights the importance of aligning MOOC content with learner needs and providing ongoing support tomaximize the educational value online courses can offer them. These insights contribute to understanding educational value in the postdigital age, advocating for the development and support of MOOCs to foster continued personal and professional growth.
Keywords
Value Creation Framework, Postdigital Education, MOOCs, Online Assessment
Reference
Soleymani, A., De Laat, M., & Specht, M. M. (2024) EXPLORING PERSONAL EXPERIENCE AND VALUE CREATION IN POSTDIGITAL EDUCATION: INSIGHTS FROM A LARGE-SCALE MOOC SURVEY., Preprint (Version 1) available at Research Square
https://doi.org/10.21203/rs.3.rs-5043440/v1
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
Data for Learning in Engineering Education
White paper ‘100 DAYS OF… Data for Learning’
Written by Marcus Specht, Selma van Esveld, Jacopo De Stefani, Ted Adrichem and Andra Gherghiceanu to combine the insights and findings from the 2022/2023 event series 100 DAYS OF… Data for Learning.
Summary
For the past decades, the role of data has been ever growing in almost all fields – learning (and education) not excluded. But what is actually meant by ‘Data for Learning’? What data is available at TU Delft to support teaching and learning? In what way is it being used? For what purpose – and with which impact? And what are the challenges involved? These have been the questions which motivated the team of ‘100 DAYS OF… DATA FOR LEARNING’ to shape the program.
This paper outlines the findings of our 100+ days’ exploration. The aim of this paper is to raise awareness, understand conditions and needs, and discuss concerns and opportunities of (further) development of using ‘Data for Learning’ within the context of TU Delft Education.
In the ‘100 DAYS OF… DATA FOR LEARNING’ we have organised peer exchange among scientific staff and educational support, students, and lecturers. We have held journal clubs, invited science speaker sessions, and a hackathon event to understand the role and potential of data to support teaching and learning. In detail this included twelve Science speaker sessions in which a variety of topics has been presented and discussed about current applications of data in teaching and learning support as also fields of tension and challenges. In the 2022 CEL (Centre for Education and Learning) annual meeting, experts and interested participants convened for three keynotes and eight workshops on the topics of Learning Analytics and Data for Teaching and Learning.
In the hackathon initiative a dataset of real student data from a higher education institution in the Netherlands was collected and presented to different stakeholders for discussion and analysis. On one hand, students had the possibility to analyse the data to extract insights that could support the work of educational advisors. On the other hand, practitioners reflected on the current status of learning data and discussed improvements or potential future projects.
Overall, a variety of stakeholders from the TU Delft, on a national and international level, have been involved and contributed to the 100 Days. This has created awareness and new initiatives about the potential and challenges of ‘Data for Learning’. This brochure gives background, details, and starting points for further exploration of this important topic for the future of education.
Keywords
Data for learning, learning analytics, Data for teaching and learning, white paper, engineering education
Reference
Specht, M., van Esveld, S. L., De Stefani, J., Gherghiceanu, A., Adrichem, T. (2023). DATA FOR LEARNING IN ENGINEERING EDUCATION. WHITE PAPER ‘100 DAYS OF… DATA FOR LEARNING’.
Delft University of Technology.
Download
Enhancing quality assurance in continuing education through an organisational cultural change
Article written by Clelia Paraluppi, Patricia Mancebo May, Ceyrine Pellikaan and Naomi Wahls and published in the European Journal of University Lifelong Learning (EJULL) as part of the EUCEN Conference 2023.
Abstract
The TU Delft Extension School for Continuing Education underwent a collaborative process
to strengthen its quality culture involving professionals and leaders working on designing,
developing and delivering its online courses. In this paper we describe the steps taken
towards an enhanced Quality Assurance (QA) system. A key part of the Extension School’s
strategy to guarantee excellence in its online courses is the continuous training provided for
instructors and teaching assistants who form the course teams. This is delivered in several
ways: specialised hands-on courses and dedicated portals, personal guidance throughout
the entire course development process, and an extensive offer of short trainings. This
approach contributes both to higher quality for our online courses and to the professional
development of our teaching staff, who bring their newly acquired experience and online
materials back to their in-campus courses. In this paper, we share the lessons learned on
establishing an organisational quality culture, defining QA standards and processes, and we
showcase how the professionalisation of instructors plays a pivotal role in offering high-quality education.
Keywords
Quality assurance, quality culture, continuing education, professional development, course development
Reference
Paraluppi, C., Mancebo May, P., Pellikaan, C. & Wahls, N. (2023) ENHANCING QUALITY ASSURANCE IN CONTINUING EDUCATION THROUGH AN ORGANISATIONAL CULTURAL CHANGE. European
Journal of University Lifelong Learning, 7(2), pp. 89-96. © eucen, 2023.
https://doi.org/10.53807/0702ADf6
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by-nc-sa/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator, the purposes are non-commercial and distribution of remixed, adapted or build upon material should be released under the same license.
Impact of MOOC and other online course development on campus education
Short paper written by Selma van Esveld, Nardo de Vries, Sibilla Becchetti, Sofia Dopper, and Willem van Valkenburg and presented by Selma van Esveld at EMOOCs 2023 in Potsdam, Germany. Article was published in the Proceedings of the Eighth EMOOCs Conference (EMOOCs 2023).
Abstract
The TU Delft Extension School for Continuing Education develops and delivers MOOCs, programs and other online courses for lifelong learners and professionals worldwide focused on Science, Engineering & Design. At the beginning of 2022, we started a project to examine whether creating an online course had any impact on TU Delft campus education. Through a survey, we collected feedback from 68 TU Delft lecturers involved in developing and offering online courses and programs for lifelong learners and professionals. The lecturers reported on the impact of developing an online course on a personal and curricular level. The results showed that the developed online materials, and the acquired skills and experiences from creating online courses, were beneficial for campus education, especially during the transition to remote emergency teaching in the COVID-19 lockdown periods. In this short paper, we will describe the responses in detail and map the benefits and challenges experienced by lecturers when implementing their online course materials and newly acquired educational skills on campus. Finally, we will explore future possibilities to extend the reported, already relevant, impact of MOOCs and of other online courses on campus education.
Keywords
COVID, impact of MOOCs, campus education, lifelong learning, teacher skills, open educational resources
Reference
van Esveld, S.; de Vries, N.; Becchetti, S.; Dopper, S.; van Valkenburg, W. (2023). EMOOCS 2023: POST-COVID PROSPECTS FOR MASSIVE OPEN ONLINE COURSES – BOOST OR BACKLASH? Proceedings of the Eighth EMOOCs Conference. https://doi.org/10.25932/publishup-57645 (page 1-8)
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
Online professional development across institutions and borders
Article written by Bart Rienties, Blazenka Divjak, Michael Eichhorn, Francisco Iniesto, Gillian Saunders-Smits, Barbi Svetec, Alexander Tillmann and Mirza Zizak and published in the International Journal of Educational Technology in Higher Education as part of the EU-funded project ‘RAPIDE’.
Abstract
Professional development (PD) is a key element for enhancing the quality of academic teaching. An increasing number of PD activities have moved to blended and online formats, especially since the COVID-19 pandemic. Due to the desire, potential, and need for collaboration among educators to learn from innovative and best practices, several institutions have started to pool their resources and expertise together and have started to implement cross-institutional and cross-national online professional development (OPD). The questions of what type of a (cross-)institutional OPD educators might prefer, and whether educators learn effectively from (and with) peers in such cross-cultural context have not been adequately explored empirically. In this case-study across three European countries, we explored the lived experiences of 86 educators as a result of a cross-institutional OPD. Using a mixed methods design approach our pre-post findings indicated that, on average, participants made substantial gains in knowledge. In addition, several cultural differences were evident in the expectations and lived experiences in ODP, as well as the intention to transfer what had been learned into one’s own practice of action. This study indicates that while substantial economic and pedagogical affordances are provided with cross-institutional OPD, cultural differences in context might impact the extent to which educators implement lessons learned from OPD.
Keywords
Online professional development, Cross-institutional, Cultural, Mixed method, Innovative pedagogy, Higher education
Reference
Rienties, B., Divjak, B., Eichhorn, M., Iniesto, F., Saunders-Smits, G., Svetec, B., Tillmann, A., & Zizak, M. (2023). ONLINE PROFESSIONAL DEVELOPMENT ACROSS INSTITUTIONS AND BORDERS. International Journal of Educational Technology in Higher Education, 20(1), 30. https://doi.org/10.1186/s41239-023-00399-1
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
The Use of Digital Peer Assessment in Higher Education: An Umbrella Review of Literature
Article written by G. van Helden, V. van der Werf, G. Saunders-Smits, M.M. Specht and published in the Journal IEEE Access.
Abstract
Increasing student numbers in higher education, particularly in engineering and computer science, make it difficult for motivated lecturers to continue engaging in active teaching methods such as Flipped Classrooms and Work-Based Learning. In these settings, digital Peer Assessment can be one approach to provide effective and scalable feedback. In Peer Assessment, students assess each other’s performance whilst gaining useful reflection and judgment skills at the same time. This umbrella review of 14 review papers on the use of (digital) Peer Assessment in education provides a comprehensive overview of design choices and their consequences open to educational practitioners wishing to implement digital Peer Assessment in their courses, the type of tooling available and the possible effects of these choices on the learning outcomes as well as potential pitfalls and challenges when implementing Peer Assessment. The paper will inform and assist educators in finding or developing a tool that fits their needs.
Keywords
Digital education, educational technology, engineering education, peer assessment
Reference
van Helden, G., van der Werf, V., Saunders-Smits, G., & Specht, M. M. (2023). THE USE OF DIGITAL PEER ASSESSMENT IN HIGHER EDUCATION: AN UMBRELLA REVIEW OF LITERATURE. IEEE Access, 11, 22948-22960. https://doi.org/10.1109/ACCESS.2023.3252914
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of IEEE Access must be obtained for commercial re-use or in order to create a derivative work.
Using peer assessment in inclusive digital education
Article written by G. Saunders-Smits, G. van Helden, V. van der Werf, M. M. Specht and published in the Proceedings of the 50th Annual Conference Universitat Politècnica de Catalunya · BarcelonaTech (UPC).
Abstract
This workshop is part of the ERASMUS+ project: RAPIDE: on Relevant Assessment and pedagogies for Inclusive Digital Education (https://rapide-project.eu) and is open to anyone who is interested in implementing or improving peer assessment in their courses. At the end of the workshop, participants will be able to make an informed decision on a suitable form of Peer Assessment for their courses. Over the past few years, many of us have faced operating in a frequently changing teaching environment which has made evaluating and assessing students’ learning outcomes and more importantly giving students feedback on their learning much more complicated. One pedagogical tool that has been increasingly used is that of peer assessments where students give each other feedback and assess each other’s work. In this workshop, participants will be introduced to many different types of peer assessment that can be used in engineering education, such as peer reviewing (each other’s work), peer grading(continuous feedback on mastery), and peer evaluation (group work) whether face-to-face, hybrid or in a fully online environment and how to do so in an inclusive way thus maintaining the important safe place that education should be. Participants will then in small groups discuss what types of peer evaluations they use or want to use in their courses and brainstorm on ideas for implementation in their own specific case or for one of the general cases that the facilitators will have available. At the end of the workshop participants will present their main findings back to the whole group so that they may also learn from each other. We aim for participants to leave feeling inspired at the end of the workshop to implement or improve peer assessment in their own courses. The aggregated main findings and ideas contrived in the workshop on how to implement peer assessment will also be shared with a wider audience through the conference proceedings and the RAPIDE project website.
Keywords
Focus groups, course design, team based learning, project based learning, learning technology
Reference
Saunders-Smits, G., van Helden, G., van der Werf, V., & Specht, M. M. (2022). USING PEER ASSESSMENT IN INCLUSIVE DIGITAL EDUCATION. In H-M. Jarvinen, S. Silvestre, A. Llorens, & B. V. Nagy (Eds.), Proceedings of the 50th Annual Conference Universitat Politècnica de Catalunya · BarcelonaTech (UPC) (pp. 2305-2308). (SEFI 2022 – 50th Annual Conference of the European Society for Engineering Education, Proceedings). https://doi.org/10.5821/conference-9788412322262.1369
Download
Enhancing Students’ Global Perspective-Taking to Improve Virtual Team Performance: A Swift Trust Theory Perspective
Article written by Michael A. Erskine, Sam Zaza, Rafael D. Araújo, Flávio E. A. Horita and Naomi Wahls and published in the Proceedings of the XVIII Brazilian Symposium on Information Systems, Curitiba, Brazil.
Abstract
Context: Contemporary organizations rely on global virtual teams. This trend, exasperated due to the Covid-19 pandemic, aligns with ongoing globalization and digital transformation efforts. The information system (IS) scholarship has a strong interest in studying groups that develop digital technologies with a frequent focus on global virtual teams. Such teams, which frequently form ad hoc, require a swift formation of trust to be effective. Global-perspective taking overcomes intercultural trust barriers and presents an opportunity for more effective teams.
Problem: However, academic IS programs traditionally do not teach or assess concepts such as global-perspective in their students. Our study assesses whether university IS educators can impart global perspective-taking through online intercultural exchanges (OIEs).
Theoretical reference: We examine the effects of global perspective-taking (comprising cultural intelligence, global citizenship, and civic-mindedness) on the effectiveness of global virtual teams through the lens of swift trust theory.
Method: We conducted an exploratory study by creating OIEs in the context of web development coursework between students in the United States and Brazil (N=131).
Results: We found that an OIE environment led to enhanced global perspective-taking and improved student outcomes. The swift trust theory suggests that such outcomes would ultimately enhance virtual team performance.
Impact on the IS area: We contribute to the IS scholarship by extending the swift trust theory to include global perspective-taking and provide practical suggestions to academic IS programs on implementing effective OIE practices. We also report the benefits of global perspective-taking on international virtual team performance, which is of interest to hiring organizations.
Reference
Erskine, M. A., Zaza, S., Araújo, R. D., Horita, F. E. A., & Wahls, N. (2022). ENHANCING STUDENTS’ GLOBAL PERSPECTIVE-TAKING TO IMPROVE VIRTUAL TEAM PERFORMANCE: A SWIFT TRUST THEORY PERSPECTIVE Proceedings of the XVIII Brazilian Symposium on Information Systems, Curitiba, Brazil. https://doi.org/10.1145/3535511.3535535
Download
Using Social Network Analysis to explore Learning networks in MOOCs discussion forums
Article written by Ali Soleymani, Laure Itard, Maarten de Laat, Manuel Valle Torre, and Marcus Specht and published in the Proceedings of the CLIMA 2022 Conference.
Abstract
Learning and educational challenges in the field of indoor climate and building services like energy systems are mainly due to the transformation of professional practices and learning networks, a big shift in the way in which people work, communicate, and share their knowledge and the need for additional workforce, either juniors or coming from other disciplines. One of the most important factors that highly influence professional development and workplace learning is networked learning. Our goal in this study, is understanding the learning networks characteristics and patterns of interaction using Social Network Analysis techniques in three MOOCs discussion forums. The result of this study shows not only the importance of Learning networks and peer support on professionalization of learners, but also how pedagogical approach of instructors in MOOCs can foster learning networks. This novel approach in developing learning networks and communities is not only able to help connect young professionals and experienced practitioners digitally, but also it can promote professional development and innovation in the energy installation sector.
Keywords
Professional learning networks, social network analysis, lifelong learning, Massive Online Open Courses
Reference
Soleymani, A., Itard, L., de Laat, M., Valle Torre, M., & Specht, M. (2022). USING SOCIAL NETWORK ANALYSIS TO EXPLORE LEARNING NETWORKS IN MOOCS DISCUSSION FORUMS. CLIMA 2022 Conference. https://doi.org/10.34641/clima.2022.300
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
Blending Your Education: Lessons Learned During COVID
Article written by Naomi Wahls, Wiebe Dijkstra, and Martijn Ouwehand and published by EADTU as part of the EU project ‘Digitel Pro’.
Abstract
This article is a concise analysis of the current COVID situation taking into account the needs of teaching staff and support staff in an emergency situation (IO1) and conditions for change management (IO6) to the design and develop blended education. TU Delft is partner of the EU project ‘Digitel Pro’ in collaboration with DCU, KU Leuven, UOC, and EADTU. This is an analysis (a) completing the literature review from 2018 on and (b) refocusing the conclusions on the COVID 19 needs as the Digitel Pro partners have already made a comprehensive analysis for the EMBED project. Best Practices for Blended Learning during COVID times are still emerging. It is unclear if everyone truly uses the same definition for blended and hybrid teaching within the literature produced during COVID times because not all authors provide a definition in their articles. Some of the authors who published in 2020 and 2021 are completely new to online teaching. Although online education has been around since at least 2003, it is surprising to see authors mention that distance learning is still in developmental stages in 2021. Distance learning will continue to develop, however distance learning is well established as an educational mode with various formats such as online, blended, hybrid, and virtual exchange. Perhaps new during COVID times was that all courses had to face distance learning and prior to COVID, some educators could avoid online formats entirely. The original plan pre-COVID for implementing Blended Learning throughout an entire campus was realized in the document: Research report on state of the art in blended learning and innovation (Goeman, Poelmans, & Van Rompaey, 2018), found here: https://embed.eadtu.eu/results. This article expands on that Research report by explaining the COVID scenarios and what emerged as the secondary or emergency plan, as well as best practices noted by instructors for education during rapid changes for COVID restrictions.
Reference
Wahls, N. L., Dijkstra, W. P., & Ouwehand, G. M. (2022). BLENDING YOUR EDUCATION: LESSONS LEARNED DURING COVID. (v. 9.3.2022 ed.) EADTU. https://digitelpro.eadtu.eu/images/Blending_Your_Education__Lessons_Learned_During_COVID.pdf