Posts in category Papers
The Use of Digital Peer Assessment in Higher Education: An Umbrella Review of Literature
Article written by G. van Helden, V. van der Werf, G. Saunders-Smits, M.M. Specht and published in the Journal IEEE Access.
Abstract
Increasing student numbers in higher education, particularly in engineering and computer science, make it difficult for motivated lecturers to continue engaging in active teaching methods such as Flipped Classrooms and Work-Based Learning. In these settings, digital Peer Assessment can be one approach to provide effective and scalable feedback. In Peer Assessment, students assess each other’s performance whilst gaining useful reflection and judgment skills at the same time. This umbrella review of 14 review papers on the use of (digital) Peer Assessment in education provides a comprehensive overview of design choices and their consequences open to educational practitioners wishing to implement digital Peer Assessment in their courses, the type of tooling available and the possible effects of these choices on the learning outcomes as well as potential pitfalls and challenges when implementing Peer Assessment. The paper will inform and assist educators in finding or developing a tool that fits their needs.
Keywords
Digital education, educational technology, engineering education, peer assessment
Reference
van Helden, G., van der Werf, V., Saunders-Smits, G., & Specht, M. M. (2023). THE USE OF DIGITAL PEER ASSESSMENT IN HIGHER EDUCATION: AN UMBRELLA REVIEW OF LITERATURE. IEEE Access, 11, 22948-22960. https://doi.org/10.1109/ACCESS.2023.3252914
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of IEEE Access must be obtained for commercial re-use or in order to create a derivative work.
Using peer assessment in inclusive digital education
Article written by G. Saunders-Smits, G. van Helden, V. van der Werf, M. M. Specht and published in the Proceedings of the 50th Annual Conference Universitat Politècnica de Catalunya · BarcelonaTech (UPC).
Abstract
This workshop is part of the ERASMUS+ project: RAPIDE: on Relevant Assessment and pedagogies for Inclusive Digital Education (https://rapide-project.eu) and is open to anyone who is interested in implementing or improving peer assessment in their courses. At the end of the workshop, participants will be able to make an informed decision on a suitable form of Peer Assessment for their courses. Over the past few years, many of us have faced operating in a frequently changing teaching environment which has made evaluating and assessing students’ learning outcomes and more importantly giving students feedback on their learning much more complicated. One pedagogical tool that has been increasingly used is that of peer assessments where students give each other feedback and assess each other’s work. In this workshop, participants will be introduced to many different types of peer assessment that can be used in engineering education, such as peer reviewing (each other’s work), peer grading(continuous feedback on mastery), and peer evaluation (group work) whether face-to-face, hybrid or in a fully online environment and how to do so in an inclusive way thus maintaining the important safe place that education should be. Participants will then in small groups discuss what types of peer evaluations they use or want to use in their courses and brainstorm on ideas for implementation in their own specific case or for one of the general cases that the facilitators will have available. At the end of the workshop participants will present their main findings back to the whole group so that they may also learn from each other. We aim for participants to leave feeling inspired at the end of the workshop to implement or improve peer assessment in their own courses. The aggregated main findings and ideas contrived in the workshop on how to implement peer assessment will also be shared with a wider audience through the conference proceedings and the RAPIDE project website.
Keywords
Focus groups, course design, team based learning, project based learning, learning technology
Reference
Saunders-Smits, G., van Helden, G., van der Werf, V., & Specht, M. M. (2022). USING PEER ASSESSMENT IN INCLUSIVE DIGITAL EDUCATION. In H-M. Jarvinen, S. Silvestre, A. Llorens, & B. V. Nagy (Eds.), Proceedings of the 50th Annual Conference Universitat Politècnica de Catalunya · BarcelonaTech (UPC) (pp. 2305-2308). (SEFI 2022 – 50th Annual Conference of the European Society for Engineering Education, Proceedings). https://doi.org/10.5821/conference-9788412322262.1369
Download
Using Social Network Analysis to explore Learning networks in MOOCs discussion forums
Article written by Ali Soleymani, Laure Itard, Maarten de Laat, Manuel Valle Torre, and Marcus Specht and published in the Proceedings of the CLIMA 2022 Conference.
Abstract
Learning and educational challenges in the field of indoor climate and building services like energy systems are mainly due to the transformation of professional practices and learning networks, a big shift in the way in which people work, communicate, and share their knowledge and the need for additional workforce, either juniors or coming from other disciplines. One of the most important factors that highly influence professional development and workplace learning is networked learning. Our goal in this study, is understanding the learning networks characteristics and patterns of interaction using Social Network Analysis techniques in three MOOCs discussion forums. The result of this study shows not only the importance of Learning networks and peer support on professionalization of learners, but also how pedagogical approach of instructors in MOOCs can foster learning networks. This novel approach in developing learning networks and communities is not only able to help connect young professionals and experienced practitioners digitally, but also it can promote professional development and innovation in the energy installation sector.
Keywords
Professional learning networks, social network analysis, lifelong learning, Massive Online Open Courses
Reference
Soleymani, A., Itard, L., de Laat, M., Valle Torre, M., & Specht, M. (2022). USING SOCIAL NETWORK ANALYSIS TO EXPLORE LEARNING NETWORKS IN MOOCS DISCUSSION FORUMS. CLIMA 2022 Conference. https://doi.org/10.34641/clima.2022.300
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International licence (https://creativecommons.org/licenses/by/4.0/), which permits reusers to distribute, remix, adapt, and build upon the material in any medium or format, so long as attribution is given to the creator. The license allows for commercial use.
Blending Your Education: Lessons Learned During COVID
Article written by Naomi Wahls, Wiebe Dijkstra, and Martijn Ouwehand and published by EADTU as part of the EU project ‘Digitel Pro’.
Abstract
This article is a concise analysis of the current COVID situation taking into account the needs of teaching staff and support staff in an emergency situation (IO1) and conditions for change management (IO6) to the design and develop blended education. TU Delft is partner of the EU project ‘Digitel Pro’ in collaboration with DCU, KU Leuven, UOC, and EADTU. This is an analysis (a) completing the literature review from 2018 on and (b) refocusing the conclusions on the COVID 19 needs as the Digitel Pro partners have already made a comprehensive analysis for the EMBED project. Best Practices for Blended Learning during COVID times are still emerging. It is unclear if everyone truly uses the same definition for blended and hybrid teaching within the literature produced during COVID times because not all authors provide a definition in their articles. Some of the authors who published in 2020 and 2021 are completely new to online teaching. Although online education has been around since at least 2003, it is surprising to see authors mention that distance learning is still in developmental stages in 2021. Distance learning will continue to develop, however distance learning is well established as an educational mode with various formats such as online, blended, hybrid, and virtual exchange. Perhaps new during COVID times was that all courses had to face distance learning and prior to COVID, some educators could avoid online formats entirely. The original plan pre-COVID for implementing Blended Learning throughout an entire campus was realized in the document: Research report on state of the art in blended learning and innovation (Goeman, Poelmans, & Van Rompaey, 2018), found here: https://embed.eadtu.eu/results. This article expands on that Research report by explaining the COVID scenarios and what emerged as the secondary or emergency plan, as well as best practices noted by instructors for education during rapid changes for COVID restrictions.
Reference
Wahls, N. L., Dijkstra, W. P., & Ouwehand, G. M. (2022). BLENDING YOUR EDUCATION: LESSONS LEARNED DURING COVID. (v. 9.3.2022 ed.) EADTU. https://digitelpro.eadtu.eu/images/Blending_Your_Education__Lessons_Learned_During_COVID.pdf
Download
The effect of the COVID-19 pandemic on a MOOC in Aerospace Structures and Materials
Article written by Ioana Jivet and Gillian N. Saunders-Smits and published in the Proceedings of the SEFI 49th Annual Conference.
Abstract
In March 2020 COVID-19 brought the world and with that aviation to a standstill. Also in March 2020, the third run of the DelftX MOOC Introduction to Aerospace Structures and Materials started on edX. This MOOC generally attracts a mixture of young aviation enthusiasts (often students) and aviation professionals. Given the large interest MOOCs have received as the pandemic hit, we investigate how the new global context affected the motivation and the way learners interact with our course material. For this project, we will use learning analytics approaches to analyse the log data available from the edX platform and the data from pre- and post-course evaluations of two runs of the same MOOC (2019 and 2020). With the insights gathered through this analysis, we wish to better understand our learners and adjust the learning design of the course to better suit their needs. Our paper will present the first insights of this analysis.
Keywords
MOOC, Aerospace Engineering, Learning Analytics, Lifelong Learning
Reference
Jivet, I., & Saunders-Smits, G. (2021). THE EFFECT OF THE COVID-19 PANDAMIC ON A MOOC IN AEROSPACE STRUCTURES AND MATERIALS. In H-U. Heiß, H-M. Järvinen, A. Mayer, & A. Schulz (Eds.), Blended Learning in Engineering Education: challenging, enlightening – and lasting? (pp. 258-267)
Download
Presentation
Presentation of the work of dr. ir. I. Jivet and dr.ir. Gillian N. Saunders-Smits at the 49th Annual SEFI conference held online from 13-16 September 2021 hosted by TU Berlin:
Shifting from Blended to Online Learning: Students’ and Teachers’ Perspectives
Article written by Esra Polat, Sonja van Dam and Conny Bakker and published in the Proceedings of the Design Society.
Abstract
The Covid-19 outbreak forced many universities across the world to transition from a traditional or blended format to fully online education. This paper presents a case study on the transition to an online education format for a circular design course. Both quantitative and qualitative data were collected through a survey with 26 students and interviews with six course teachers. The findings revealed that students preferred the on-campus versions over the online course components. They indicated the perceived lack of motivation, lack of sense of community, and a high workload as influencing factors. Teachers indicated the lack of connection with students as a drawback to online education but identified advantages to their teaching and the student’s learning experience. Suggestions for addressing an optimal blended course format are provided.
Keywords
Design education, Online learning, Circular economy, Case study, Covid-19
Reference
Polat, E., Van Dam, S., & Bakker, C. (2021). SHIFTING FROM BLENDED TO ONLINE LEARNING: STUDENTS’ AND TEACHERS’ PERSPECTIVES. Proceedings of the Design Society, 1, 2651-2660. doi:10.1017/pds.2021.526
Download
License
This is an Open Access article, distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is unaltered and is properly cited. The written permission of Cambridge University Press must be obtained for commercial re-use or in order to create a derivative work.
Development of a maturity model for blended education: A delphi study
Article written by Katie Goeman, Wiebe Dijkstra, Stephan Poelmans, Pavani Vemuri, Willem Van Valkenburg and published in the International Journal on E-Learning: Corporate, Government, Healthcare, and Higher Education.
Abstract
In order to embed blended learning environments in a strategic and sustainable manner, a multi-actor, multidimensional approach is necessary. This paper reports the results of a 3-round Delphi study involving 28 experts which focuses on the refinement and validation of a layered maturity model that assesses key aspects of blended practices in higher education. The study examines the wording of the proposed assumptions, dimensions and indicators, whether they bear validity and if there are others that are not accounted for. We present the findings of each round, the confirmed maturity model and a series of recommendations for its future usage. As such, it is helpful for lecturers, program coordinators, support services or institutional leaders to decide upon follow-up actions and to achieve up-scaled blended programs and courses in higher education institutions.
Keywords
Maturity model, blended learning, blended teaching, blended education, EMM, higher education
Reference
Goeman, K., Dijkstra, W., Poelmans, S., Vemuri, P., & Van Valkenburg, W. (2021). DEVELOPMENT OF A MATURITY MODEL FOR BLENDED EDUCATION: A DELPHI STUDY. International Journal on E-Learning: Corporate, Government, Healthcare, and Higher Education, 20(3), 229-258. https://www.learntechlib.org/primary/p/217682/
Download
De lerende als rode draad: Weten wat de (werkende) student nodig heeft
Artikel geschreven door Nida K. van Leersum, Willem F. van Valkenburg en Rob F. Mudde en gepubliceerd in het Tijdschrift voor Hoger Onderwijs
Samenvatting
Het permanent najagen van kennis en vaardigheden voor onze persoonlijke en professionele ontwikkeling zal ons steeds meer veranderen in levenslang lerenden. Maar wat houdt ‘een leven lang ontwikkelen’ precies in, en welke rol kunnen universiteiten daarin spelen?
Keywords
Higher education, lifelong learning
Referentie
van Leersum, N. K., van Valkenburg, W. F., & Mudde, R. F. (2021). DE LERENDE ALS RODE DRAAD: WETEN WAT DE (WERKENDE) STUDENT NODIG HEEFT. Tijdschrift voor Hoger Onderwijs, jaargang 28(2), 32-37. https://www.themahogeronderwijs.org/bladerversie/
Download
Pioneering Online Design Teaching in a MOOC Format: Tools for Facilitating Experiential Learning
Article written by Jaap Daalhuizen and Jan Schoormans and published in International Journal of Design.
Abstract
Providing online design education offers a unique opportunity for learning, by providing high quality learning experiences to distributed audiences for free. It has its challenges as well, particularly when the aim is use ‘active learning’ strategies (Biggs & Tang, 2011), which are necessary when teaching design. In this paper, we report on the development of one of the first massive open online courses (MOOC) in the field of product design. We provide insight into the way the course was designed to stimulate active learning, highlighting the tools that were developed to engage students in a mode of experiential learning (Kolb, 1984). We present the results of the course evaluation, through (post-course) surveys and interviews, focusing on the way the newly developed active learning tools were experienced by the students. We found that experiential learning strategies are applicable to the MOOC context, and that dedicated didactic tools were evaluated more positively in terms of stimulating reflection, motivation and learning that conventional ones. We conclude with an analysis of the outlook on future developments for online design education.
Keywords
Design Education, Design Methods, Massive Open Online Learning.
Reference
Daalhuizen, J., & Schoormans, J. (2018). Pioneering online design teaching in a MOOC format: tools for facilitating experiential learning. International Journal of Design, 12(2), 1-14.
Download
Online Courses on Business Model Innovation for Practitioners in SMEs
This article is published in the Journal of Business Models (2019), Vol. 7, No. 3.
Abstract
We develop and evaluate five online courses (MOOCs) on business model innovation, tailored to small and medium sized enterprises (SMEs). Six design principles are found for such courses: regarding type and form of learning contents; time investments from participants; practical examples and tools; integration with daily practice; and participative learning.
Keywords
Business model innovation; Online learning; MOOC
Reference
de Reuver, M., Cligge, M., and Haaker, T. (2019), Online courses on business model innovation for practitioners in SMEs, Vol. 7, No. 3, pp. 13-24
Acknowledgements
This publication was developed within the project `Regeling open en online hoger onderwijs’ of the Dutch Ministry of Education, Culture and Science, guided by SURF (www.surf.nl). The course development received part of its funding from the European Community’s Horizon 2020 Program (2014–2020) under grant agreement 645791. The content herein reflects only the authors’ view. The European Commission is not responsible for any use that may be made of the information it contains. We thank the other course team members Harry Bouwman, Gudo Reekers, Stephan Kool, Thea Dullemans and Johannetta Gordijn for invaluable contributions to the courses. We also thank our colleagues from the H2020 ENVISION project. An earlier version of this paper was presented to Open Education Global Conference 2018, and we thank the reviewers and audience for helpful comments.