Evaluating students' experiences in self-regulated smart learning environment

Educ Inf Technol (Dordr). 2023;28(1):547-580. doi: 10.1007/s10639-022-11126-0. Epub 2022 Jul 4.

Abstract

The increasing development in smart and mobile technologies transforms a learning environment into a smart learning environment that can support diverse learning styles and skills development. An online learner needs to be supported for an engaging and active learning experience. Previously, this progressive research developed and implemented a self-regulated smart learning environment (mobile app) among final-year undergraduate students to support online learning experiences. To understand students' experiences, there is a need to evaluate the mobile app. However, there is a lack of a well-documented study investigating students' experiences in terms of usability, challenges, and factors influencing satisfaction to inform a decision regarding future implementation. This study attempts to fill these gaps by exploring these experiences for sustainable future implementation. The study used cyclical mixed-method evaluations to explore the experiences of 85 final-year undergraduate students. The quantitative data were collected using a survey on the constructs of the research model previously developed to evaluate factors influencing students' satisfaction, and the qualitative used focus group discussions to explore usability experiences and challenges of implementations. The quantitative data were analyzed using SPSS 25 to confirm the structural equation model's relationship. The qualitative data were analyzed using a thematic process to understand students' experiences. The findings from the first mixed-method evaluation show that students were able to follow the learning process, and the application supported their online learning experiences. However, a student expressed the need to improve user functionalities to motivate and engage them in the learning process. The suggestions were incorporated into the mobile app development for the second evaluation. The findings from the second evaluation revealed similar support. However, students suggested a web-based version to support different operating systems and improve interactions. Furthermore, the information system qualities and moderating factors investigated supported students' satisfaction. Future research could explore facilitators' experiences in the mobile app for sustainable development and implementation for engaging online learning experiences and skills development.

Keywords: Mixed-method; Mobile app; Online learning; Self-regulated learning; Smart learning environment.