Keywords
learning management system
teacher professional development
usability evaluation
educational technology
Dimensions
Altmetrics
How to Cite
Abstract
This study aims to evaluate teachers’ perceived usability of a Learning Management System (LMS) implemented in a national STEM pedagogy pilot and to identify priority areas for refinement before large-scale implementation. A quantitative survey was conducted involving 152 senior high school (Sekolah Menengah Atas/SMA) and vocational high school (Sekolah Menengah Kejuruan/SMK) teachers from 38 Indonesian provinces. Data were collected using a 35-item questionnaire measuring seven dimensions of LMS usability. The findings indicate a high level of perceived usability (M = 3.814 out of 4), with the highest ratings observed for compatibility and application performance. Nevertheless, item-level analysis identified several areas requiring improvement, particularly navigation, notification clarity, and helpdesk functionality. This study contributes to the literature by evaluating LMS usability within a government-led, nationwide teacher professional development program involving both STEM and non-STEM teachers, thereby extending previous research that has predominantly focused on institution-based or student-centered settings. The study concludes that the LMS is suitable for broader implementation, provided that identified usability issues are addressed. It recommends that the Ministry of Primary and Secondary Education prioritize improvements to navigation design, notification systems, and user support services to enhance platform usability and sustain teacher engagement in STEM professional development.
References
Al-Fraihat, D., Joy, M., Masa’deh, R., & Sinclair, J. (2020). Evaluating E-learning systems success: An empirical study. Computers in Human Behavior, 102, 67–86. https://doi.org/10.1016/j. chb.2019.08.004
Al-Nuaimi, M. N., & Al-Emran, M. (2021). Learning management systems and technology acceptance models: A systematic review. Education and Information Technologies, 26(5), 5499– 5533.
Biswas, U., & Bhattacharya, S. (2024). ML-based intelligent real-time feedback system for blended classroom. Education and Information Technologies, 29(4), 3923–3951.
Bragg, L. A., Walsh, C., & Heyeres, M. (2021). Successful design and delivery of online professional development for teachers: A systematic review of the literature. Computers & Education, 166, 104158.
Agency for Standards, Curriculum, and Assessment in Education (BSKAP). (2025). Panduan Pembelajaran STEM. https://repositori.kemendikdasmen.go.id/33606/1/Panduan%20STEM%20 22_09_2025%20FA%20fix%203.pdf
Camilleri, M. A., & Camilleri, A. C. (2017). Digital learning resources and ubiquitous technologies in education. Technology, Knowledge and Learning, 22(1), 65–82.
Cheng, M. M. H., & Yeh, F. Y. (2022). Identifying effective STEM programmes and strategies in Asia. In Concepts and Practices of STEM Education in Asia (pp. 19–41). Springer.
DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems, 19(4), 9–30.
Estrada-Molina, O., Fuentes-Cancell, D. R., & Morales, A. A. (2022). The assessment of the usability of digital educational resources: An interdisciplinary analysis from two systematic reviews. Education and Information Technologies, 27(3), 4037–4063. https://doi.org/10.1007/s10639-021-10727-5
Hayes, A. F., & Coutts, J. J. (2020). Use Omega rather than Cronbach’s Alpha for estimating reliability. But…. Communication Methods and Measures, 14(1), 1–24. https://doi.org/10.1080/1931 2458.2020.1718629
Heap, T., Thompson, R., & Fein, A. (2021). Designing teacher professional development programs to support a rapid shift to digital. Educational Technology Research and Development, 69(1), 35–38.
https://doi.org/10.1007/s11423-020-09863-5
Kelley, T. R., & Knowles, J. G. (2016). A conceptual framework for integrated STEM education. International Journal of STEM Education, 3(1), 11. https://doi.org/10.1186/s40594-016-0046-z
OECD. (2023). PISA 2022 Results (Volume I and II) - Country Notes: Indonesia. https://www.oecd.org/ en/publications/pisa-2022-results-volume-i-and-ii-country-notes_ed6fbcc5-en/indonesia_ c2e1ae0e-en.html
Philipsen, B., Tondeur, J., Pareja Roblin, N., Vanslambrouck, S., & Zhu, C. (2019). Improving teacher professional development for online and blended learning: A systematic metaaggregative review. Educational Technology Research and Development, 67(5), 1145–1174. https:// doi.org/10.1007/s11423-019-09645-8
Portillo-Blanco, A., Deprez, H., De Cock, M., Guisasola, J., & Zuza, K. (2024). A systematic literature review of integrated STEM education: Uncovering consensus and diversity in principles and characteristics. Education Sciences, 14(9), 1028. https://doi.org/10.3390/educsci14091028 Pusat Kurikulum dan Pembelajaran. (2025). Naskah akademik pembelajaran mendalam menuju pendidikan bermutu untuk semua. Badan Standar, Kurikulum, dan Asesmen Pendidikan, Kementerian Pendidikan Dasar dan Menengah Republik Indonesia. https://kurikulum.
kemendikdasmen.go.id/rujukan/kajian-naskah-akademik
Sancar, R., Atal, D., & Deryakulu, D. (2021). A new framework for teachers’ professional development. Teaching and Teacher Education, 101, 103305. https://doi.org/10.1016/j.tate.2021.103305
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning. Cognitive Science, 12(2), 257–285.
Taber, K. S. (2018). The Use of Cronbach’s Alpha when developing and reporting research instruments in Science education. Research in Science Education, 48(6), 1273–1296. https://doi. org/10.1007/s11165-016-9602-2
Ting, F. S. T., Shroff, R. H., Lam, W. H., Garcia, R. C. C., Chan, C. L., Tsang, W. K., & Ezeamuzie, N. O. (2023). A meta-analysis of studies on the effects of active learning on Asian students’ performance in Science, Technology, Engineering and Mathematics (STEM) subjects. The AsiaPacific Education Researcher, 32(3), 379–400.
Tran, H. T. N., She, W. J., Kajimura, S., & Shibuya, Y. (2025). Assessing notification timing strategies for improved micro-learning engagement. IEEE Access.
Tulinayo, F. P., Ssentume, P., & Najjuma, R. (2018). Digital technologies in resource constrained higher institutions of learning: A study on students’ acceptance and usability. International Journal of Educational Technology in Higher Education, 15(1), 1–19.
Wahono, B., Lin, P.-L., & Chang, C.-Y. (2020). Evidence of STEM enactment effectiveness in Asian student learning outcomes. International Journal of STEM Education, 7(1), 36. https://doi. org/10.1186/s40594-020-00236-1
Wu, H. T. (2022). Establish a digital real-time learning system with push notifications. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.767389
Xie, K., Kim, M. K., Cheng, S.-L., & Luthy, N. C. (2017). Teacher professional development through digital content evaluation. Educational Technology Research and Development, 65(4), 1067–1103.
Zakariya, Y. F. (2022). Cronbach’s Alpha in Mathematics education research: Its appropriateness, overuse, and alternatives in estimating scale reliability. Frontiers in Psychology, 13, 1074430.
Zhou, S., Dong, Z., Wang, H. H., & Chiu, M. M. (2025). A meta-analysis of STEM Integration on student academic achievement. Research in Science Education, 55(5), 1273–1302. https://doi. org/10.1007/s11165-024-10216-y
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
Copyright (c) 2026 Jurnal Penelitian Kebijakan Pendidikan