User Flow Analysis of the Ruangguru App Using Heuristic Evaluation and Cognitive Walkthrough Methods
-
Florentina Yuni Arini
*
Universitas Negeri Semarang, Semarang,
Indonesia
- Elang Restu Kembara Universitas Negeri Semarang, Semarang, Indonesia
- Fakhri Syihamul Umam Universitas Negeri Semarang, Semarang, Indonesia
- Hasya Anaqi Baskoro Universitas Negeri Semarang, Semarang, Indonesia
- Rosita Anggun Denistyansyah Universitas Negeri Semarang, Semarang, Indonesia
- Adjie Satria Pratama Universitas Negeri Semarang, Semarang, Indonesia (*) Corresponding Author
Abstract
This study evaluates the effectiveness of user flow in the Ruangguru application by integrating Heuristic Evaluation (HE) and Cognitive Walkthrough (CW). HE was conducted by two UI/UX experts, while CW involved 62 students from lower secondary, upper secondary, and higher education levels. The research stages comprised problem identification, literature review, HE/CW scenario development, data collection, analysis, and formulation of design recommendations. HE identified 23 violations of Nielsen’s principles with an average severity rating of 2.74. The most critical issues occurred in System Status Visibility (SR = 3.2), Consistency and Standards (SR = 3.0), and Recognition rather than Recall (SR = 2.8), particularly during registration, content search, and payment transactions. CW produced an overall usability score of 4.08/5, with 63% of respondents willing to reuse the application. Interface Visibility achieved the highest score (4.10), whereas Action–Goal Association recorded the lowest score (3.81). HE exposed structural interface deficiencies, while CW revealed cognitive barriers during task execution. The combined analysis generated five recommendations: design-system standardisation, clearer status indicators, more intuitive labels, structured payment-method grouping, and contextual onboarding. This study contributes an integrated Heuristic Evaluation and Cognitive Walkthrough framework that links expert-identified interface problems with user-experienced cognitive barriers, providing a clear basis for prioritizing user-flow improvements in educational technology applications.
Downloads
References
A. Tatnall, “Education and Information Technologies,” Educ. Inf. Technol., vol. 25, no. 5, pp. 3425–3441, 2020, [Online]. Available: https://link.springer.com/article/10.1007/s10639-020-10301-5.
Y. Zou, F. Kuek, W. Feng, and X. Cheng, “Digital learning in the 21st century: trends, challenges, and innovations in technology integration,” Front. Educ., vol. 10, 2025, doi: 10.3389/feduc.2025.1562391.
B. Badrudin, M. Khusnuridlo, and M. Z. El Wahyu, “The influence of learning management information system and service quality on the customer satisfaction of Ruangguru application,” Cypriot J. Educ. Sci., vol. 17, no. 1, pp. 148–158, 2022, doi: 10.18844/cjes.v17i1.6692.
L. H. Sihombing, “Ruangguru; A Digital Assessment Tool for Enhancing Autonomous English Learning in Indonesia,” IDEAS J. English Lang. Teach. Learn. Linguist. Lit., vol. 4778, pp. 7251–7266, 2025.
S. Marhaban and I. A. Fata, “Investigating EFL Learners’ Perceptions and Practices Using the Indonesia’s Prepaid Mobile Application Ruangguru,” Al-Ta lim J., vol. 32, no. 2, pp. 133–150, 2025, [Online]. Available: https://journal.tarbiyahiainib.ac.id/index.php/attalim/article/view/996.
N. A. Hidayah, M. N. Gunawan, D. Kusumawati, Maswani, R. Handayani, and Suparto, “Student Perceptions of User Satisfaction and User Loyalty of Website Based E-Learning,” 2023 11th Int. Conf. Cyber IT Serv. Manag. CITSM 2023, 2023, doi: 10.1109/CITSM60085.2023.10455621.
A. G. Imana and Y. S. Nugroho, “Ux (User Experience) Evaluation of the Openlearning System At Universitas Muhammadiyah Surakarta Using Heuristic Evaluation and Usability Testing,” J. Tek. Inform., vol. 4, no. 4, pp. 681–691, 2023, doi: 10.52436/1.jutif.2023.4.4.824.
F. Škola, D. Boskovic, S. Rizvic, D. Skarlatos, and F. Liarokapis, “Assessing User Experience and Cognitive Workload in Virtual Reality Digital Storytelling,” Int. J. Hum. Comput. Interact., vol. 40, no. 6, pp. 1479–1486, 2024, doi: 10.1080/10447318.2023.2247846.
M. Suryani et al., “Role, Methodology, and Measurement of Cognitive Load in Computer Science and Information Systems Research,” IEEE Access, vol. 12, pp. 190007–190024, 2024, doi: 10.1109/ACCESS.2024.3514355.
W. S. Sayed et al., “AI-based adaptive personalized content presentation and exercises navigation for an effective and engaging E-learning platform,” Multimed. Tools Appl., vol. 82, no. 3, pp. 3303–3333, 2023, doi: 10.1007/s11042-022-13076-8.
L. Talero-Sarmiento, M. Gonzalez-Capdevila, A. Granollers, H. Lamos-Diaz, and K. Pistili-Rodrigues, “Towards a Refined Heuristic Evaluation: Incorporating Hierarchical Analysis for Weighted Usability Assessment,” Big Data Cogn. Comput., vol. 8, no. 6, 2024, doi: 10.3390/bdcc8060069.
H. Alkhoder and M. Al-Razgan, “An Intelligent Framework for Learnability Prediction Using Enhanced Cognitive Walkthroughs and Machine Learning,” IEEE Access, vol. 14, pp. 6619–6634, 2026, doi: 10.1109/ACCESS.2026.3652256.
J. S. Alqurni, “Evaluating the User Interface and Usability Approaches for E-Learning Systems,” Int. J. Inf. Technol. Web Eng., vol. 18, no. 1, 2023, doi: 10.4018/IJITWE.333638.
Y. Ofosu-Asare, “Enhancing user experience in online learning environments: Design, evaluation, and usability techniques,” J. Graph. Eng. Des., vol. 15, no. 4, pp. 45–59, 2024, doi: 10.24867/JGED-2024-4-045.
C. Or and A. H. S. Chan, “Inspection Methods for Usability Evaluation,” Human-Computer Interact., p. vol3:170-vol3:192, 2026, doi: 10.1201/9781003584292-37.
M. Whaiduzzaman et al., “Concept to Reality: An Integrated Approach to Testing Software User Interfaces,” Appl. Sci., vol. 13, no. 21, 2023, doi: 10.3390/app132111997.
D. Zhou, L. Wu, J. Huang, G. Lv, C. Tang, and X. Yang, “Enhancing User Experience on Social Media Platforms: A Flow Theory-Based Approach,” Int. J. Hum. Comput. Interact., vol. 41, no. 13, pp. 8280–8295, 2025, doi: 10.1080/10447318.2024.2407675.
H. Kusuma, F. S. Rue, R. Y. Rumagit, and G. D. Pratama, “Usability evaluation of Ruangguru online learning mobile application using heuristic method,” Procedia Comput. Sci., vol. 245, pp. 176–184, 2024, doi: 10.1016/j.procs.2024.10.241.
M. R. Davids, U. M. E. Chikte, and M. L. Halperin, “An efficient approach to improve the usability of e-learning resources: The role of heuristic evaluation,” Am. J. Physiol. - Adv. Physiol. Educ., vol. 37, no. 3, pp. 242–248, 2013, doi: 10.1152/advan.00043.2013.
H. Cho et al., “Assessing the Usability of a Clinical Decision Support System: Heuristic Evaluation,” JMIR Hum. Factors, vol. 9, no. 2, 2022, doi: 10.2196/31758.
M. Faudzi, Z. Cob, G. Masitah, R. Omar, and S. Sharudin, “User interface design in mobile learning applications: Developing and evaluating a questionnaire for measuring learners’ extraneous cognitive load,” Heliyon, vol. 10, no. 10, pp. 2405–8440, 2024.
W. Sangsuwan, P. Saithong, and J. Polpinij, “Transforming Higher Education with Digital Solutions: A User-Centered Design Framework for Developing Student Handbook Applications,” Eur. J. Educ. Res., vol. 15, no. 1, pp. 79–99, 2026, doi: 10.12973/eu-jer.15.1.79.
S. Syamala, A. Shrivastava, and S. Karmakar, “Enhancing User Experience in Digital Design Learning Environments Through User Interface Improvements: A Comprehensive Approach,” IEEE Access, vol. 13, pp. 182960–182976, 2025, doi: 10.1109/ACCESS.2025.3624267.
A. Scholze, S. Potkonjak, F. Marcel, G. Folinazzo, and N. Townend, “Scenarios for Learning – Scenarios as Learning: A Design-Based Research Process,” Educ. Linguist., vol. 55, pp. 113–139, 2022, doi: 10.1007/978-3-030-87124-6_6.
M. Sailer et al., “Technology-related teaching skills and attitudes: Validation of a scenario-based self-assessment instrument for teachers,” Comput. Human Behav., vol. 115, 2021, doi: 10.1016/j.chb.2020.106625.
Z. Liu and Y. Yang, “Fundamental Usability Evaluation in Visualization: Integrating Nielsen’s Principles and the Analytic Hierarchy Process,” Int. J. Hum. Comput. Interact., vol. 41, no. 20, pp. 13012–13040, 2025, doi: 10.1080/10447318.2025.2467455.
H. Tinmaz and P. K. Singh Dhillon, “User-centric avatar design: A cognitive walkthrough approach for metaverse in virtual education,” Data Sci. Manag., vol. 7, no. 4, pp. 267–282, 2024, doi: 10.1016/j.dsm.2024.05.001.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel User Flow Analysis of the Ruangguru App Using Heuristic Evaluation and Cognitive Walkthrough Methods
Pages: 92-101
Copyright (c) 2026 Florentina Yuni Arini, Elang Restu Kembara, Fakhri Syihamul Umam, Hasya Anaqi Baskoro, Rosita Anggun Denistyansyah, Adjie Satria Pratama
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
