Adapting the Bebras Challenge into an Educational Game for Learning Computational Thinking and Assessing Its Usability

Authors

  • Sukirman Sukirman Universitas Muhammadiyah Surakarta
  • Irma Yuliana Universitas Muhammadiyah Surakarta
  • Fakhri Aulia Wildan Ramadhan Universitas Muhammadiyah Surakarta

DOI:

https://doi.org/10.33394/jtp.v11i1.15373

Keywords:

Bebras Challenge, computational thinking, educational game, usability, game-based learning

Abstract

Computational thinking (CT) has become an essential component of secondary education, with several countries, including Indonesia, integrating CT tasks, such as those from the Bebras Challenge, into the national informatics curriculum. However, these tasks are often presented in static and text-based formats, limiting their potential to engage learners in interactive and meaningful ways. This study aimed to develop and evaluate the usability of an educational game adapted from a Bebras Challenge problem, "Magic Potion". It was designed to be aligned with the Grade 8 Informatics curriculum in Indonesia. The game engages students in CT through experimentation-based gameplay, where players mix potions to observe the effects on digital flowers and deduce which potion contains water. Using a Design and Development Research (DDR) framework, the game was tested with 55 junior high school students, who then completed the System Usability Scale (SUS) and open-ended feedback questions. The results yielded a mean SUS score of 75.3, indicating good usability. Qualitative feedback highlighted the game’s visual appeal, interactivity, and cognitive engagement. These findings suggest that curriculum-based CT tasks can be effectively transformed into engaging game-based learning tools, offering accessible entry points for introducing CT in formal educational contexts.

Author Biographies

Sukirman Sukirman, Universitas Muhammadiyah Surakarta

Pendidikan Teknik Informatika, Fakultas Keguruan dan Ilmu Pendidikan

Irma Yuliana, Universitas Muhammadiyah Surakarta

Pendidikan Teknik Informatika, Fakultas Keguruan dan Ilmu Pendidikan

Fakhri Aulia Wildan Ramadhan, Universitas Muhammadiyah Surakarta

Pendidikan Teknik Informatika, Fakultas Keguruan dan Ilmu Pendidikan

References

Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4(3), 114–123.

Barz, N., Benick, M., Dörrenbächer-Ulrich, L., & Perels, F. (2025). The evaluation of an educational game to promote pre-service teachers’ self-regulated learning. Entertainment Computing, 52, 100836. https://doi.org/10.1016/j.entcom.2024.100836

Bauer, A., Zufle, M., Herbst, N., & Kounev, S. (2019). Best practices for time series forecasting (Tutorial). Proceedings - 2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems, FAS*W 2019, 255–256. https://doi.org/10.1109/FAS-W.2019.00069

Brennan, K., & Resnick, M. (2012). New frameworks for studying and assessing the development of computational thinking. Proceedings of the 2012 Annual Meeting of the American Educational Research Association, Vancouver, Canada, 1, 25.

Brooke, J. (1996). SUS: A “quick and dirty” usability scale. Usability Evaluation in Industry, 189(194), 4–7.

Cachero, C., Barra, P., Meliá, S., & López, O. (2020). Impact of Programming Exposure on the Development of Computational Thinking Capabilities: An Empirical Study. IEEE Access, 8, 72316–72325. https://doi.org/10.1109/ACCESS.2020.2987254

Chen, C.-H., & Chang, C.-L. (2024). Effectiveness of AI-assisted game-based learning on science learning outcomes, intrinsic motivation, cognitive load, and learning behavior. Education and Information Technologies, 29(14), 18621–18642. https://doi.org/10.1007/s10639-024-12553-x

Chen, Y., Wu, J., Han, J., Zhao, H., & Deng, S. (2024). A Game-Theoretic Approach-Based Task Offloading and Resource Pricing Method for Idle Vehicle Devices Assisted VEC. IEEE Internet of Things Journal, 11(12), 21954–21969. https://doi.org/10.1109/JIOT.2024.3381183

Dagienė, V., Stupurienė, G., & Vinikienė, L. (2016). Promoting Inclusive Informatics Education Through the Bebras Challenge to All K-12 Students. Proceedings of the 17th International Conference on Computer Systems and Technologies 2016, 407–414. https://doi.org/10.1145/2983468.2983517

Dagiene, V., Stupuriene, G., & Vinikiene, L. (2023). Computer Science in K-12 with Bebras Challenge: 20 Years of Lithuanian Experience. Proceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 2, 637–637. https://doi.org/10.1145/3587103.3594233

Fatihatussa’adah, I., Yamtinah, S., Ariani, S. R. D., Wiyarsi, A., Widarti, H. R., Shidiq, A. S., & Abrori, F. M. (2024). Fostering Collaboration and Enhancing Student Learning Achievement through the Integration of Ethnoscience in the Common Knowledge Construction Model with Podcast Media. Indonesian Journal on Learning and Advanced Education (IJOLAE), 295–314. https://doi.org/10.23917/ijolae.v6i3.23222

Giannakoulas, A., & Xinogalos, S. (2018). A pilot study on the effectiveness and acceptance of an educational game for teaching programming concepts to primary school students. Education and Information Technologies, 23(5), 2029–2052. https://doi.org/10.1007/s10639-018-9702-x

Gris, G., & Bengtson, C. (2021). Assessment Measures in Game-based Learning Research. International Journal of Serious Games, 8(1), 3–26. https://doi.org/10.17083/ijsg.v8i1.383

Grover, S., & Pea, R. (2013). Computational Thinking in K–12: A Review of the State of the Field. Educational Researcher, 42(1), 38–43. https://doi.org/10.3102/0013189X12463051

Kalelioğlu, F. (2015). A new way of teaching programming skills to K-12 students: Code.org. Computers in Human Behavior, 52, 200–210. https://doi.org/https://doi.org/10.1016/j.chb.2015.05.047

Kemdikbud, D. (2019). Kesiapan Sekolah Menengah Pertama dan Sekolah Menengah Atas dalam Menerapkan Informatika sebagai Mata Pelajaran pada Tahun 2019/2020.

Lamb, R. L., Annetta, L., Firestone, J., & Etopio, E. (2018). A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using serious educational games, serious games, and simulations. Computers in Human Behavior, 80, 158–167. https://doi.org/10.1016/j.chb.2017.10.040

Lewis, J. R. (2018). The System Usability Scale: Past, Present, and Future. International Journal of Human–Computer Interaction, 34(7), 577–590. https://doi.org/10.1080/10447318.2018.1455307

Masduki, M., Khotimah, R. P., Sukirman, S., Kurniawati, S., & Hidayati, I. N. (2024). Exploring mathematics teacher’s perceptions of students’ computational thinking and attitudes towards STEAM-AR: A need for module development. JRAMathEdu (Journal of Research and Advances in Mathematics Education). https://doi.org/10.23917/jramathedu.v9i2.10830

McKenney, S., & Reeves, T. C. (2014). Educational design research. Handbook of Research on Educational Communications and Technology, 131–140.

Nielsen, J. (1992). Finding usability problems through heuristic evaluation. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 373–380. https://doi.org/https://doi.org/10.1145/142750.142834

Papert, S. (1980). Mindstorms: Children, computers, and powerful ideas. Basic Books, Inc.

Piaget, J. (2013). The construction of reality in the child. Routledge.

Prensky, M. (2003). Digital game-based learning. Computers in Entertainment, 1(1), 21. https://doi.org/10.1145/950566.950596

Richey, R. C., & Klein, J. D. (2007). Design and Development Research: Methods, Strategies, and Issues. Lawrence Erlbaum Associates. https://doi.org/10.4324/9780203826034

Richey, R. C., & Klein, J. D. (2008). Research on design and development. In J. M. Spector, M. D. Merrill, J. van Merriënboer, & M. P. Driscoll (Eds.), Handbook of Research on Educational Communications and Technology (3rd ed., pp. 748–757). Lawrence Erlbaum Associates.

Sari, C. K., Murtiyasa, B., Machromah, I. U., Ramadhani, N. A., Rejeki, S., Murtiyasa, B., Palupi, R., & Yuliana, I. (2025). Infusing Unplugged Computational Thinking into a Probability Worksheet for Students’ Mathematical Literacy. IJORER : International Journal of Recent Educational Research, 6(6), 1896–1910. https://doi.org/10.46245/ijorer.v6i6.1026

Scherer, R., Siddiq, F., & Sánchez Viveros, B. (2020). A meta-analysis of teaching and learning computer programming: Effective instructional approaches and conditions. Computers in Human Behavior, 109, 106349. https://doi.org/https://doi.org/10.1016/j.chb.2020.106349

SUKIRMAN, S., IBHARIM, L. F. M., SAID, C. S., & MURTIYASA, B. (2022). A Strategy of Learning Computational Thinking through Game Based in Virtual Reality: Systematic Review and Conceptual Framework. Informatics in Education, 21(1), 179–200. https://doi.org/10.15388/infedu.2022.07

Thota, N., & Berglund, A. (2016). Learning Computer Science: Dimensions of Variation Within What Chinese Students Learn. ACM Transactions on Computing Education, 16(3), 1–27. https://doi.org/10.1145/2853199

Vita-Barrull, N., Estrada-Plana, V., March-Llanes, J., Sotoca-Orgaz, P., Guzmán, N., Ayesa, R., & Moya-Higueras, J. (2024). Do you play in class? Board games to promote cognitive and educational development in primary school: A cluster randomized controlled trial. Learning and Instruction, 93, 101946. https://doi.org/10.1016/j.learninstruc.2024.101946

Wing, J. M. (2006). Computational Thinking. Commun. ACM, 49(3), 33–35. https://doi.org/10.1145/1118178.1118215

Xiang, M., Zhang, L., Liu, Y., Wang, X., & Shang, J. (2025). Acquisition of math knowledge in digital and non-digital game-based learning classrooms: Impact of intrinsic motivation and cognitive load. Entertainment Computing, 52, 100869. https://doi.org/10.1016/j.entcom.2024.100869

Yuliana, I., Hermawan, H. D., Prayitno, H. J., Ratih, K., Adhantoro, M. S., Hidayati, H., & Ibrahim, M. H. (2021). Computational Thinking Lesson in Improving Digital Literacy for Rural Area Children via CS Unplugged. Journal of Physics: Conference Series, 1720(1), 012009. https://doi.org/10.1088/1742-6596/1720/1/012009

Yulianto, A. R., Hendri, A. S., Sudaryanto, A. P., & Hanif, M. I. (2024). Empowering Early Education: Developing a Hijaiyah Game for Preschoolers. Khazanah Informatika : Jurnal Ilmu Komputer Dan Informatika, 10(1), 78–87. https://doi.org/10.23917/khif.v10i1.2286

Downloads

Published

2026-01-31

How to Cite

Sukirman, S., Yuliana, I., & Ramadhan, F. A. W. (2026). Adapting the Bebras Challenge into an Educational Game for Learning Computational Thinking and Assessing Its Usability. Jurnal Teknologi Pendidikan : Jurnal Penelitian Dan Pengembangan Pembelajaran, 11(1), 124–135. https://doi.org/10.33394/jtp.v11i1.15373

Issue

Vol. 11 No. 1 (2026): Januari

Section

Articles

License

Copyright (c) 2026 Sukirman Sukirman, Irma Yuliana, Fakhri Aulia Wildan Ramadhan

Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

License and Publishing Agreement
In submitting the manuscript to the journal, the authors certify that:

  • They are authorized by their co-authors to enter into these arrangements.
  • The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
  • That it is not under consideration for publication elsewhere,
  • That its publication has been approved by all the author(s) and by the responsible authorities – tacitly or explicitly – of the institutes where the work has been carried out.
  • They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
  • They agree to the following license and publishing agreement.

Copyright

  1. Authors who publish with JTP agree to the following terms:
  2. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
  3. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
  4. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
  5. Licensing for Data Publication

Licensing for Data Publication

JTP use a variety of waivers and licenses, that are specifically designed for and appropriate for the treatment of data:
Open Data Commons Attribution License, http://www.opendatacommons.org/licenses/by/1.0/ (default)