Developing a game-based learning assessment framework towards ubiquitous computational thinking among undergraduate students
Keywords:game-based learning, computational thinking, assessment framework, learning assessment, video games
This article discusses on a working study from a research on the usage of a game-based learning assessment framework as a standard guideline to assess undergraduate students' understanding and performance towards ubiquitous computational thinking properly. The objective of this research is to construct an appropriate game-based learning assessment framework to learn ubiquitous computational thinking and to determine the importance of the game-based learning approach. The methods in conducting this research study are a mixed method research with Delphi methodology approach. The game-based learning assessment framework was constructed based on results gathered by literature reviewing papers and afterward questionnaires as an online survey given to experts from game development and computer science fields by phases to answer and validate. The results gathered according to phases were performed using thematic analysis and descriptive statistics respectively. The expected results of this study are that the game-based learning assessment framework is able to assess undergraduate students’ understanding and learning performance towards ubiquitous computational thinking and also able to align and incorporate into computing curriculum.
Abdulmajed, H., Park, Y. S., & Tekian, A. (2015). Assessment of educational games for health professions: A systematic review of trends and outcomes. Medical Teacher, 37(1), 27-32. https://doi.org/10.3109/0142159X.2015.1006609
Barak, M., & Williams, P. (2007). Learning elemental structures and dynamic processes in technological systems: A cognitive framework. International Journal of Technology and Design Education, 17(3), 323-340. https://doi.org/10.1007/s10798-006-9006-0
Bellotti, F., Kapralos, B., Lee, K., Moreno-Ger, P., & Berta, R. (2013). Assessment in and of serious games: An overview. Advances in Human-Computer Interaction, 1–11. https://doi.org/10.1155/2013/136864
Bennedsen, J., Caspersen, M. E., & Kölling, M. (Eds.). (2008). Reflections on the teaching of programming: Methods and implementations (Vol. 4821). Springer.
Csizmadia, A., Curzon, P., Dorling, M., Humphreys, S., Ng, T., Selby, C., & Woollard, J. (2015). Computational thinking: A guide for teachers. Hachette, UK: Hodder Education.
de Jesus, Â. M., & Silveira, I. F. (2019, November). A collaborative game-based learning framework to improve computational thinking skills. In 2019 International Conference on Virtual Reality and Visualization (ICVRV) (pp. 161-166). IEEE. https://doi.org/10.1109/ICVRV47840.2019.00038
Gardner, M. (2017). Understanding integrated STEM science instruction through the experiences of teachers and students. Phd Dissertation. Syracuse University.
Gokhale, A., & Machina, K. (2018). Guided online group discussion enhances student critical thinking skills. International Journal on E-Learning, 17(2), 157-173.
Grime, M. M., & Wright, G. (2014). Delphi Method. Wiley Online Library, https://doi.org/10.1002/9781118445112.stat07879
Gris, G., & Bengtson, C. (2021). Assessment measures in game-based learning research: A systematic review. International Journal of Serious Games, 8(1), 3-26. https://doi.org/10.17083/ijsg.v8i1.383
Guenaga, M., Eguíluz, A., Garaizar, P., & Gibaja, J. (2021). How do students develop computational thinking? Assessing early programmers in a maze-based online game. Computer Science Education, 31(2), 259-289. https://doi.org/10.1080/08993408.2021.1903248
Habibi, A., Sarafrazi, A., & Izadyar, S. (2014). Delphi technique theoretical framework in qualitative research. The International Journal of Engineering and Science, 3(4), 8-13.
Hasson, F., Keeney, S., & McKenna, H. (2000). Research guidelines for the Delphi survey technique. Journal of advanced nursing, 32(4), 1008-1015.
Hsu, T. C., Chang, S. C., & Hung, Y. T. (2018). How to learn and how to teach computational thinking: Suggestions based on a review of the literature. Computers & Education, 126, 296-310. https://doi.org/10.1016/j.compedu.2018.07.004
Israel-Fishelson, R., & Hershkovitz, A. (2020). Persistence in a game-based learning environment: The case of elementary school students learning computational thinking. Journal of Educational Computing Research, 58(5), 891-918. https://doi.org/10.1177/0735633119887187
Kalelioglu, F., Gulbahar, Y., & Kukul, V. (2016). A framework for computational thinking based on a systematic research review. Baltic Journal of Modern Computing, 4(3), 583-596
Kazimoglu, C., Kiernan, M., Bacon, L., & Mackinnon, L. (2012). A serious game for developing computational thinking and learning introductory computer programming. Procedia-Social and Behavioral Sciences, 47, 1991-1999. https://doi.org/10.1016/j.sbspro.2012.06.938
Kotini, I., & Tzelepi, S. (2015). A gamification-based framework for developing learning activities of computational thinking. In Gamification in Education and Business (pp. 219-252). Springer, Cham.
Loh, C. S. (2012). Information trails: In-process assessment of game-based learning. In Assessment in game-based learning (pp. 123-144). Springer, New York, NY.
Peteranetz, M. S., Flanigan, A. E., Shell, D. F., & Soh, L. K. (2018). Helping engineering students learn in introductory computer science (CS1) using computational creativity exercises (CCEs). IEEE Transactions on Education, 61(3), 195-203. https://doi.org/10.1109/TE.2018.2804350
Seng, W. Y., Yatim, M. H. M., & Hoe, T. W. (2018). Learning object-oriented programming paradigm via game-based learning game—Pilot study. Int. J. Multimed. Its Appl, 10, 181-197. https://doi.org/10.5121/ijma.2018.10615
Sidek, S. F., Yatim, M. H. M., & Said, C. S. (2020). Characterizing computational thinking for tertiary education learning. Journal of Contemporary Issues and Thought, 10(1), 58-69. https://doi.org/10.37134/jcit.vol10.sp.6.2020
Sitzmann, T. (2011). A meta‐analytic examination of the instructional effectiveness of computer‐based simulation games. Personnel Psychology, 64(2), 489-528. https://doi.org/10.1111/j.1744-6570.2011.01190.x
Turchi, T., Fogli, D., & Malizia, A. (2019). Fostering computational thinking through collaborative game-based learning. Multimedia Tools and Applications, 78(10), 13649-13673. https://doi.org/10.1111/j.1744-6570.2011.01190.x
Van Staalduinen, J. P., & De Freitas, S. (2011). A game-based learning framework: Linking game design and learning. In Learning to play: Exploring the future of education with video games, 53, 29-53.
Wang, C. S., Liu, C. C., & Li, Y. C. (2011, October). A game-based learning content design framework for the elementary school children education. In The 16th North-East Asia Symposium on Nano, Information Technology and Reliability (pp. 53-57). IEEE. https://doi.org/10.1109/NASNIT.2011.6111121
Watson, C., & Li, F. W. (2014, June). Failure rates in introductory programming revisited. In Proceedings of the 2014 conference on Innovation & technology in computer science education (pp. 39-44).
Weintrop, D., Holbert, N., Horn, M. S., & Wilensky, U. (2016). Computational thinking in constructionist video games. International Journal of Game-Based Learning (IJGBL), 6(1), 1-17. https://doi.org/10.4018/IJGBL.2016010101
Wu, M. L., & Richards, K. (2011, September). Facilitating computational thinking through game design. In International Conference on Technologies for E-Learning and Digital Entertainment (pp. 220-227). Springer, Berlin, Heidelberg.
Yatim, M. H. M. (2021). A classification of computational thinking model based on computational thinking abilities in game-based learning activities. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(3), 1029-1035. https://doi.org/10.13189/ujer.2020.080135