Online Formative Assessment in Higher STEM Education; A Systematic Literature Review
DOI:
https://doi.org/10.37134/ajatel.vol11.1.5.2021Keywords:
Formative assessment, STEM education, Online formative assessment, Higher educationAbstract
Online formative assessment in higher education Science Technology Engineering and Mathematics (STEM) is gaining attention in recent years based on the increasing use of online learning. This study, aimed at critically reviewing studies on online formative assessment in Higher education STEM between 2011 to 2020. The study adopted a qualitative research design to analyze studies based on specific themes. 1402 articles were systematically searched through Scopus, web of science, and google scholar databases. However, only 12 studies were included in this study after satisfying the inclusion criteria. All data analyses were done using the Endnote X9 reference manager. The findings reveal that, evidence about online tools used, theories used in the learning and assessment process, the domain of learning outcome assessed, assessment of practical skills, and form of assessment used have been implicitly described. However, the online formative assessments have shown great potential of yielding immediate feedback. Therefore, future studies can engage in a more extensive study on areas such as online assessment tools for assessing practical skills and strategies that can enhance the effectiveness of online formative assessment which encompasses all domains of learning outcome within STEM higher education.
Downloads
References
Adedoyin, O. B., & Soykan, E. (2020). Covid-19 pandemic and online learning: the challenges and opportunities. Interactive Learning Environments, 1–13. https://doi.org/10.1080/10494820.2020.1813180
Adnan, M. (2020). Online learning amid the COVID-19 pandemic: Students perspectives. Journal of Pedagogical Research, 1(2), 45–51. https://doi.org/10.33902/jpsp.2020261309
Allo, M. D. G. (2020). Is the online learning good in the midst of Covid-19 Pandemic ? The case of EFL learners. Jurnal Sinestesia, 10(1), 1–10.
Anwari, I., Yamada, S., Unno, M., Saito, T., Suwarma, I. R., Mutakinati, L., & Kumano, Y. (2015). Implementation of authentic learning and assessment through STEM education approach to improve students’ metacognitive skills. K-12 STEM Education, 1(3), 123–136. http://www.k12stemeducation.in.th/journal/article/view/23/24
Baleni, Z. G. (2015). Online formative assessment in higher education : Its pros and cons. Electronic Journal of e-Learning, 13(4), 228–236.
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment Evaluation and Accountability, 21(September 2008), 5–31. https://doi.org/10.1007/s11092-008-9068-5
Boekaerts, M., Maes, S., & Karoly, P. (2005). Self-Regulation Across Domains of Applied Psychology : Is there an Emerging Consensus? Applied Psychology: An International Review, 54(2), 149–154.
Cabrera, I., & Villalon, J. (2013). An adaptive interface for computer-assisted rubrics in an E-marking tool using nearest neighbor. Proceedings - 2013 IEEE 13th International Conference on Advanced Learning Technologies, ICALT 2013, 72–76. https://doi.org/10.1109/ICALT.2013.27
Challis, D. (2005). Committing to quality learning through adaptive online assessment. Assessment and Evaluation in Higher Education, 30(5), 519–527. https://doi.org/10.1080/02602930500187030
Chang, S. C., Hsu, T. C., & Jong, M. S. Y. (2020). Integration of the peer assessment approach with a virtual reality design system for learning earth science. Computers and Education, 146(November 2019), 103758. https://doi.org/10.1016/j.compedu.2019.103758
Clutterbuck, P., Rowlands, T., & Seamons, O. (2015). Investigating student behavior in adopting online formative assessment feedback. International Journal of Social, Economics and Management Engineering, 9(1), 328–335.
Cohen, D., & Sasson, I. (2016). Online quizzes in a virtual learning environment as a tool for formative assessment. Journal of Technology and Science Education, 6(3), 188–208.
Davis, D., Chen, G., Hauff, C., & Houben, G. J. (2018). Activating learning at scale: A review of innovations in online learning strategies. Computers and Education, 125(June), 327–344. https://doi.org/10.1016/j.compedu.2018.05.019
Deepika, N. (2020). The impact of online learning during COVID-19: students’ and teachers’ perspective. The International Journal of Indian Psychology, 8(2), 784–793. https://doi.org/10.25215/0802.094
Dhawan, S. (2020). Online Learning: A Panacea in the Time of COVID-19 Crisis. Journal of Educational Technology Systems, 49(1), 5–22. https://doi.org/10.1177/0047239520934018
Divall, M. V., Alston, G. L., Bird, E., Buring, S. M., Kelley, K. A., Murphy, N. L., Schlesselman, L. S., Stowe, C. D., & Szilagyi, J. E. (2014). A faculty toolkit for formative assessment in pharmacy education. American Journal of Pharmaceutical Education, 78(9). https://doi.org/10.5688/ajpe789160
Elmahdi, Ismail; Al-Hattami, Abdulghani; Fawzi, H. (2018). Using technology for formative assessment to improve students’ learning. TOJET: The Turkish Online Journal of Educational Technology, 17(2), 182–188. https://eric.ed.gov/?id=EJ1176157
Elzainy, A., El Sadik, A., & Al Abdulmonem, W. (2020). Experience of e-learning and online assessment during the COVID-19 pandemic at the College of Medicine, Qassim University. Journal of Taibah University Medical Sciences, 15(6), 456–462. https://doi.org/10.1016/j.jtumed.2020.09.005
Fuad, A., & Rahim, A. (2020). Guidelines for Online Assessment in Emergency Remote Teaching during the COVID-19 Pandemic. Education in Medicine Journal, 12(2), 59–68. https://doi.org/10.21315/eimj2020.12.2.6
Galvan, J. L., & Galvan, M. C. (2017). Writing literature reviews: A guide for students of the social and behavioral sciences. New York: Routledge
Gao, X., Li, P., Shen, J., & Sun, H. (2020). Reviewing assessment of student learning in interdisciplinary STEM education. International Journal of STEM Education, 7(1). https://doi.org/10.1186/s40594-020-00225-4
Ghaicha, A. (2016). Theoretical Framework for Educational Assessment : A Synoptic Review. Journal of Education and Practice, 7(24), 212–231.
Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers and Education, 57(4), 2333–2351. https://doi.org/10.1016/j.compedu.2011.06.004
Gonzalez, H. B., & Kuenzi, J. (2012). What Is STEM Education and Why Is It Important? Congressional Research Service, August, 1–15. https://www.ccc.edu/departments/Documents/STEM_labor.pdf
Gotwals, A. W., Philhower, J., Cisterna, D., & Bennett, S. (2015). Using video to examine formative assessment practices as measures of expertise for mathematics and science teachers. International Journal of Science and Mathematics Education, 13(2), 405–423. https://doi.org/10.1007/s10763-015-9623-8
Greene, J. A., Azevedo, R., & Greene, J. A. (2007). Review of Educational New Perspectives and Directions. Review of Educational Research, 77(3), 334-372. https://doi.org/10.3102/003465430303953
Hansen, G., & Ringdal, R. (2018). Studies in educational evaluation formative assessment as a future step in maintaining the mastery-approach and performance-avoidance goal stability. Studies in Educational Evaluation, 56(November 2017), 59–70. https://doi.org/10.1016/j.stueduc.2017.11.005
Harizah, Z., Kusairi, S., & Latifah, E. (2020). Student’s critical thinking skills in interactive demonstration learning with web based formative assessment. Journal of Physics: Conference Series, 1567(4). https://doi.org/10.1088/1742-6596/1567/4/042038
Haug, B. S., & Ødegaard, M. (2015). Formative assessment and teachers’ sensitivity to student responses. International Journal of Science Education, 37(4), 629–654. https://doi.org/10.1080/09500693.2014.1003262
Hooshyar, D., Ahmad, R. B., Yousefi, M., Fathi, M., Abdollahi, A., Horng, S.-J., & Lim, H. (2016). A solution-based intelligent tutoring system integrated with an online game-based formative assessment: development and evaluation. Educational Technology Research and Development, 64(4), 787–808. https://doi.org/10.1007/s11423-016-9433-x
Jeong, J. S., González-Gómez, D., & Prieto, F. Y. (2020). Sustainable and flipped stem education: Formative assessment online interface for observing pre-service teachers’ performance and motivation. Education Sciences, 10(10). https://doi.org/10.3390/educsci10100283
Kamioka, H. (2019). Preferred reporting items for systematic review and meta-analysis protocols (prisma-p) 2015 statement. Japanese Pharmacology and Therapeutics, 47(8), 1177–1185.
Kerr, S., Muller, D., Mckinon, W., & Inerney, P. M. (2016). An online formative assessment tool to prepare students for summative assessment in physiology. 8(1), 72–76. https://doi.org/10.7196/AJHPE.2016.v8i1.581
Kibble, J. (2007). Use of unsupervised online quizzes as formative assessment in a medical physiology course : effects of incentives on student participation and performance. Advance Physiology Education, 6, 253–260. https://doi.org/10.1152/advan.00027.2007.
Kusairi, S., Noviandari, L., Parno, & Pratiwi, H. Y. (2019). Analysis of students’ understanding of motion in straight line concepts: Modeling Instruction with formative E-Assessment. International Journal of Instruction, 12(4), 353–364. https://doi.org/10.29333/iji.2019.12423a
Lestari, T. P., & Sumarti, S. S. (2018). STEM-Based Project Based Learning Model to Increase Science Process and Creative Thinking Skills of 5th Grade. Journal of Primary Education, 7(1), 18–24.
Lin, C. Y., & Wang, T. H. (2017). Implementation of personalized e-assessment for remedial teaching in an e-learning environment. Eurasia Journal of Mathematics, Science and Technology Education, 13(4), 1045–1058. https://doi.org/10.12973/eurasia.2017.00657a
Lu, X., Zheng, D., & Liu, L. (2018). Data driven analysis on the effect of online judge system. Proceedings - 2017 IEEE International Conference on Internet of Things, IEEE Green Computing and Communications, IEEE Cyber, Physical and Social Computing, IEEE Smart Data, IThings-GreenCom-CPSCom-SmartData 2017, 2018-Janua, 573–577. https://doi.org/10.1109/iThings-GreenCom-CPSCom-SmartData.2017.90
McDonald, C. (2016). STEM Education: A Review of the Contribution of the Disciplines of Science, Technology, Engineering and Mathematics. Science Education International, 27(4), 530–569.
Moharreri, K., Ha, M., & Nehm, R. H. (2014). EvoGrader : an online formative assessment tool for automatically evaluating written evolutionary explanations. Evolution: Education and Outreach, 7(15), 1-14.
Moher D, A, L., J, T., & DG, A. (2009). Preferred Reporting Items for Systematic Reviews and MetaAnalyses. PLoS Medicine, 6, 1–2. https://doi.org/10.1371/journal.pmed1000097
Nikolic, S., Stirling, D., & Ros, M. (2018). Formative assessment to develop oral communication competency using YouTube: self- and peer assessment in engineering. European Journal of Engineering Education, 43(4), 538–551. https://doi.org/10.1080/03043797.2017.1298569
Paiva, R. C., Ferreira, M. S., & Frade, M. M. (2017). Intelligent tutorial system based on personalized system of instruction to teach or remind mathematical concepts. Journal of Computer Assisted Learning, 33(4), 370–381. https://doi.org/10.1111/jcal.12186
Panadero, E., & Brown, G. T. L. (2017). Teachers’ reasons for using peer assessment: positive experience predicts use. European Journal of Psychology of Education, 32(1), 133–156. https://doi.org/10.1007/s10212-015-0282-5
Robert, M. C., & Scott, W. S. (2013). Stem project-based learning (M. C. Robert, M. M. Capraro, & R. M. James (eds.)). Boston: Sense Publishers
Sangwin, C.J., & Köcher, N. (2016). Automation of mathematics examinations. Computers and Education, 94, 215–227. https://doi.org/10.1016/j.compedu.2015.11.014
Sangwin, Christopher J., & Köcher, N. (2016). Automation of mathematics examinations. Computers and Education, 94, 215–227. https://doi.org/10.1016/j.compedu.2015.11.014
Schleicher, A. (2020). The impact of COVID-19 on education: Insights from education at a glance 2020. OECD Journal: Economic Studies, 1–31. https://www.oecd.org/education/the-impact-of-covid-19-on-education-insights-education-at-a-glance-2020.pdf
Singh, V. K., Kumari, P., Singh, A., & Thapa, J. (2011). An automated course feedback system using opinion mining. Proceedings of the 2011 World Congress on Information and Communication Technologies, WICT 2011, 72–76. https://doi.org/10.1109/WICT.2011.6141220
Sridharan, B., & Boud, D. (2019). The effects of peer judgements on teamwork and self-assessment ability in collaborative group work. Assessment and Evaluation in Higher Education, 44(6), 894–909. https://doi.org/10.1080/02602938.2018.1545898
Taber, K. S. (2013). Revisiting the chemistry triplet: Drawing upon the nature of chemical knowledge and the psychology of learning to inform chemistry education. Chemistry Education Research and Practice, 14(2), 156–168. https://doi.org/10.1039/c3rp00012e
Tsai, F., Tsai, C., & Lin, K. (2015). Computers & Education The evaluation of different gaming modes and feedback types on game-based formative assessment in an online learning environment. Computers & Education, 81, 259–269. https://doi.org/10.1016/j.compedu.2014.10.013
Uribe, S. N., & Vaughan, M. (2017). Facilitating student learning in distance education: a case study on the development and implementation of a multifaceted feedback system. Distance Education, 38(3), 288–301. https://doi.org/10.1080/01587919.2017.1369005
Ventista, O. M. (2018). Self-assessment in massive open online courses. E-Learning and Digital Media, 15(4), 165–175. https://doi.org/10.1177/2042753018784950
Walker, P., Rhys Gwynllyw, D., & Henderson, K. L. (2015). Diagnosing student errors in e-Assessment questions. Teaching Mathematics and Its Applications, 34(3), 160–170. https://doi.org/10.1093/teamat/hrv010
Wang, D., & Han, H. (2020). Applying learning analytics dashboards based on process-oriented feedback to improve students’ learning effectiveness. Journal of Computer Assisted Learning, February, 1–13. https://doi.org/10.1111/jcal.12502
White, D. W. (2014). What is STEM education and why is it important. Florida Association of Teacher Educators Journal, 1(14), 1-9.
Wu, X. V., Chan, Y. S., Tan, K. H. S., & Wang, W. (2018). A systematic review of online learning programs for nurse preceptors. Nurse Education Today, 60(April 2017), 11–22. https://doi.org/10.1016/j.nedt.2017.09.010
Yuliana, I., Kusairi, S., Taufiq, A., Priyadi, R., & Rosyidah, N. D. (2020). The analysis of students’ problem-solving ability in the 5E learning cycle with formative e-assessment. AIP Conference Proceedings, 2215(April). https://doi.org/10.1063/5.0000751
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Mangai Solomon Mahanan, Corrienna Abdul Talib, Nor Hasniza Ibrahim
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
