Reka bentuk ekspresi wajah dan tahap realistik Talking-Head dan kesannya terhadap emosi pelajar
DOI:
https://doi.org/10.37134/bitara.vol14.sp.1.2021Keywords:
Animasi, emosi, ekspresi wajah, talking-head, realistikAbstract
Animasi talking-head merupakan pendekatan yang boleh digunakan sebagai perwakilan guru atau agen pedagogi dalam medium pembelajaran digital. Namun, animasi talking-head berpotensi mengakibatkan ketidakselesaan sekiranya reka bentuk karakter talking-head yang tidak betul digunakan. Oleh itu, artikel ini akan membincangkan serta mencadangkan suatu kerangka konseptual bagi panduan untuk kajian-kajian berkaitan permasalahan ini. Kerangka konseptual ini dibina berdasarkan teori, prinsip dan tinjauan literatur yang dilakukan. Artikel ini juga menggariskan cadangan kajian lanjutan untuk mengukuhkan lagi kerangka konseptual yang dibina.
This The talking-head animation is an instructional approach that can be utilized to represent teachers or pedagogical agents in the digital learning medium. However, talking-head animation can potentially become a source of distraction in learning due to insufficient design of the talking-head characters. Therefore, this article will discuss and suggest a conceptual framework as a guidance for studies related to such problems. This conceptual framework is constructed based on the theories, principles and relevant literature reviews. This article also outlines future research suggestions to further strengthen the conceptual framework that has been developed.
Keywords: Animation, emotion, face expression, talking-head, realistic
Downloads
References
Ahmad Zamzuri, M. A. (2018). Multimedia dan perisian pendidikan panduan praktikal reka bentuk dan penyelidikan. Tanjong Malim, Perak: Penerbit Universiti Pendidikan Sultan Idris.
Ahmed, W., van der Werf, G., Kuyper, H., & Minnaert, A. (2013). Emotions, self-regulated learning, and achievement in mathematics: A growth curve analysis. Journal of Educational Psychology, 105(1), 150–161. https://doi.org/10.1037/a0030160
Bakker, I., van der Voordt, T., Vink, P., & de Boon, J. (2014). Pleasure, arousal, dominance: Mehrabian and russell revisited. Current Psychology, 33(3), 405–421. https://doi.org/10.1007/s12144-014-9219-4
Barrett, L. F., Quigley, K. S., Bliss-Moreau, E., & Aronson, K. R. (2004). Interoceptive sensitivity and self-reports of emotional. Journal of Personality and Social Psychology, 87(5), 684–697. https://doi.org/10.1038/jid.2014.371
Baylor, A. L. (2011). The design of motivational agents and avatars. Educational Technology Research And Development, 59(2), 291–300. https://doi.org/10.1007/s11423-011-9196-3
Brom, C., Stárková, T., & D’Mello, S. K. (2018). How effective is emotional design? A meta-analysis on facial anthropomorphisms and pleasant colors during multimedia learning. Educational Research Review, 25, 100–119. https://doi.org/10.1016/j.edurev.2018.09.004
Buff, A., Reusser, K., Rakoczy, K., & Pauli, C. (2011). Activating positive affective experiences in the classroom: “ Nice to have” or something more? Learning and Instruction, 21(3), 452–466. https://doi.org/10.1016/j.learninstruc.2010.07.008
Bynion, T. M., & Feldner, M. T. (2017). Self-Assessment Manikin. In V. Zeigler-Hill & T. K. Shackelford (Eds.), Encyclopedia of Personality and Individual Differences (pp. 1–3). https://doi.org/10.1007/978-3-319-28099-8_77-1
Cheetham, M., Wu, L., Pauli, P., & Jancke, L. (2015). Arousal, valence, and the uncanny valley: Psychophysiological and self-report findings. Frontiers in Psychology, 6, 1–15. https://doi.org/10.3389/fpsyg.2015.00981
Dey, P., Maddock, S., & Nicolson, R. (2010). Evaluation of a viseme-driven talking head. In J. Collomosse & I. Grimstead (Eds.), EG UK Theory and Practice of Computer Graphics (pp. 139–142). https://doi.org/10.2312/LocalChapterEvents/TPCG/TPCG10/139-142
Domagk, S. (2010). Do pedagogical agents facilitate learner motivation and learning outcomes? Journal of Media Psychology, 22(2), 82–95. https://doi.org/10.1027/1864-1105/a000011
Frenzel, A. C., Pekrun, R., & Goetz, T. (2007). Perceived learning environment and students’ emotional experiences: A multilevel analysis of mathematics classrooms. Learning and Instruction, 17(5), 478–493. https://doi.org/10.1016/j.learninstruc.2007.09.001
Ganotice, F. A., Datu, J. A. D., & King, R. B. (2016). Which emotional profiles exhibit the best learning outcomes? A person-centered analysis of students academic emotions. School Psychology International, 37(5), 498–518. https://doi.org/10.1177/0143034316660147
Gläser-Zikuda, M., Stuchlíková, I., & Janík, T. (2013). Emotional aspects of learning and teaching: Reviewing the field-discussing the issues. Orbis Scholae, 7(2), 7–22. https://doi.org/10.14712/23363177.2015.18
Goetz, T., Keller, M. M., Lüdtke, O., Nett, U. E., & Lipnevich, A. A. (2019). The dynamics of real-time classroom emotions: Appraisals mediate the relation between students’ perceptions of teaching and their emotions. Journal of Educational Psychology, 1(999), 1–18. https://doi.org/10.1037/edu0000415
Gulz, A., & Haake, M. (2006). Design of animated pedagogical agents — A look at their look. International Journal of Human-Computer Studies, 64(4), 322–339. https://doi.org/10.1016/j.ijhcs.2005.08.006
Jia, J., Wu, Z., Zhang, S., Meng, H. M., & Cai, L. (2014). Head and facial gestures synthesis using PAD model for an expressive talking avatar. Multimedia Tools and Applications, 73(1), 439–461. https://doi.org/10.1007/s11042-013-1604-8
Kim, Y., & Baylor, A. L. (2016). Research-based design of pedagogical agent roles: A review, progress, and recommendations. International Journal of Artificial Intelligence in Education, 26(1), 160–169. https://doi.org/10.1007/s40593-015-0055-y
Kim, Y., Thayne, J., & Wei, Q. (2017). An embodied agent helps anxious students in mathematics learning. Educational Technology Research and Development, 65(1), 219–235. https://doi.org/10.1007/s11423-016-9476-z
Krämer, N., Kopp, S., Becker-Asano, C., & Sommer, N. (2013). Smile and the world will smile with you - The effects of a virtual agent’s smile on users’ evaluation and behavior. International Journal of Human Computer Studies, 71(3), 335–349. https://doi.org/10.1016/j.ijhcs.2012.09.006
Ku, J., Jang, H. J., Kim, K. U., Kim, J. H., Park, S. H., Lee, J. H., … Sun I. Kim. (2005). Experimental results of affective valence and arousal to avatar’s facial expressions. CyberPsychology & Behavior, 8(5), 493–503. https://doi.org/http://doi.org/10.1089/cpb.2005.8.493
Kunz, S. (2015). The problem of realism in animated characters – has the uncanny valley been crossed? International Conference in Illustration & Animation, 74–86. Braga, Portugal: IPCA.
Kuppens, P. (2008). Individual differences in the relationship between pleasure and arousal. Journal of Research in Personality, 42(4), 1053–1059. https://doi.org/10.1016/j.jrp.2007.10.007
Kuppens, P., Tuerlinckx, F., Yik, M., Koval, P., Coosemans, J., Zeng, K. J., & Russell, J. A. (2017). The relation between valence and arousal in subjective experience varies with personality and culture. Journal of Personality, 85(4), 530–542. https://doi.org/10.1111/jopy.12258
Lawson, A. P., Mayer, R. E., Adamo-Villani, N., Benes, B., Lei, X., & Cheng, J. (2021). Recognizing the emotional state of human and virtual instructors. Computers in Human Behavior, 114(May 2020), 106554. https://doi.org/10.1016/j.chb.2020.106554
Lay, S., Brace, N., Pike, G., & Pollick, F. (2016). Circling around the uncanny valley: Design principles for research into the relation between human likeness and eeriness. I-Perception, 7(6), 1–11. https://doi.org/10.1177/2041669516681309
Linnenbrink-Garcia, L., Patall, E. A., & Pekrun, R. (2016). Adaptive motivation and emotion in education: Research and principles for instructional design. Policy Insights from the Behavioral and Brain Sciences, 3(2), 228–236. https://doi.org/10.1177/2372732216644450
Lisetti, C., & Hudlicka, E. (2015). Why and how to build emotion-based agent architectures. In Rafael Calvo, S. D’Mello, J. Gratch, & A. Kappas (Eds.), The Oxford Handbook of Affective Computing (pp. 94–109). https://doi.org/10.1093/oxfordhb/9780199942237.013.019
MacDorman, K. F., Green, R. D., Ho, C. C., & Koch, C. T. (2009). Too real for comfort? Uncanny responses to computer generated faces. Computers in Human Behavior, 25(3), 695–710. https://doi.org/10.1016/j.chb.2008.12.026
Marieke, R., Elliot, A. J., & De Dreu, C. K. W. (2014). Why is avoidance motivation problematic, and what can be done about it? Current Directions in Psychological Science, 23(2), 133–138. https://doi.org/https://doi.org/10.1177/0963721414524224
Mathur, M. B., & Reichling, D. B. (2016). Navigating a social world with robot partners: A quantitative cartography of the Uncanny Valley. Cognition, 146, 22–32. https://doi.org/10.1016/j.cognition.2015.09.008
Mori, M. (1970). The uncanny valley. Energy, 7(4), 33–35.
Mori, M. (2012). The uncanny valley (K. F. MacDorman & N. Kageki, Trans.). IEEE Robotics and Automation Magazine, 19(2), 98–100. https://doi.org/http://dx.doi.org/10.1109/MRA. 2012.2192811
Muhammad Ihsan, R., Ahmad Zamzuri, M. A., & Mohd Khairulnizam, R. (2020). Talking-head, realism level and emotions in learning: A conceptual framework. International Journal of Information and Education Technology, 10(8), 585–589. https://doi.org/10.18178/ijiet.2020.10.8.1428
Norlida, D., & Ahmad Zamzuri, M. A. (2019). Kerangka konseptual reka bentuk emoji untuk poster kesedaran dalam bentuk media bercetak. KUPAS SENI: Jurnal Seni Dan Pendidikan Seni, 7, 12–21. Retrieved from https://ejournal.upsi.edu.my/index.php/JSPS/article/view/2689
Parthasarathy, S., & Busso, C. (2017). Jointly predicting arousal, valence and dominance with multi-task learning. International Speech Communication, 1103–1107. https://doi.org/10.21437/Interspeech.2017-1494
Patel, H., & MacDorman, K. F. (2015). Sending an avatar to do a human’s job: Compliance with authority persists despite the uncanny valley. Presence: Teleoperators & Virtual Environments, 24(1), 1–23. https://doi.org/10.1162/PRES
Pekrun, R. (2006). The control-value theory of achievement emotions: Assumptions, corollaries, and implications for educational research and practice. Educational Psychology Review, 18(4), 315–341. https://doi.org/10.1007/s10648-006-9029-9
Pekrun, R., Frenzel, A. C., Goetz, T., & Perry, R. P. (2007). The control-value theory of achievement emotions. In P. A. Schutz & R. Pekrun (Eds.), Emotion in Education (pp. 13–36). https://doi.org/10.1016/B978-012372545-5/50003-4
Peng, X., Chen, H., Wang, L., & Wang, H. (2018). Evaluating a 3-D virtual talking head on pronunciation learning. International Journal of Human Computer Studies, 109, 26–40. https://doi.org/10.1016/j.ijhcs.2017.08.001
Ruhland, K., Prasad, M., & Mcdonnell, R. (2017). Data-driven approach to synthesizing facial animation using motion capture. IEEE Computer Graphics and Applications, 37(4), 30–41. https://doi.org/10.1109/MCG.2017.3271467
Saidatul Maizura, S., Farah, M. Z., Nabila, A. N. K., Noorizdayantie, S., Zuraidah, A. R., Omar, M., … Wong, S. L. (2010). The pedagogical agent in online learning : Effects of the degree of realism on achievement in terms of gender. Contemporary Educational Technology, 1(2), 175–185. Retrieved from http://dergipark.gov.tr/download/article-file/252129
Schindler, S., Zell, E., Botsch, M., & Kissler, J. (2017). Differential effects of face-realism and emotion on event-related brain potentials and their implications for the uncanny valley theory. Scientific Reports, 7, 1–13. https://doi.org/10.1038/srep45003
Schwind, V., Leicht, K., Jäger, S., Wolf, K., & Henze, N. (2018). Is there an uncanny valley of virtual animals? A quantitative and qualitative investigation. International Journal of Human Computer Studies, 111, 49–61. https://doi.org/10.1016/j.ijhcs.2017.11.003
Shao, K., Pekrun, R., & Nicholson, L. J. (2019). Emotions in classroom language learning: What can we learn from achievement emotion research? System, 86, 1–11. https://doi.org/10.1016/j.system.2019.102121
Stef, A., Perera, K., Shum, H. P. H., & Ho, E. S. L. (2019). Synthesizing expressive facial and speech animation by text-to-IPA translation with emotion control. International Conference on Software, Knowledge Information, Industrial Management and Applications IEEE, 70–78. https://doi.org/10.1109/SKIMA.2018.8631536
Storbeck, J., & Clore, G. L. (2008). Affective arousal as information: How affective arousal influences judgments, learning, and memory. Social and Personality Psychology Compass, 2(5), 1824–1843. https://doi.org/10.1111/j.1751-9004.2008.00138.x.Affective
Tinwell, A. (2014). The uncanny valley in games and animation. Broken Sound Parkway NW: CRC Press.
Tinwell, A., Abdel Nabi, D., & Chalton, J. . (2013). Perception of psychopathy and the uncanny valley in virtual characters. Computers in Human Behavior, 29(4), 1617–1625. https://doi.org/http://dx.doi.org/10.1016/j.chb.2013.01.008
Tze, W. L., Nor Azan, M. Z., & Noraidah, S. (2017). Exploring the affective, motivational and cognitive effects of pedagogical agent enthusiasm in a multimedia learning environment. Human-Centric Computing and Information Sciences, 7(9), 1–21. https://doi.org/10.1186/s13673-017-0089-2
Tze, W. L., Nor Azan, M. Z., Noraidah, S., & Su, M. T. (2016). The effects of a pedagogical agent’s smiling expression on the learner’s emotions and motivation in a virtual learning environment. International Review of Research in Open and Distributed Learning, 17(5), 248–266. https://doi.org/http://dx.doi.org/10.19173/irrodl.v17i5.2350
Vesker, M., Bahn, D., Degé, F., Kauschke, C., & Schwarzer, G. (2018). Perceiving arousal and valence in facial expressions: Differences between children and adults. European Journal of Developmental Psychology, 15(4), 411–425. https://doi.org/10.1080/17405629.2017.1287073
