Playing Gamelan Bonang in the Air: User Requirements for Designing a Digital Musical Instrument for the Malay Bonang

Authors

  • Khatriza Ahmad Saffian Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 Serdang, Selangor Darul Ehsan, MALAYSIA
  • Noris Mohd Norowi Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 Serdang, Selangor Darul Ehsan, MALAYSIA
  • Lili Nurliyana Abdullah Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 Serdang, Selangor Darul Ehsan, MALAYSIA
  • Puteri Suhaiza Sulaiman Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, 43400 Serdang, Selangor Darul Ehsan, MALAYSIA
  • Ahmad Faudzi Musib Faculty of Human Ecology, Universiti Putra Malaysia, 43400 Serdang, Selangor Darul Ehsan, MALAYSIA

DOI:

https://doi.org/10.37134/mjm.vol11.1.5.2022

Keywords:

Digital Musical Instruments, Human Computer Interaction, Malay gamelan, music interaction, user requirements, virtual bonang

Abstract

In recent years, computer technologies have been impactful in the design and development of Digital Musical Instruments (DMIs). As music interaction became prominent in the Human-Computer Interaction (HCI) field, emphasis on user requirement upon the design of musical interfaces has also grown since the last decade. Although designing new DMIs is becoming very popular, it is often determined by the designers and often not reflective of users’ needs.  In this study, we explored user requirements for the design of a virtual musical instrument of the Malay bonang, an instrument found in the Malay gamelan ensemble. The requirements were elicited from a group of gamelan experts to establish the bonang playing techniques to be mapped to the virtual instrument which we called Air Bonang. Findings revealed that in designing the Air Bonang that is natural and expressive, the fundamental playing techniques of the bonang should be integrated into the system using mid-air interaction. In addition, exploratory techniques might also be integrated into the Air Bonang to leverage musical expression. The outcome of the study proposes design criteria that encompass three aspects of a natural Air Bonang, namely, embodiment, expressiveness, and feedback.

Downloads

Download data is not yet available.

References

Anshori, F. (2014). Aplikasi "AR-Gamelan" sebagai media pembelajaran mengenal Gamelan Jawa berbasis augmented reality pada perangkat mobile Android (Studi Kasus : MI Ma ’ arif Nu 1 Pageraji ). Jurnal Skripsi.

Aryadana, I. P. S., Wiranatha, A. A. K. A. C., & Dharmadi, I. P. A. (2019). Aplikasi virtual reality gamelan gong kebyar tradisional Bali berbasis Android. Jurnal Ilmiah Merpati (Menara Penelitian Akademika Teknologi Informasi), 7(2), 162. https://doi.org/10.24843/jim.2019.v07.i02.p08

Bowen, N. (2013). Mobile phones, group improvisation, and music: Trends in digital socialized music-making [CIty University of New York]. In City University of New York. https://doi.org/10.1017/CBO9781107415324.004

Brown, D., Nash, C., & Mitchell, T. (2018). Understanding user-defined mapping design in mid-air musical performance. 5th International Conference on Movement and Computing. https://doi.org/10.1145/3212721.3212810

Brown, D., Nash, C., & Mitchell, T. J. (2020). Was that me?: Exploring the effects of error in gestural digital musical instruments. ACM International Conference Proceeding Series, 168–174. https://doi.org/10.1145/3411109.3411137

Cohé, A., & Hachet, M. (2012). Beyond the mouse: Understanding user gestures for manipulating 3D objects from touchscreen inputs. Computers and Graphics (Pergamon), 36(8), 1119–1131. https://doi.org/10.1016/j.cag.2012.09.004

Corbin, J. & Strauss A. (2014). Basics of qualitative research: Techniques and procedures for developing grounded theory. In Sage Publications (3rd Edition).

Coss, R. G. (2018). Descriptions of expert jazz educators’ experiences teaching improvisation. International Journal of Music Education, 36(4), 521–532. https://doi.org/10.1177/0255761418771093

Diatmika, I. W. I., Darmawiguna, I. G. M., & Sunarya, I. M. G. (2015). Pengembangan aplikasi instrumen gamelan semar pegulingan Android. Kumpulan Artikel Mahasiswa Pendidikan Teknik Informatika (KARMAPATI), 4(5). https://doi.org/10.23887/janapati.v4i2.9775

Dwipayana, K., Wirawan, I. M. A., & Sindu, I. G. P. (2019). Go-Byar based on virtual reality for the learning media of gamelan. 25(2), 229–236. https://doi.org/10.21831/jptk.v25i2.26182

Emerson, G., & Egermann, H. (2020). Exploring the motivations for building new Digital Musical Instruments. In Musicae Scientiae (Vol. 24, Issue 3). https://doi.org/10.1177/1029864918802983

Fogliano, F. (2020). NEMI: New ergonomic musical instrument A bridge between the Human-Centred Design and Digital Musical Instrument. UNICAMP - Università di Campinas - Brasile (BRASILE).

Françoise, J., & Bevilacqua, F. (2018). Motion-sound mapping through interaction: An approach to user-centered design of auditory feedback using machine learning. ACM Transactions on Interactive Intelligent Systems, 8(2). https://doi.org/10.1145/3211826

Hamdan, S., Musib, A. F., Musoddiq, I. A., & Sawawi, M. (2020). Timbre spectrum of gamelan instruments from four Malay Gamelan ensembles. Pertanika Journal of Science and Technology, 28(2), 459–476.

Han, J., & Gold, N. E. (2014). Lessons learned in exploring the Leap-Motion(TM) sensor for gesture-based instrument design. New Interfaces For Musical Expression, 371–374.

Hansberger, J. T., Peng, C., Mathis, S. L., Areyur Shanthakumar, V., Meacham, S. C., Cao, L., & Blakely, V. R. (2017). Dispelling the gorilla arm syndrome: The viability of prolonged gesture interactions. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 10280, Issue August). https://doi.org/10.1007/978-3-319-57987-0_41

Hassan, W., Rosli, D., Ariffin, A., Ahmad, F., & Jamin, J. (2020). The application of bonang gamelan music based on mobile application. International Journal of Recent Technology and Engineering, 8(6), 1077–1082. https://doi.org/10.35940/ijrte.f7554.038620

Hincapié-Ramos, J. D., Guo, X., Moghadasian, P., & Irani, P. (2014). Consumed endurance: A metric to quantify arm fatigue of mid-air interactions. Conference on Human Factors in Computing Systems - Proceedings, 1063–1072. https://doi.org/10.1145/2556288.2557130

Hwang, I., Son, H., & Kim, J. R. (2017). AirPiano: Enhancing music playing experience in virtual reality with mid-air haptic feedback. 2017 IEEE World Haptics Conference, WHC 2017, 213–218. https://doi.org/10.1109/WHC.2017.7989903

Koutsabasis, P., & Vogiatzidakis, P. (2019). Empirical research in mid-air interaction: A systematic review. International Journal of Human-Computer Interaction, 35(18), 1747–1768. https://doi.org/10.1080/10447318.2019.1572352

Lam, M. (2020). The physicality of music production: Investigating the roles of mindful practice and kinesthetic learning. Music Educators Journal, 106(3), 23–28. https://doi.org/10.1177/0027432119895553

Lazar, J., Feng, J. H., & Hochheiser, H. (2017). Research ,methods in Human-Computer interaction (Second). Elsevier Inc.

Leng, H. Y., Norowi, N. M., & Jantan, A. H. (2018). Designing an expressive virtual kompang on mobile device with Tri-Axial accelerometer. International Journal of Engneering and Techology, 7(4.31), 414–419.

Leng, H. Y., Norowi, N. M., & Jantan, A. H. (2017). A user-defined gesture set for music interaction in immersive virtual environment. ACM International Conference Proceeding Series, Part F1293(2), 44–51. https://doi.org/10.1145/3077343.3077348

León, L. R. P., Galindo, J. A. R., & Prado, P. L. Z. (2015). Human factors in musicians: Design proposals. Procedia Manufacturing, 3(Ahfe), 6124–6132. https://doi.org/10.1016/j.promfg.2015.07.765

McPherson, A., Morreale, F., & Harrison, J. (2019). Musical instruments for novices: Comparing NIME, HCI and Crowdfunding Approaches. In Springer Series on Cultural Computing, 179–212. Springer. https://doi.org/10.1007/978-3-319-92069-6_12

Mohd Shah, S., & Poheng, J. J. (2021). The changing landscape of the Malay gamelan and its implications on music education in Malaysia. Environment-Behaviour Proceedings Journal, 6(SI5), 137–141. https://doi.org/10.21834/ebpj.v6isi5.2939

Morreale, F., Mcpherson, A. P., & Wanderley, M. M. (2018). NIME Identity from the performer’s perspective.

Naber, A. L. H. (2016). Designing a digital gamelan. ICMC 2016 - 42nd International Computer Music Conference, Proceedings, 191–194.

Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., Hoagwood, K., Angeles, L., & Northwest, K. P. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42(5), 233–244. https://doi.org/10.1007/s10488-013-0528-y

Permana, F., Tolle, H., Utaminingrum, F., & Dermawi, R. (2019). Development of Augmented Reality (AR) based gamelan simulation with leap motion control. International Journal of Interactive Mobile Technologies, 12, 120–135. https://doi.org/10.3991/ijim.v13i12.9270

Rakkolainen, I., Freeman, E., Sand, A., Raisamo, R., & Brewster, S. (2020). A survey of mid-air ultrasound haptics and its applications. IEEE Transactions on Haptics, 1–1. https://doi.org/10.1109/toh.2020.3018754

Revana, I., Mohammad, Z., & Damastuti, F. A. (2020). Saron hit precision in virtual world. Seminar Nasional Terapan Riset Inovatif (SENTRINOV) Ke-6, 6(1), 990–997.

Saffian, K. (2014). Pitch analysis of keyed instruments in the Malay gamelan ensemble. International Music and Performing Arts Conference 2014 (IMPAC2014).

Saffian, K. A., & Norowi, N. M. (2021). Gestural interaction of gamelan mobile application : A preliminary study. Asian CHI Symposium 2021.

Shah, S. M. (2013). Contextualizing the transmission of Malaysian traditional music. Procedia - Social and Behavioral Sciences, 93, 1000–1004. https://doi.org/10.1016/j.sbspro.2013.09.318

Tanaka, A. (2010). Mapping out instruments, affordances, and mobiles. Proceedings of the International Conference on New Interfaces for Musical Expression (NIME), Nime, 15–18. http://www.nime.org/proceedings/2010/nime2010_088.pdf

Wobbrock, J. O., Morris, M. R., & Wilson, A. D. (2009). User-defined gestures for surface computing. Conference on Human Factors in Computing Systems - Proceedings, 1083–1092. https://doi.org/10.1145/1518701.1518866

Zappi, V., & McPherson, A. P. (2014). Dimensionality and appropriation in Digital Musical Instrument design. NIME ’14 Proceedings of the 2014 Conference on New Interfaces for Musical Expression, 455–460. http://www.nime.org/proceedings/2014/nime2014_409.pdf

Downloads

Published

22-12-2022

How to Cite

Ahmad Saffian, K., Mohd Norowi, N., Abdullah, L. N., Sulaiman, P. S., & Musib, A. F. (2022). Playing Gamelan Bonang in the Air: User Requirements for Designing a Digital Musical Instrument for the Malay Bonang: . Malaysian Journal of Music, 11(1), 68–83. https://doi.org/10.37134/mjm.vol11.1.5.2022