ANALISIS PENGARUH NATURAL USER INTERFACE BERBASIS SENSOR ULTRASONIK TERHADAP USABILITY DAN USER EXPERIENCE PADA SISTEM INTERAKSI MULTIMEDIA INTERAKTIF

Authors

  • Rizki Dwi Irianti Politeknik Elektronika Negeri Surabaya
  • Ashafidz Fauzan Dianta Politeknik Elektronik Negeri Surabaya, Surabaya
  • Zakha Maisat Eka Darmawan Politeknik Elektronik Negeri Surabaya, Surabaya
  • Putri Ariatna Alia Politeknik Elektronik Negeri Surabaya, Surabaya
  • Churnia Sari Universitas Negeri Jakarta, Jakarta Timur

Keywords:

Natural User Interface, Sensor Ultrasonik, Arduino Mega, Unity, Usability

Abstract

Interaksi manusia dan komputer terus berkembang dari pendekatan konvensional menuju antarmuka yang lebih alami dan intuitif. Natural User Interface (NUI) merupakan salah satu paradigma HCI yang memanfaatkan gerakan tubuh dan gestur pengguna sebagai media interaksi tanpa ketergantungan pada perangkat input tradisional. Penelitian ini bertujuan untuk merancang, mengimplementasikan, dan mengevaluasi sistem NUI berbasis sensor ultrasonik HC-SR04 pada lingkungan multimedia interaktif Unity, serta menganalisis pengaruhnya terhadap usability dan user experience pengguna. Sistem dikembangkan menggunakan sensor ultrasonik HC-SR04 sebagai perangkat akuisisi data spasial, Arduino Mega 2560 sebagai unit pemrosesan data, dan Unity sebagai platform visualisasi interaktif. Mekanisme inverse mapping diterapkan untuk menerjemahkan jarak tangan pengguna terhadap sensor menjadi pergerakan objek virtual secara real-time. Pengujian akurasi sensor menunjukkan rata-rata persentase error sebesar 1,99%, yang mengindikasikan tingkat akurasi yang memadai untuk sistem interaksi berbasis gestur real-time. Evaluasi usability menggunakan metode System Usability Scale (SUS) dengan 15 responden menghasilkan nilai rata-rata sebesar 80,5, yang termasuk dalam kategori Excellent. Hasil tersebut menunjukkan bahwa implementasi NUI berbasis sensor ultrasonik memberikan pengaruh positif terhadap usability dan user experience melalui interaksi yang responsif, intuitif, dan natural, serta berpotensi dikembangkan lebih lanjut pada aplikasi multimedia interaktif, game berbasis gestur, dan media pembelajaran digital.

References

D. Wigdor and D. Wixon, Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Burlington, MA: Morgan Kaufmann, 2011.

B. Shneiderman, C. Plaisant, M. Cohen, S. Jacobs, N. Lazar, and P. Zettlemoyer, Designing the User Interface: Strategies for Effective Human-Computer Interaction, 6th ed. Hoboken, NJ: Pearson, 2016.

ISO 9241-11:2018, Ergonomics of Human-System Interaction — Part 11: Usability: Definitions and Concepts. International Organization for Standardization, 2018.

M. Martín, D. Lores, and M. S. Pérez, "A comprehensive review on NUI, multi-sensory interfaces and UX design for applications and devices for visually impaired users," Frontiers in Public Health, vol. 12, p. 1357160, Oct. 2024, doi: 10.3389/fpubh.2024.1357160.

K. S. Santos et al., "Gesture-based interactions: Integrating accelerometer and gyroscope sensors in the use of mobile apps," Sensors, vol. 24, no. 3, p. 1004, Feb. 2024, doi: 10.3390/s24031004.

P. Milgram and F. Kishino, "A taxonomy of mixed reality visual displays," IEICE Trans. Inf. Syst., vol. E77-D, no. 12, pp. 1321–1329, 1994.

G. C. Guerino and N. M. C. Valentim, "Usability and user experience evaluation of natural user interfaces: A systematic mapping study," IET Software, vol. 14, no. 5, pp. 451–467, Oct. 2020, doi: 10.1049/iet-sen.2020.0051.

A. Bangor, P. T. Kortum, and J. T. Miller, "An empirical evaluation of the System Usability Scale," Int. J. Human-Computer Interaction, vol. 24, no. 6, pp. 574–594, 2008, doi: 10.1080/10447310802205776.

T. N. Arifin, G. F. Pratiwi, and A. Janrafsasih, "Sensor ultrasonik sebagai sensor jarak," Jurnal Tera, vol. 2, no. 2, pp. 55–62, Sep. 2022, doi: 10.59832/JT.V2I2.183.

R. D. Irianti, P. A. Alia, F. P. Nurmaida, M. I. Hag, and D. F. Abdillah, "Dodge Runner: Ultrasonic sensor-based natural user interface for real-time gesture control in Unity," Prosiding Seminar Seni Media Rekam, vol. 3, no. 1, pp. 111–124, 2025.

P. A. Alia, J. S. Prayogo, R. Kriswibowo, and A. T. Setyadi, "Implementation open artificial intelligence ChattGPT integrated with Whatsapp Bot," Advance Sustainable Science, Engineering and Technology, vol. 6, no. 1, p. 02401019, Jan. 2024, doi: 10.26877/ASSET.V6I1.17909.

R. D. Irianti, A. F. Dianta, Z. M. E. Darmawan, F. P. Nurmaida, and A. R. Saputra, "Implementation of a push button-based tangible user interface for virtual object control in Unity," Journal Informatic, Education and Management (JIEM), vol. 8, no. 1, pp. 747–756, 2026, doi: 10.61992/jiem.v8i1.254.

M. A. Santos, A. R. Costa, and V. N. Freire, "Natural user interface for motor rehabilitation: A systematic literature review," Int. J. Human-Computer Studies, vol. 142, p. 102455, 2020, doi: 10.1016/j.ijhcs.2020.102455.

G. C. Guerino, N. M. C. Valentim, and T. A. da Silva, "Evaluation methods for natural user interfaces: A systematic literature review," in Proc. 19th Brazilian Symp. Human Factors in Comput. Syst. (IHC), 2020, pp. 1–10, doi: 10.1145/3424953.3426485.

A. Bangor, P. Kortum, and J. Miller, "Determining what individual SUS scores mean: Adding an adjective rating scale," J. Usability Studies, vol. 4, no. 3, pp. 114–123, 2009.

J. R. Lewis, "The System Usability Scale: Past, present, and future," Int. J. Human-Computer Interaction, vol. 34, no. 7, pp. 577–590, 2018, doi: 10.1080/10447318.2018.1455307.

D. Wigdor and D. Wixon, Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Burlington, MA: Morgan Kaufmann, 2011.

L. Durand-Rivera and C. Martínez-González, "Usability evaluation of a tangible user interface and serious game for identification of cognitive deficiencies in preschool children," Int. J. Advanced Comput. Sci. Appl., vol. 11, no. 6, 2020.

P. Vlachogianni and N. Tselios, "Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review," J. Research on Technology in Education, vol. 54, no. 3, pp. 392–409, 2022, doi: 10.1080/15391523.2021.1867938.

R. Kriswibowo, P. A. Alia, J. S. Prayogo, and R. W. Febriana, "Implementation of text processing techniques on citizen opinions regarding floods in Surabaya," ELECTRON Jurnal Ilmiah Teknik Elektro, vol. 5, no. 1, pp. 30–36, May 2024, doi: 10.33019/ELECTRON.V5I1.148.

P. A. Alia, "Literature review: Lung disease detection based on X-Ray using artificial intelligence," Jurnal Rekayasa Sistem Informasi dan Teknologi, vol. 1, no. 2, pp. 50–53, Nov. 2023, doi: 10.59407/JRSIT.V1I2.152.

C. Ooka, A. Ohya, and A. Yorozu, "Principal component analysis for agricultural robot following," in IAS-18, pp. 175–187, 2023.

Downloads

Published

2026-05-30

How to Cite

Rizki Dwi Irianti, Ashafidz Fauzan Dianta, Zakha Maisat Eka Darmawan, Putri Ariatna Alia, & Churnia Sari. (2026). ANALISIS PENGARUH NATURAL USER INTERFACE BERBASIS SENSOR ULTRASONIK TERHADAP USABILITY DAN USER EXPERIENCE PADA SISTEM INTERAKSI MULTIMEDIA INTERAKTIF. Jurnal Rekayasa Sistem Informasi Dan Teknologi, 3(4), 175–726. Retrieved from https://journal.ppmi.web.id/index.php/jrsit/article/view/3829

Issue

Section

Artikel