Penerapan Metode Heuristic Evaluation dalam Analisis Perplexity

Authors

  • Dito Kurnia Universitas Malikussaleh
  • Desvina Yulisda Universitas Malikussaleh
  • Muhammad Ikhwani Universitas Malikussaleh

DOI:

https://doi.org/10.36312/ej.v6i3.3144

Keywords:

Heuristic Evaluation, Interaksi Manusia dan Komputer, Perplexity AI, Severity Ratings, Usability

Abstract

Perplexity AI merupakan chatbot berbasis Artificial Intelligence yang dirancang untuk membantu pengguna dalam pencarian informasi secara cepat dan akurat termasuk dalam konteks akademik. Meskipun penggunaannya di kalangan mahasiswa semakin meningkat, belum banyak dilakukan evaluasi terhadap kualitas kegunaan (usability) antarmuka sistem ini, penelitian ini menerapkan metode Heuristic Evaluation berdasarkan sepuluh prinsip Nielsen. Penelitian dilakukan secara kuantitatif dengan menyebarkan kuesioner online kepada 88 mahasiswa aktif Program Studi Sistem Informasi Universitas Malikussaleh yang telah menggunakan Perplexity AI. Data dianalisis melalui uji validitas, reliabilitas, regresi linier berganda, dan perhitungan severity rating. Seluruh item kuesioner dinyatakan valid dan reliabel (Cronbach’s Alpha > 0,6). Hasil regresi menunjukkan bahwa secara simultan semua aspek heuristic berpengaruh signifikan terhadap kepuasan pengguna (F = 88,89; signifikansinya 0,000; Adjusted R² = 90,9%). Namun, secara parsial hanya tiga aspek yang berpengaruh signifikan, yaitu Flexibility and Efficiency of Use, Help Users Recognize, Diagnose, and Recover from Errors, serta Help and Documentation. Hasil perhitungan severity rating menunjukkan sebagian besar masalah tergolong cosmetic problem, yaitu tidak wajib diperbaiki kecuali tersedia waktu tambahan. Rekomendasi perbaikan diberikan untuk peningkatan fitur fleksibilitas, bantuan sistem, dan dokumentasi agar Perplexity AI lebih adaptif terhadap kebutuhan pengguna. Hasil penelitian ini dapat menjadi rujukan dalam pengembangan sistem chatbot berbasis AI di bidang pendidikan, sekaligus memperkuat literatur akademik dalam kajian Interaksi Manusia dan Komputer (IMK), khususnya pada aspek evaluasi usability antarmuka digital.

Application of the Heuristic Evaluation Method in Perplexity Analysis

Abstract

Perplexity AI is an Artificial Intelligence–based chatbot designed to assist users in retrieving information quickly and accurately, including within academic contexts. Although its use among university students is increasing, limited evaluations have been conducted regarding the usability quality of its interface. This study applies the Heuristic Evaluation method based on Nielsen’s ten principles. The research employed a quantitative approach by distributing an online questionnaire to 88 active students of the Information Systems Program at Malikussaleh University who had experience using Perplexity AI. The data were analyzed through validity and reliability testing, multiple linear regression, and severity rating calculations. All questionnaire items were found to be valid and reliable (Cronbach’s Alpha > 0.6). Regression analysis indicated that, simultaneously, all heuristic aspects significantly influenced user satisfaction (F = 88.89; significance = 0.000; Adjusted R² = 90.9%). However, on a partial level, only three aspects had a significant effect: Flexibility and Efficiency of Use, Help Users Recognize, Diagnose, and Recover from Errors, and Help and Documentation. The severity rating results showed that most problems were classified as cosmetic, meaning they are not mandatory to fix unless additional time is available. Improvement recommendations are provided to enhance flexibility features, system assistance, and documentation so that Perplexity AI can become more adaptive to user needs. The findings of this study may serve as a reference for the development of AI-based chatbot systems in education and contribute to the academic literature in Human-Computer Interaction (HCI), particularly in the evaluation of digital interface usability.

Downloads

Download data is not yet available.

References

Aldekhyyel, R., Almulhem, J., & Binkheder, S. (2021). Usability of telemedicine mobile applications during covid-19 in saudi arabia: a heuristic evaluation of patient user interfaces. Healthcare, 9(11), 1574. https://doi.org/10.3390/healthcare9111574

Casu, M., Triscari, S., Battiato, S., Guarnera, L., & Caponnetto, P. (2024). Ai chatbots for mental health: a scoping review of effectiveness, feasibility, and applications. Applied Sciences, 14(13), 5889. https://doi.org/10.3390/app14135889

Chintya, L. C., & Sharif, O. O. (2019). Analisis User Experience (Studi Pada Applikasi Paytren) User Experience Analysis (Studies on Paytren Application). 6(3), 5543–5550

Diansih, S., & Kuntoro, A. Y. (2024). Analisis User Interface Menggunakan Metode Heuristic Evaluation Pada Website Badan Pengembangan Sumber Daya Manusia Dan PMDDTT. Indonesian Journal of Technology and Computer Science (IJTCS), 1(1), 1–11. https://bpsdm.kemendesa.go.id

Fish, B. (2020). Analisis Kepuasan Pengguna “Bukalapak” Menggunakan Metode Heuristic Evaluation Terhadap Mahasiswa Pendidikan Teknologi Informasi Fakultas Tarbiyah Dan Keguruan Universitas Islam Negeri Ar-Raniry Banda Aceh. 2507(February), 1–9.

Hassan, M., Tukiainen, M., & Qureshi, A. (2019). Participatory heuristic evaluations of jeliot mobile: end-users evaluating usability of their mlearning application., 1-6. https://doi.org/10.1109/times-icon47539.2019.9024452

Hidayat, T., Nurdiawan, O., & Arie Wijaya, Y. (2023). Analisa Website Portal Informasi Sekolah Dengan Menggunakan Metode Heuristic Evaluation. JATI (Jurnal Mahasiswa Teknik Informatika), 7(1), 740–746. https://doi.org/10.36040/jati.v7i1.6559

Höhn, S. and Bongard-Blanchy, K. (2021). Heuristic evaluation of covid-19 chatbots., 131-144. https://doi.org/10.1007/978-3-030-68288-0_9

Holmes, S., Moorhead, A., Bond, R., Zheng, H., Coates, V., & McTear, M. (2019). Usability testing of a healthcare chatbot: can we use conventional methods to assess conversational user interfaces?., 207-214. https://doi.org/10.1145/3335082.3335094

Ira, L. (2023). mengenal perplexity ai, fitur dan cara penggunaannya. https://www.tempo.co/ekonomi/mengenal-perplexity-ai-fitur-dan-cara-penggunaannya-130899

Kennedy, B., Kerns, E., Chan, Y., Chaparro, B., & Fouquet, S. (2019). Safeuristics! do heuristic evaluation violation severity ratings correlate with patient safety severity ratings for a native electronic health record mobile application?. Applied Clinical Informatics, 10(02), 210-218. https://doi.org/10.1055/s-0039-1681073

Larbi, D., Denecke, K., & Gabarrón, E. (2022). Usability testing of a social media chatbot for increasing physical activity behavior. Journal of Personalized Medicine, 12(5), 828. https://doi.org/10.3390/jpm12050828

Luo, Y. (2024). Enhancing educational interfaces: integrating user-centric design principles for effective and inclusive learning environments. Applied and Computational Engineering, 64(1), 192-197. https://doi.org/10.54254/2755-2721/64/20241427

Mahmoud, A. and Saleem, J. (2024). Usability assessment of openemr: enhancing healthcare interactions. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 68(1), 1848-1851. https://doi.org/10.1177/10711813241268732

Mount-Campbell, A., Hosseinzadeh, D., Gürcan, M., & Patterson, E. (2017). Applying human factors engineering to improve usability and workflow in pathology informatics. Proceedings of the International Symposium on Human Factors and Ergonomics in Health Care, 6(1), 23-27. https://doi.org/10.1177/2327857917061007

Nielsen, J., & Molich, R. (1990). Heuristic evaluation of user interfaces. Conference on Human Factors in Computing Systems - Proceedings, April, 249–256. https://doi.org/10.1145/97243.97281.

Nugraha, Y., Masnita, Y., & Kurniawati, K. (2022). Peran Responsiveness Chatbot Artificial Intelligence Dalam Membentuk Customer Satisfaction, J. Manaj. Dan Bisnis Sriwij., vol. 20, no. 3, hal. 143–158, doi:10.29259/jmbs.v20i3.18528

Paramastri, A. S., & Sabila, M. K. (2024). Penerimaan Perplexity Pada Lingkup Mahasiswa Menggunakan Teori Utaut, hal. 178–187, 2024.

Pratama, A. V. (2018). Uji Usability Situs Web Academic Information System ( Ais ) Uin Syarif Hidayatullah Jakarta Dengan Metode Cognitive Walkthrough. UIN Syarif Hidayatullah Jakarta, Juli, 0–6. https://www.researchgate.net/publication/326534874.

Rahadian, D., Rahayu, G., & Oktavia, R. R. (2019). Teknologi Pendidikan: Kajian Aplikasi Ruangguru Berdasarkan Prinsip dan Paradigma Interaksi Manusia dan Komputer. Jurnal Petik, 5(1), 11–24. https://doi.org/10.31980/jpetik.v5i1.489

Rahmadina, A., Aknuranda, I., & Wardani, N. H. (2019). Evaluasi Usability Aplikasi E-TPT Berbasis Mobile Kantor Pelayanan Pajak Pratama Malang Utara dengan Menggunakan Metode Heuristic Evaluation. Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, 3(7), 6396–6403.

Ren, R. (2021). A family of experiments for evaluating the usability of a collaborative modelling chatbot. https://doi.org/10.18293/seke2021-043

Ren, R. (2021). Evaluation of chatbots usability experimentation (s). https://doi.org/10.18293/seke2021-053

Ren, R., Zapata, M., Castro, J., Dieste, Ó., & Acuña, S. (2022). Experimentation for chatbot usability evaluation: a secondary study. Ieee Access, 10, 12430-12464. https://doi.org/10.1109/access.2022.3145323

Richard Panigor Sitompul. (2024). Analisis Faktor Yang Mempengaruhi Penerimaan Pengguna Platform Generative Artificial Intelligence Sebagai Perangkat Pendukung Proses Pembelajaran Dengan Pendekatan Extended Technology Acceptance Model (Studi Kasus: Mahasiswa Uin Syarif Hidayatullah Jakart.

Rinabi, V. (2019). Analisis Model Human Computer Interaction Untuk Mengukur User Experience Pada Sistem Informasi Akademik (Studi Kasus: UC Student Application). Jurnal Sistem Cerdas dan Rekayasa, 1(1), 8. http://ojs.widyakartika.ac.id/index.php/jscr/article/view/6

Safa, A. (2024). Analisis Pengaruh Kualitas Layanan Terhadap Loyalitas Pengguna Chatgpt Dengan Pendekatan Model Webqual 4.0, hal. 1–23.

Shelemo, A. A. (2023). Analisis Usability Pada Aplikasi Mobile Kai Access Berdasarkan Pengguna Goal-Directed Dan Experential User Menggunakan Metode Heuristic Evaluation. Nucl. Phys., 13(1), 104–116.

Tuzzahrah, A. N., Voutama, A., Ridha, A. A., Karawang, U. S., Hs, J., Waluyo, R., Timur, T., & Barat, J. (2023). Analisa Website Prodi Sistem Informasi Unsika Manusia Dan Komputer. 25(2), 108–115.

Tuzzahrah, A. N., Voutama, A., Ridha, A. A., Karawang, U. S., Hs, J., Waluyo, R., Timur, T., & Barat, J. (2023). Analisa Website Prodi Sistem Informasi Unsika Manusia Dan Komputer. 25(2), 108–115.

Vlachogianni, P. and ???????, ?. (2023). Perceived usability evaluation of educational technology using the post-study system usability questionnaire (pssuq): a systematic review. Sustainability, 15(17), 12954. https://doi.org/10.3390/su151712954

Weeks, R., Sangha, P., Cooper, L., Sedoc, J., White, S., Gretz, S., … & Bar?Zeev, N. (2023). Usability and credibility of a covid-19 vaccine chatbot for young adults and health workers in the united states: formative mixed methods study. Jmir Human Factors, 10, e40533. https://doi.org/10.2196/40533

Downloads

Published

2025-09-23

Issue

Section

Articles

How to Cite

Kurnia, D., Yulisda, D., & Ikhwani, M. (2025). Penerapan Metode Heuristic Evaluation dalam Analisis Perplexity. Empiricism Journal, 6(3), 991-1001. https://doi.org/10.36312/ej.v6i3.3144