Evaluasi Sistem Informasi Kemajuan Akademik (SIsKA-NG) Mobile Menggunakan Metode Heuristic Evaluation, System Usability Scale, dan Concurrent Think Aloud
Abstract
Abstrak
Masih terbatasnya fungsionalitas Sistem Informasi Kemajuan Akademik (SIsKA), terutama dalam aspek fungsionalitas khususnya fitur notifikasi, baik notifikasi jadwal ujian maupun notifikasi tentang masa studi masing-masing mahasiwa yang berguna sebagai pengingat batas waktu studi akhir mahasiswa, berkonsekuensi langsung pada kualitas pelayanan dan monitoring perkembangan mahasiswa di Program Studi Ilmu Komputer Universitas Pendidikan Ganesha. Penelitian ini berfokus pada evaluasi dan pengembangan lanjutan SIsKA-NG mobile dengan menggunakan heuristic evaluation sebagai tahap pengembangan pertama, dari hasil evaluasi oleh para evaluator ditemukan 20 permasalahan pada Aplikasi SIsKA mobile, 8 permasalahan dengan severity rating paling tinggi (Catastrophic), 6 permasalahn dengan prioritas tinggi (Mayor) dan permasalahan yang perlu di perbaiki namun pada prioritas rendah (Minor) serta permasalahan yang tidak perlu di perbaiki kecuali ada waktu tambahan masing-masing terdapat 3 permasalahan. Bedasarkan pengembangan tahap pertama dilakukan pengukuran kepuasan pengguna menggunakan kuesioner system usability scale, dimana didapatkan skor akhir sebesar 82.25, lebih tinggi dari skor standar system usability scale yaitu 68.00. sehingga skor tersebut mendapatkan grade ‘sangat baik’ ,yang berarti pengguna sangat puas dalam menggunakan aplikasi, namun untuk lebih memaksimalkan performa Aplikasi SIsKA-NG mobile, dilakukan usability tesing untuk menggali data kualitatif dari responden yang sama dengan kuesioner system usability scale menggunakan metode concurrent think aloud, dimana hasil rangkuman kritik atau saran dari responden sebanyak 21 kritik atau saran dijadikan acuan pengembangan tahap kedua pada Aplikasi SIsKA-NG mobile.
Keywords
References
Alhadreti, O., & Mayhew, P. (2018). Are Two Pairs of Eyes Better Than One? A Comparison of Concurrent Think-Aloud and Co-Participation Methods in Usability Testing. Journal of Usability Studies.
Almarashdeh, I., & Alsmadi, M. (2017). Heuristic evaluation of mobile government portal services: An experts’ review. 2016 11th International Conference for Internet Technology and Secured Transactions, ICITST 2016. https://doi.org/10.1109/ICITST.2016.7856746
Belkhir, A., Abdellatif, M., Tighilt, R., Moha, N., Gueheneuc, Y. G., & Beaudry, E. (2019). An observational study on the state of REST API uses in android mobile applications. Proceedings - 2019 IEEE/ACM 6th International Conference on Mobile Software Engineering and Systems, MOBILESoft 2019. https://doi.org/10.1109/MOBILESoft.2019.00020
Borovina, N., Bošković, D., Dizdarević, J., Bulja, K., & Salihbegović, A. (2015). Heuristic based evaluation of Mobile Services web portal usability. 2014 22nd Telecommunications Forum, TELFOR 2014 - Proceedings of Papers. https://doi.org/10.1109/TELFOR.2014.7034611
Brooke, J. (2013). SUS: a retrospective. Journal of Usability Studies.
Elling, S., Lentz, L., & De Jong, M. (2012). Combining concurrent think-aloud protocols and eye-tracking observations: An analysis of verbalizations and silences. IEEE Transactions on Professional Communication. https://doi.org/10.1109/TPC.2012.2206190
Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data (rev. ed.). In Protocol analysis Verbal reports as data rev ed.
Flutter, C. P. D. using. (2019). Cross Platform Development using Flutter. International Journal of Engineering Science and Computing.
Galitz, W. O. (1997). The essential guide to user interface design. SIGCHI Bulletin.
Gupta, S. (2015). A Comparative study of Usability Evaluation Methods. International Journal of Computer Trends and Technology. https://doi.org/10.14445/22312803/ijctt-v22p121
Indrawan, G., Gunawan, I. M. A. O., & Sariyasa. (2020). The usability evaluation of academic progress information system (SISKA-NG). Advances in Science, Technology and Engineering Systems. https://doi.org/10.25046/aj050259
Indrawan, G., Heriawan, G. T., Paramitha, A. A. I. I., Wiryawan, G., Subawa, G. B., Sastradi, M. T., & Sucahyana, K. A. (2017). SIsKA: Mobile Based Academic Progress Information System. https://doi.org/10.2991/icirad-17.2017.24
Katsanos, C., Tselios, N., & Xenos, M. (2012). Perceived usability evaluation of learning management systems: A first step towards standardization of the system usability scale in Greek. Proceedings of the 2012 16th Panhellenic Conference on Informatics, PCI 2012. https://doi.org/10.1109/PCi.2012.38
Lewis, J. R. (2018). The System Usability Scale: Past, Present, and Future. International Journal of Human-Computer Interaction. https://doi.org/10.1080/10447318.2018.1455307
McDonald, S., Edwards, H. M., & Zhao, T. (2012). Exploring think-alouds in usability testing: An international survey. IEEE Transactions on Professional Communication. https://doi.org/10.1109/TPC.2011.2182569
Motlagh Tehrani, S. E., Zainuddin, N. M. M., & Takavar, T. (2015). Heuristic evaluation for Virtual Museum on smartphone. Proceedings - 2014 3rd International Conference on User Science and Engineering: Experience. Engineer. Engage, i-USEr 2014, Vm, 227–231. https://doi.org/10.1109/IUSER.2014.7002707
Mustikaningtyas, B. A., Saputra, M. C., & Pinandito, A. (2016). Analisis Usability Pada Website Universitas Brawijaya Dengan Heuristic Evaluation. Jurnal Teknologi Informasi Dan Ilmu Komputer. https://doi.org/10.25126/jtiik.201633194
Nielsen, J., & Mack, R. (1994). Heuristic Evaluation. In Usability Inspection Methods. https://doi.org/10.1089/tmj.2010.0114
Nielsen, L., & Madsen, S. (2012). The usability expert’s fear of agility - An empirical study of global trends and emerging practices. NordiCHI 2012: Making Sense Through Design - Proceedings of the 7th Nordic Conference on Human-Computer Interaction. https://doi.org/10.1145/2399016.2399057
Paramitha, A. A. I. I., Dantes, G. R., & Indrawan, G. (2018). The evaluation of web based academic progress information system using heuristic evaluation and user experience questionnaire (UEQ). Proceedings of the 3rd International Conference on Informatics and Computing, ICIC 2018. https://doi.org/10.1109/IAC.2018.8780430
Pradini, R. S., Kriswibowo, R., & Ramdani, F. (2019). Usability Evaluation on the SIPR Website Uses the System Usability Scale and Net Promoter Score. Proceedings of 2019 4th International Conference on Sustainable Information Engineering and Technology, SIET 2019. https://doi.org/10.1109/SIET48054.2019.8986098
Sasmito, G. W., Zulfiqar, L. O. M., & Nishom, M. (2019). Usability Testing based on System Usability Scale and Net Promoter Score. 2019 2nd International Seminar on Research of Information Technology and Intelligent Systems, ISRITI 2019. https://doi.org/10.1109/ISRITI48646.2019.9034666
Sharfina, Z., & Santoso, H. B. (2017). An Indonesian adaptation of the System Usability Scale (SUS). 2016 International Conference on Advanced Computer Science and Information Systems, ICACSIS 2016. https://doi.org/10.1109/ICACSIS.2016.7872776
Van den Haak, M. J., & De Jong, M. D. T. (2003). Exploring Two Methods of Usability Testing: Concurrent versus Retrospective Think-Aloud Protocols. IEEE International Professional Communication Conference. https://doi.org/10.1109/ipcc.2003.1245501
Wijaya, A. C., Wiranto Aris Munandar, M., & Utaminingrum, F. (2019). Usability Testing of Augmented Reality for Food Advertisement Based on Mobile Phone Using System Usability Scale. Proceedings of 2019 4th International Conference on Sustainable Information Engineering and Technology, SIET 2019. https://doi.org/10.1109/SIET48054.2019.8986118
Yilmaz, B., & Durdu, P. O. (2015). Heuristic Evaluation of a mobile hand-writing learning application. 9th International Conference on Application of Information and Communication Technologies, AICT 2015 - Proceedings. https://doi.org/10.1109/ICAICT.2015.7338621
DOI: https://doi.org/10.23887/jik.v5i2.3431
Refbacks
- There are currently no refbacks.
Diterbitkan oleh:
UNIVERSITAS PENDIDIKAN GANESHA
Jl. Udayana, Kampus Tengah, Singaraja-Bali
Kode Pos 81116
Telp. 0362-22570
Homepage: http://www.undiksha.ac.id
