Measuring MyTelkomsel Usability with Post-Study System Usability Questionnaire
DOI:
https://doi.org/10.30871/jaic.v10i2.12418Keywords:
Usability, User Experience, Post-Study System Usability Questionnaire, MyTelkomselAbstract
The MyTelkomsel app is a mobile operator service app that makes it easy for Telkomsel users to access the digital services provided. Currently, the MyTelkomsel app has been downloaded more than 100 million times on Google Playstore and has a rating of 4.0 out of 5, so further evaluation is needed to gain an in-depth understanding of the user experience. This study evaluates the user experience using the Post-Study System Usability Questionnaire (PSSUQ) and Usability Testing with the think-aloud method. The PSSUQ results from 110 respondents show that the quality of information is 3.38 and the quality of the interface is 3.37, which is considered good. However, system quality had the lowest score, at 3.26. Usability testing involving 10 participants showed effectiveness (task success rate) of 81% and efficiency (time spent on tasks) of 56.45 seconds, but the error rate (50%) indicated that there were still problems with navigation and interface design. Meanwhile, the think-aloud test results showed that users had difficulty using the customer service and purchase history features in the application. The conclusion of this study is that although the quality of the MyTelkomsel application is generally good and acceptable to users, improvements in interface design and system performance are still needed to improve the overall quality of the application and enhance the user experience.
Downloads
References
[1] F. Nugraha, D. A. Rahayu, and I. Bastian, “Analisis Tingkat Kepuasan Pengguna Aplikasi Mytelkomsel Menggunakan Evaluasi Heuristik dan Metode Pieces (Studi Kasus : Mahasiswa Kampus Karawaci Universitas Gunadarma),” J. Teknol. Inf. dan Ilmu Komput., vol. 9, no. 3, pp. 463–468, 2022, doi: 10.25126/jtiik.2022924403.
[2] N. Saqdiyah and F. D. Patrikha, “Pengaruh Harga, Kualitas Layanan dan Kemudahan Penggunaan Terhadap Keputusan Pembelian Kuota Internet Melalui Aplikasi (Studi Pada Pengguna di Surabaya),” J. Pendidik. Tata Niaga, vol. 11, no. 3, pp. 229–239, 2023.
[3] W. Devi, AlyaAulia, “Evaluasi Aplikasi My Telkomsel Menggunakan Metode Usability Testing,” J. Jaring SainTek, vol. 5, no. 1, pp. 29–38, 2023, doi: 10.31599/jaringsaintek.v5i1.2053.
[4] H. Dela Arum and A. Ibrahim, “Implementasi Metode MeCUE 2.0 dalam Evaluasi User Experience MyTelkomsel,” Sist. J. Sist. Inf., vol. 13, no. 6, pp. 2687–2697, 2024.
[5] K. Kurniawati, Jefi, “Pengukuran Usability Aplikasi MyTelkomsel Menggunakan System Usability Scale Terhadap Kepuasan Pelanggan,” vol. 24, pp. 61–68, 2025.
[6] Ester Pardede, Sharipuddin, and Y. Hartiwi, “Analisis Usability Pada Aplikasi Mytelkomsel Menggunakan Metode Importance Performance Analysis Terhadap Kepuasan Pengguna,” J. Manaj. Teknol. Dan Sist. Inf., vol. 4, no. 1, pp. 638–646, 2024, doi: 10.33998/jms.2024.4.1.1622.
[7] H. Y. Abuaddous, A. M. Saleh, O. Enaizan, F. Ghabban, and A. B. Al-Badareen, “Automated User Experience (UX) Testing for Mobile Application: Strengths and Limitations,” Int. J. Interact. Mob. Technol., vol. 16, no. 4, pp. 30–45, 2022, doi: 10.3991/ijim.v16i04.26471.
[8] J. Š. Novák, J. Masner, P. Benda, P. Šimek, and V. Merunka, “Eye Tracking, Usability, and User Experience: A Systematic Review,” Int. J. Hum. Comput. Interact., vol. 40, no. 17, pp. 4484–4500, 2024, doi: 10.1080/10447318.2023.2221600.
[9] P. Weichbroth, “Usability of mobile applications: A systematic literature study,” IEEE Access, vol. 8, pp. 55563–55577, 2020, doi: 10.1109/ACCESS.2020.2981892.
[10] I. Journal, H. Interaction, and J. R. L. Ibm, “Lewis , J . R .: IBM Computer Usability Satisfaction Questionnaires : Psychometric Evaluation and Instructions for Use . International Journal of IBM Computer Usability Satisfaction Questionnaires : Psychometric Evaluation and Instructions for Use,” vol. 7, no. May, pp. 57–78, 1995.
[11] D. Kurniawan and F. Yuamita, “[4.29] [2023] Usability Testing Penggunaan Menu Kartu Hasil Studi Di Website Sistem Informasi Akademik Universitas Teknologi Yogyakarta,” J. Teknol. dan Manaj. Ind. Terap., vol. 2, no. 1, pp. 41–52, 2023, [Online]. Available: https://sia.uty.ac.id/std.
[12] J. Nielsen and T. K. Landauer, “Mathematical model of the finding of usability problems,” Conf. Hum. Factors Comput. Syst. - Proc., pp. 206–213, 1993, doi: 10.1145/169059.169166.
[13] A. Setiawan, A. Prahasto, and R. Gernowo, “Penggunaan Usability Testing Sebagai Alat Evaluasi,” J. Sains dan Teknol., vol. 9, no. 1, pp. 58–67, 2022.
[14] W. A. Pramono, H. M. Az-Zahra, and R. I. Rokhmawati, “Evaluasi Usability Pada Aplikasi MyTelkomsel Dengan Menggunakan Metode Usability Testing,” J. Pengemb. Teknol. Inf. dan Ilmu Komput., vol. 3, no. 3, pp. 2235–2242, 2019.
[15] I. M. Sukarsa, P. W. Buana, I. P. Juliarta, A. Utama, and N. W. Wisswani, “Meningkatkan User Experience Menggunakan Metode Usability Testing ( Studi Kasus : Aplikasi Warga Bali ) Usability Evaluation Dan User Interace Improvement To Increase User Experience Using Usability Testing Methods ( Case Study : Warga Bali Apps ),” J. Teknol. Inf. dan Ilmu Komput., vol. 9, no. 5, pp. 1003–1010, 2022, doi: 10.25126/jtiik.202295408.
[16] B. Noushad, P. W. M. Van Gerven, and A. B. H. de Bruin, “Twelve tips for applying the think-aloud method to capture cognitive processes,” Med. Teach., vol. 46, no. 7, pp. 892–897, 2024, doi: 10.1080/0142159X.2023.2289847.
[17] H. K. Peong et al., “Penerapan Usability Testing Dengan Menggunakan Metode Retrospective Think Aloud Untuk Pengukuran Tingkat,” vol. 8, no. 2, pp. 2130–2138, 2024.
[18] S. A. Wulandari and M. L. Hamzah, “Analisis Tingkat Usability Situs Website Rilisberita Dengan Menggunakan Metode System Usability Scale ( SUS ) Analyze The Level Of Usefulness Of The News Release Website With Using The Scale Usability System ( SUS ) Method Program Studi Sistem Informasi ,” vol. 7, 2024.
[19] N. Zahirah, D. R. Indah, M. A. Firdaus, N. K. P. Gumay, and A. Ibrahim, “Usability Evaluation of GetContact Application Using Post-Study System Usability Questionnaire and Retrospective Think Aloud,” Sinkron, vol. 9, no. 1, pp. 197–209, 2025, doi: 10.33395/sinkron.v9i1.14267.
[20] Z. B. Agustyn, S. Wibowo, and A. J. Furqon, “Usability Testing Aplikasi Getcontact Menggunakan Metode Post Study System Usability Questionnaire (Pssuq),” J. Inform. dan Tek. Elektro Terap., vol. 12, no. 2, 2024, doi: 10.23960/jitet.v12i2.3999.
[21] M. Naufal, T. K. Ahsyar, M. Jazman, and I. Permana, “Evaluasi Usability Aplikasi Mobile Banking Menggunakan Metode Retrospective Think Aloud dan Post-Study System Usability Questionnaire,” Indones. J. Comput. Sci., vol. 13, no. 3, pp. 4812–4823, 2024, doi: 10.33022/ijcs.v13i3.4039.
[22] R. Hidayat et al., “Evaluating the Usability of Canva Among University Students in Pekanbaru Using the WEBUSE Method,” J. Appl. Informatics Comput., vol. 9, no. 5, pp. 2687–2694, 2025, doi: 10.30871/jaic.v9i5.10351.
[23] F. Bohlouly, A. Kheirdoust, K. Ghaddaripouri, R. Sheibani, and M. R. Mazaheri Habibi, “Usability Evaluation of the Karafs Application: A Qualitative Study Using the Think-Aloud Method,” Heal. Sci. Reports, vol. 9, no. 1, 2026, doi: 10.1002/hsr2.71713.
[24] T. Doi, “Usability textual data analysis: A formulaic coding think-aloud protocol method for usability evaluation,” Appl. Sci., vol. 11, no. 15, 2021, doi: 10.3390/app11157047.
[25] S. U. Wardah, I. Aknuranda, and A. Syawli, “Analisis Pengalaman Pengguna Aplikasi MyTelkomsel dan MyIM3 Dengan Pengujian Usability dan User Experience Questionnaire (UEQ),” J. Pengemb. Teknol. Inf. dan Ilmu Komput., vol. 9, no. 5, pp. 2548–964, 2025, [Online]. Available: http://j-ptiik.ub.ac.id
[26] J. Nielsen and R. Molich, “Heuristic evaluation of user interfaces,” Conf. Hum. Factors Comput. Syst. - Proc., no. February, pp. 249–256, 1990, doi: 10.1145/97243.97281.
[27] A. Kusumaningtyas and P. Prihandoko, “Evaluasi Layanan Kesehatan Aplikasi Depok Single Window Dengan Metode System Usability Scale dan Heuristic Evaluation,” J. Teknol. Inf. dan Ilmu Komput., vol. 11, no. 1, pp. 167–174, 2024, doi: 10.25126/jtiik.20241117714.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Ulil Azhimi Al Ghofiati, Alfian Nurlifa, Amaludin Arifia
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
