Improvement of User Experience Evaluation For SMEs Digital Application Using TRI, TAM, SUS Integration
DOI:
https://doi.org/10.30871/jaic.v10i1.11736Keywords:
UI/UX, Design Science Research, Technology Readiness Index, System Usability Scale, SMEsAbstract
Micro, Small, and Medium Enterprises (MSMEs) in the service sector, particularly vehicle wash services, continue to face challenges related to queue management, service transparency, and operational efficiency, which negatively affect user experience. This study aims to develop and evaluate a mobile-based service booking and management application prototype by integrating the Design Science Research (DSR) approach with the Technology Readiness Index (TRI), Technology Acceptance Model (TAM), and System Usability Scale (SUS) as an evaluation framework. The artifact was developed through DSR stages, including problem identification, design, demonstration, and evaluation. Qualitative data were collected through interviews with MSME owners, employees, and customers and analyzed using Thematic Analysis. Quantitative evaluation involved 106 respondents to measure technology readiness, user acceptance, and usability quality, accompanied by a descriptive analysis of relationships among the constructs. The results indicate a high level of technology readiness (TRI = 3.53) and very strong user acceptance (TAM = 4.27). However, the usability score falls within the marginal acceptable category (SUS = 62.95), indicating a gap between conceptual acceptance and actual interaction quality. These findings demonstrate that integrating TRI–TAM–SUS within the DSR framework effectively identifies critical contradictions that can serve as a basis for refining UI/UX design and implementation strategies for digital applications in service-based MSMEs.
Downloads
References
[1] F. Adha, M. F. Saputra, and N. Anisa, “Auto Lavaggio: Innovation and Digitalization in the Car Wash Industry,” Install: Information System and Technology Journal, vol. 1, no. 2, pp. 18–22, Sep. 2024, doi: 10.33859/install.v1i2.747.
[2] S. Kraus, K. Vonmetz, L. Bullini Orlandi, A. Zardini, and C. Rossignoli, “Digital entrepreneurship: The role of entrepreneurial orientation and digitalization for disruptive innovation,” Technological Forecasting and Social Change, vol. 193, p. 122638, Aug. 2023, doi: 10.1016/j.techfore.2023.122638.
[3] B. Setiawan, B. Pamungkas, A. Mekaniwati, and P. M. Kusuma, “The strategic role of digital transformation, dynamic and agile capabilities for the performance of micro, small, and medium enterprises (MSMEs),” BL, vol. 38, no. 2, pp. 130–153, Jun. 2025, doi: 10.1108/BL-08-2024-0120.
[4] T. I. Hasan, C. I. Silalahi, R. Y. Rumagit, and G. D. Pratama, “UI/UX Design Impact on E-Commerce Attracting Users,” Procedia Computer Science, vol. 245, pp. 1075–1082, 2024, doi: 10.1016/j.procs.2024.10.336.
[5] D. A. Norman, The design of everyday things, Rev. and Expanded edition. Cambridge (Mass.): MIT press, 2013.
[6] M. M. Soares, F. Rebelo, and T. Z. Ahram, Handbook of Usability and User Experience: Methods and Techniques, 1st ed. Boca Raton: CRC Press, 2022. doi: 10.1201/9780429343490.
[7] J. Almenara, J. Osuna, J. J. Gutiérrez Castillo, and A. León-Garrido, “Evaluation of the use and acceptance of mobile apps in higher education using the TAM model,” Dec. 2024.
[8] E. L. Putra, J. Suseno, and D. Napitupulu, “Pengembangan Aplikasi Dengan Menggunakan Metode Design Science Research (DSR) Berdasarkan Analisis Technology Readiness Index (TRI) dan Technology Acceptance Model (TAM),” vol. 8, no. 2.
[9] Y. L. Lai and J. Lee, “Integration of Technology Readiness Index (TRI) Into the Technology Acceptance Model (TAM) for Explaining Behavior in Adoption of BIM,” Asian Education Studies, vol. 5, no. 2, p. 10, Oct. 2020, doi: 10.20849/aes.v5i2.816.
[10] S. Desmaryani, A. Soleh, Irmanelly, and I. Wiarta, “Integration of technology acceptance models and government support to improve digital literacy,” Heliyon, vol. 10, no. 14, p. e34086, Jul. 2024, doi: 10.1016/j.heliyon.2024.e34086.
[11] I. Y. Adijaya, C. Fauzi, and S. Kacung, “Analisa System Usability Scale (Sus) Terhadap Aplikasi Sistem Informasi Kegiatan Kampus Berbasis Android,” SPIRIT, vol. 16, no. 2, Nov. 2024, doi: 10.53567/spirit.v16i2.368.
[12] Rihadatul ’Aisy, Y. T. Mursityo, and S. H. Wijoyo, “Evaluasi Usability Aplikasi Mobile Sampingan Menggunakan Metode Usability Testing dan System Usability Scale (SUS),” Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 11, no. 1, pp. 19–26, Feb. 2024, doi: 10.25126/jtiik.20241116613.
[13] F. N. Afiana, Z. Rifai, and W. A. Frilisia, “Integrasi Technology Readiness dan Technology Acceptance Model Terhadap Kesiapan Pengguna Enterprise Resource Planning (ERP) pada Industri Pengolahan Kelapa Organik,” Jurnal Sistem Informasi Bisnis, vol. 14, no. 2, pp. 100–110, Apr. 2024, doi: 10.21456/vol14iss2pp100-110.
[14] P. M. J. Delport, R. Von Solms, and M. Gerber, “Methodological Guidelines for Design Science Research,” Procedia Computer Science, vol. 237, pp. 195–203, 2024, doi: 10.1016/j.procs.2024.05.096.
[15] S. Gregor and O. Zwikael, “Design science research and the co-creation of project management knowledge,” International Journal of Project Management, vol. 42, no. 3, p. 102584, Apr. 2024, doi: 10.1016/j.ijproman.2024.102584.
[16] H. Alshammare, M. Alshayeb, and M. Baslyman, “Revealing the mobile UX horizon: Exploring user experience aspects, attributes, and measurement methods - A systematic mapping study,” Computer Standards & Interfaces, vol. 94, p. 103999, Aug. 2025, doi: 10.1016/j.csi.2025.103999.
[17] S. Krug, "Don't Make Me Think, Revisited: A Common Sense Approach to Web and Mobile Usability". Berkeley, CA: New Riders, 2014.
[18] J. Gothelf and J. Seiden, Lean UX: Creating Great Products with Agile Teams. Sebastopol, CA: O'Reilly Media, 2013.
[19] M. Linda and R. V. Imbar, “Perancangan Model Referral dengan Pendekatan Design Science Research Methodology,” Jurnal Teknik Informatika dan Sistem Informasi, vol. 10, no. 3, pp. 430–438, Dec. 2024, doi: 10.28932/jutisi.v10i3.9215.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Ivan Ismanto, Indra Gamayanto, Gabriello Klavin Sanyoto
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
