Comparison of Support Vector Machine and Random Forest Algorithms in Sentiment Analysis of the JMO Mobile Application
DOI:
https://doi.org/10.30871/jaic.v9i5.10764Keywords:
JMO Mobile, Machine Learning, Sentiment Analysis, Support Vector Machine, Random ForestAbstract
JMO Mobile is a digital service application that enables the public to access employment-related information and benefits. User reviews serve as a valuable resource for evaluating service quality, yet systematic sentiment analysis on this application remains limited. This study aims to classify the sentiment of user reviews and compare the performance of Support Vector Machine (SVM) and Random Forest (RF) algorithms. A total of 41,673 reviews were collected through web scraping, then preprocessed through text cleaning, tokenization, stopword removal, stemming, and feature extraction using TF-IDF. The reviews were categorized into positive, negative, and neutral sentiments, and divided into training and testing datasets with an 80:20 ratio. The choice of SVM and RF was based on their proven effectiveness in text classification tasks, with SVM excelling in handling high-dimensional data and RF recognized for its stability in producing reliable results. Model evaluation was conducted using accuracy as the primary metric. The findings indicate that Random Forest achieved an accuracy of 86.15 percent, slightly outperforming SVM at 86.06 percent. While SVM showed superior performance in identifying positive sentiment, Random Forest demonstrated greater consistency across classifications. Overall, Random Forest is considered more suitable for sentiment analysis of public service application reviews. This study contributes an automated approach to understanding user perceptions and offers a reference for selecting classification algorithms in similar cases.
Downloads
References
[1] K. Kusuma Dewi, I. Kaniawulan, and C. Dewi Lestari, “Analisis Sentimen Pengguna Aplikasi Jamsostek Mobile (Jmo) Pada Appstore Menggunakan Metode Naive Bayes,” Simtek J. Sist. Inf. dan Tek. Komput., vol. 8, no. 2, pp. 333–338, 2023, doi: 10.51876/simtek.v8i2.286.
[2] S. A. R. Rizaldi, S. Alam, and I. Kurniawan, “Analisis Sentimen Pengguna Aplikasi JMO (Jamsostek Mobile) Pada Google Play Store Menggunakan Metode Naive Bayes,” STORAGE J. Ilm. Tek. dan Ilmu Komput., vol. 2, no. 3, pp. 109–117, 2023, doi: 10.55123/storage.v2i3.2334.
[3] A. Noviriandini, H. Hermanto, and D. Ayu Ambarsari, “Analisis Tingkat Kepuasan Pengguna Aplikasi JMO (Jamsostek Mobile) Menggunakan Algoritma Naive Bayes Classifier,” Reputasi J. Rekayasa Perangkat Lunak, vol. 4, no. 1, pp. 33–37, 2023, doi: 10.31294/reputasi.v4i1.1986.
[4] D. Azarine, N. Rahaningsih, and R. D. Dana, “Analisis Sentimen Terhadap Pengguna Aplikasi Jamsostek Mobile pada Google Play Store Menggunakan Metode Naïve Bayes,” Media Inform., vol. 24, no. 1, pp. 13–21, 2025, doi: 10.37595/mediainfo.v24i1.316.
[5] V. Fitriyana, L. Hakim, D. Novitasari, and A. Asyhar, “Analisis Sentimen Ulasan Aplikasi Jamsostek Mobile Menggunakan Menggunakan Metode Support Vector Machine,” J. Inf. Syst. Res., vol. 4, no. 3, pp. 865–873, 2023, doi: 10.47065/josh.v4i3.3353.
[6] M. R. Adrian, M. P. Putra, M. H. Rafialdy, and N. A. Rakhmawati, “Perbandingan Metode Klasifikasi Random Forest dan SVM Pada Analisis Sentimen PSBB,” J. Inform. Upgris, vol. 7, no. 1, pp. 6–11, 2021, doi: 10.26877/jiu.v7i1.7099.
[7] M. D. Rizkiyanto, M. D. Purbolaksono, and W. Astuti, “Sentiment Analysis Classification on PLN Mobile Application Reviews using Random Forest Method and TF-IDF Feature Extraction,” INTEK J. Penelit., vol. 11, no. 1, pp. 37–43, 2024, doi: 10.31963/intek.v11i1.4774.
[8] T. Ariaji, S. N. Wahyuni, and M. Ikhsan, “Perbandingan Algoritma SVM dan RF pada Analisis Sentimen menggunakan Pendekatan Machine Learning,” J. Autom. Comput. Inf. Syst., vol. 5, no. 1, pp. 80–92, 2025, doi: 10.47134/jacis.v5i1.107.
[9] A. N. Syafia, M. F. Hidayattullah, and W. Suteddy, “Studi Komparasi Algoritma SVM Dan Random Forest Pada Analisis Sentimen Komentar Youtube BTS,” J. Inform. J. Pengemb. IT, vol. 8, no. 3, pp. 207–212, 2023, doi: 10.30591/jpit.v8i3.5064.
[10] M. Iqbal, M. Afdal, and R. Novita, “Implementasi Algoritma Support Vector Machine Untuk Analisa Sentimen Data Ulasan Aplikasi Pinjaman Online di Google Play Store,” MALCOM Indones. J. Mach. Learn. Comput. Sci., vol. 4, no. 4, pp. 1244–1252, 2024, doi: 10.57152/malcom.v4i4.1435.
[11] T. A. U. Azmi, L. Hakim, D. C. R. Novitasari, and W. D. U. D. Utami, “Application Random Forest Method for Sentiment Analysis in Jamsostek Mobile Review,” Telematika, vol. 20, no. 1, p. 117, 2023, doi: 10.31315/telematika.v20i1.8868.
[12] N. D. Kurniawan, P. R. Ferdian, and N. Hidayati, “Analisis Sentimen Algoritma Naïve Bayes, Support Vector Machine, dan Random Forest Pada Ulasan Aplikasi Ajaib,” J. Nas. Teknol. dan Sist. Inf., vol. 11, no. 1, pp. 87–97, 2025, doi: 10.25077/teknosi.v11i1.2025.87-97.
[13] K. P. Harmandini and K. M. L, “Analysis of TF-IDF and TF-RF Feature Extraction on Product Review Sentiment,” Sinkron, vol. 8, no. 2, pp. 929–937, 2024, doi: 10.33395/sinkron.v8i2.13376.
[14] A. R. Makhtum and M. Muhajir, “Sentiment Analysis of Omnibus Law Using Support Vector Machine (Svm) With Linear Kernel,” Barekeng, vol. 17, no. 4, pp. 2197–2206, 2023, doi: 10.30598/barekengvol17iss4pp2197-2206.
[15] M. A. Tsaqif and W. Maharani, “Comparison of Random Forest and Decision Tree Methods for Emotion Classification based on Social Media Posts,” Technol. Sci., vol. 6, no. 4, pp. 2240–2248, 2025, doi: 10.47065/bits.v6i4.6677.
[16] L. Enjelia, Y. Cahyana, and D. Wahiddin, “Comparison of K-Nearest Neighbors and Naive Bayes Classifier Algorithms in Sentiment Analysis of 2024 Election in Twitter (X),” J. Appl. Informatics Comput., vol. 9, no. 3, p. 946, 2025, [Online]. Available: http://jurnal.polibatam.ac.id/index.php/JAIC
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Inneke Via Mariska, Allsela Meiriza, Dinda Lestarini
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
