Classification Model Evaluation of Public Perception Regarding Nusantara Capital Relocation
DOI:
https://doi.org/10.30871/jaic.v10i3.12747Keywords:
Sentiment Analysis, Capital City of Nusantara, Multinomial Naïve Bayes, SMOTE, X (Twitter)Abstract
The relocation of the Capital City of Nusantara (IKN) has triggered extensive public opinion dynamics on the X (Twitter) social media platform. This study aims to empirically map public sentiment and evaluate the comparative performance of classification machine learning algorithms: Support Vector Machine (SVM), Logistic Regression (LR), and Multinomial Naïve Bayes (MNB). The dataset comprises 2,257 unique texts spanning the 2024-2025 period, automatically categorized using a lexicon-based approach (InSet dictionary). The technical novelty of this research lies in the extraction of TF-IDF N-gram (1, 2) features, the mitigation of extreme class imbalance via the Synthetic Minority Over-sampling Technique (SMOTE) encapsulated within a cross-validation pipeline, and systematic hyperparameter optimization using GridSearchCV. The labeling results revealed a predominance of negative sentiment at 77.3% (1,745 data) compared to positive sentiment at 22,7% (512 data), reflecting high public scrutiny and skepticism. Based on the model evaluation, MNB with parameter optimization (α=0.1) emerged as the most robust model, achieving an accuracy of 80.5% and a Macro Precision of 72.3%. The performance of MNB proved capable of outperforming the architectures of LR and SVM, which struggled with multicollinearity and underfitting anomalies in high-dimensional spaces. These findings emphasize that the integration of SMOTE and the MNB algorithm is crucial in overcoming majority class bias and calibrating the limitations of static lexicons to precisely map the polarity of public opinion.
Downloads
References
[1] G. Aji, Z. Arfani, A. M. Sari, and R. Seprtiani, “Dampak Pemindahan Ibukota Negara Baru terhadap Ekonomi dan Sosial di Provinsi Kalimantan Timur,” vol. 1, pp. 1–8, 2023.
[2] D. Ocsanda, C. I. Wijaya, M. Azzam, and A. Haq, “Oportunitas Pembentukan Entitas Kebudayaan Baru , Tinjauan Terhadap Ibu Kota Negara ( Ikn ) Indonesia 2024 Berdasarkan Sejarah Perpindahan Ibu Kota Voc 1619 Opportunity For New Cultural Entity Emergence , An Overview Of The Capital City ( Ikn ) Of Indonesia 2024 Based On The History Of The Relocation Of The Capital City Of VOC 1619,” vol. 18, pp. 1–12, 2024.
[3] N. Juli, A. D. Masitah, D. Suluh, and K. Dewi, “Analisis Opini Publik Berdasarkan Teori Agenda Setting Pada Proses Perencanaan Pemindahan IKN,” vol. 6, no. 3, pp. 10206–10217, 2022, doi: 10.36312/jisip.v6i3.3374/http.
[4] N. Hadi and D. Sugiarto, “Analisis Sentimen Pembangunan IKN pada Media Sosial X Menggunakan Algoritma SVM, Logistic Regression dan Naïve Bayes,” J. Inform. J. Pengemb. IT, vol. 10, no. 1, pp. 37–49, 2025, doi: 10.30591/jpit.v10i1.7106.
[5] P. Arsi and R. Waluyo, “Analisis Sentimen Wacana Pemindahan Ibu Kota Indonesia Menggunakan Algoritma Support Vector Machine (SVM),” J. Teknol. Inf. dan Ilmu Komput., vol. 8, no. 1, p. 147, 2021, doi: 10.25126/jtiik.0813944.
[6] Z. Kastrati, F. Dalipi, A. S. Imran, and K. P. Nuci, “Sentiment Analysis of Students ’ Feedback with NLP and Deep Learning : A Systematic Mapping Study,” 2021.
[7] L. Nemes and A. Kiss, “Social media sentiment analysis based on COVID-19,” J. Inf. Telecommun., vol. 5, no. 1, pp. 1–15, 2021, doi: 10.1080/24751839.2020.1790793.
[8] M. Bansal, A. Goyal, and A. Choudhary, “A comparative analysis of K-Nearest Neighbor , Genetic , Support Vector Machine , Decision Tree , and Long Short Term Memory algorithms in machine learning,” Decis. Anal. J., vol. 3, no. November 2021, p. 100071, 2022, doi: 10.1016/j.dajour.2022.100071.
[9] M. A. Saddam, E. Kurniawan D, and I. Indra, “Analisis Sentimen Fenomena PHK Massal Menggunakan Naive Bayes dan Support Vector Machine,” J. Inform. J. Pengemb. IT, vol. 8, no. 3, pp. 226–233, 2023, doi: 10.30591/jpit.v8i3.4884.
[10] S. A. H. Bahtiar, C. K. Dewa, and A. Luthfi, “Comparison of Naïve Bayes and Logistic Regression in Sentiment Analysis on Marketplace Reviews Using Rating-Based Labeling,” J. Inf. Syst. Informatics, vol. 5, no. 3, pp. 915–927, 2023, doi: 10.51519/journalisi.v5i3.539.
[11] I. M. Sumertajaya, Y. Angraini, J. R. Harahap, and A. Fitrianto, “Sentiment Analysis on Covid-19 Vaccination in Indonesia Using Support Vector Machine and Random Forest,” vol. 10, no. 1, pp. 1–8, 2022.
[12] R. B. Dahlian and D. Sitanggang, “Sentiment Analysis of Digital Television Migration on Twitter Using Naïve Bayes Multinomial Comparison, Support Vector Machines, and Logistic Regression Algorithms,” J. Sisfokom (Sistem Inf. dan Komputer), vol. 12, no. 2, pp. 280–288, 2023, doi: 10.32736/sisfokom.v12i2.1668.
[13] M. K. Faruq, K. Umam, M. I. Mustofa, and A. A. Mahfudh, “Comparative Study of SVM and Decision Tree Algorithms on the Effect of SMOTE Technique on LinkAja Application,” vol. 9, no. 6, pp. 3305–3311, 2025.
[14] M. Fajri and A. Primajaya, “Komparasi Teknik Hyperparameter Optimization pada SVM untuk Permasalahan Klasifikasi dengan Menggunakan Grid Search dan Random Search,” vol. 7, no. 1, pp. 10–15, 2023.
[15] M. R. Nursyam, M. Koprawi, and D. Ariyus, “Optimizing Email Spam Detection through Handling Class Imbalance with Class Weights and Hyperparameter Using GridSearchCV,” vol. 10, no. 1, pp. 232–244, 2026.
[16] E. Saputra and E. R. Susanto, “Implementation of Deep Learning with Multilayer Perceptron ( MLP ) for Heart Disease Prediction Using the SMOTE-ENN Technique,” vol. 9, no. 3, pp. 1034–1041, 2025.
[17] A. Ma’ruf, A. E. Pajri, and P. Liana, “Sentiment Analysis of President Prabowo ’ s Performance on Twitter ( X ) with a Comparative Study of SVM , XGBoost , and AdaBoost,” vol. 10, no. 1, pp. 684–697, 2026.
[18] M. F. Kurniawan and D. A. Megawaty, “Comparison of Logistic Regression , Random Forest , Support Vector Machine ( SVM ) and K-Nearest Neighbor ( KNN ) Algorithms in Diabetes Prediction,” vol. 9, no. 5, pp. 2154–2162, 2025.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Galih Sabilah Rosat, Nova Rijati
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
