A Comparison of Classical Machine Learning and IndoBERT on Sentiment Analysis of Danantara Program in X

Silvan Pradana; Etika Kartikadarma

doi:10.30871/jaic.v10i4.13280

Authors

Silvan Pradana Universitas Dian Nuswantoro
Etika Kartikadarma Universitas Dian Nuswantoro

DOI:

https://doi.org/10.30871/jaic.v10i4.13280

Keywords:

Sentiment Analysis, Danantara, IndoBERT, Sarcasm Detection, SMOTE

Abstract

The rapid growth of social media has made it a primary channel for the public to express opinions on national strategic economic policies, including the establishment of the Danantara entity. This study aims to map public sentiment on Platform X and compare the performance of classical frequency-based architectures with transformer-based models. A common research gap in previous studies is the reliance on Bag-of-Words models, which fail to capture local context and sarcasm in informal text. A total of 9,525 tweets from the period January–May 2025 were collected via crawling and labeled using a hybrid approach combining InSet Lexicon and manual validation by experts (Cohen’s Kappa = 0.81). To address significant class imbalance (66.5% negative), SMOTE was applied to classical models. Experimental results reveal a significant performance gap: the classical TF-IDF + SVM model achieved a positive-class F1-score of only 59% due to feature distortion caused by SMOTE in the TF-IDF space, while the fine-tuned IndoBERT model substantially outperformed it with a global accuracy of 95.80% and a positive-class F1-score of 81%. These findings demonstrate that the deep transformer approach is far more robust in extracting semantics from informal Indonesian social media text, with practical implications for public policy decision-making.

Downloads

Download data is not yet available.

References

[1] S. A. Nugraha, “Penerapan Lexicon Based Untuk Analisis Sentimen Masyarakat Indonesia Terhadap Danantara,” 2025.

[2] A. Yoga Pratama, G. Ananda Sanjaya, N. Khairunisa Lubis, and M. Rangga Aditya, “Analisis Sentimen Publik Terkait Danantara Menggunakan Algoritma IndoBERT pada Platform Media Sosial,” vol. 9, p. 2025, doi: 10.47002/metik.v9i1.1055.

[3] H. Dian Andarista and M. R. Nashrullah, “Sentiment Analysis of Measuring Public Perception on Social Media X towards Danantara Using Support Vector Machine Algorithm”, doi: 10.33364/sistematik/v.1-1.2403.

[4] A. A. Qolbu, N. Fitriyati, and N. Inayah, “Performa Naïve Bayes , SVM , dan IndoBERT pada Analisis Sentimen Twitter IndiHome dengan Strategi Penanganan Data Tidak Seimbang,” Jurnal Fourier, vol. 814, no. 1, pp. 29–44, 2025, doi: 10.14421/fourier.2025.141.29-44.

[5] G. Hakim, T. N. Fatyanosa, and A. W. Widodo, “Analisis Sentimen Masyarakat terhadap Kereta Cepat Whoosh pada Platform X menggunakan IndoBERT,” Jurnal Pengembangan Teknologi Informasi dan Ilmu Komputer, vol. 8, no. 10, pp. 1–10, 2024, [Online]. Available: http://j-ptiik.ub.ac.id

[6] F. P. Agustinus, M. Afaldo, D. Ardiansyah, T. Informatika, and F. Teknik, “Analisis Sentimen Opini Publik terhadap BPI Danantara di Media Sosial X Menggunakan IndoRoBERTa dan SVM,” vol. 5, pp. 235–242, 2026.

[7] H. D. A. Hilda and M. R. Nashrullah, “Sentiment Analysis of Measuring Public Perception on Social Media X towards Danantara Using Support Vector Machine Algorithm,” Jurnal Sistematik, vol. 1, no. 2, pp. 1–9, 2025, doi: 10.33364/sistematik/v.1-1.2403.

[8] Nida Nur Aini Aryanti and Ozzi Suria, “Analisis Sentimen Terhadap Pemutusan Hubungan Kerja Di Indonesia : Komparasi Indobert Dengan Svm, Random Forest, Dan Decision Tree Dengan Optimasi TF - IDF,” Rabit : Jurnal Teknologi dan Sistem Informasi Univrab, vol. 10, no. 2, pp. 1158–1176, Jul. 2025, doi: 10.36341/rabit.v10i2.6364.

[9] N. Putu et al., “Public Sentiment Analysis on Demonstration Actions Using IndoBERT Based on Transfer Learning,” 2025. [Online]. Available: http://jurnal.polibatam.ac.id/index.php/JAIC

[10] Luthfiana and Dedi Gunawan, “Analisis Sentimen Pengguna X terhadap IKN Menggunakan Word2Vec dan IndoBERT,” Jurnal Sistem Komputer dan Informatika (JSON), vol. 7, no. 3, pp. 864–874, Mar. 2026, doi: 10.30865/json.v7i3.9468.

[11] A. Anas Qolbu and N. Fitriyati, “Performa Naïve Bayes, SVM, dan IndoBERT pada Analisis Sentimen Twitter IndiHome dengan Strategi Penanganan Data Tidak Seimbang,” vol. 814, no. 1, pp. 29–44, 2025, doi: 10.14421/fourier.2025.141.29-44.

[12] Cha Cha Kirana and Nabila Rizky Oktadini, “Analisis Sentimen Naïve Bayes dengan TF-IDF dan 10-Fold pada Ulasan Aplikasi X,” Jurnal Sistem Komputer dan Informatika (JSON), vol. 7, no. 2, pp. 523–535, Dec. 2025, doi: 10.30865/json.v7i2.9007.

[13] N. Nur, A. Aryanti, and O. Suria, “Analisis Sentimen Terhadap Pemutusan Hubungan Kerja Di Indonesia : Komparasi Indobert Dengan Svm , Random Forest , Dan Decision Tree Dengan Optimasi TF - IDF Pendahuluan Pemutusan Hubungan Kerja ( PHK ) merupakan salah satu fenomena sosial dan ekonomi yan,” vol. 10, no. 2, pp. 1158–1176, 2025.

[14] R. Rahmadani, A. Rahim, and R. Rudiman, “Analisis Sentimen Ulasan ‘Ojol the Game’ Di Google Play Store Menggunakan Algoritma Naive Bayes Dan Model Ekstraksi Fitur Tf-Idf Untuk Meningkatkan Kualitas Game,” Jurnal Informatika dan Teknik Elektro Terapan, vol. 12, no. 3, 2024, doi: 10.23960/jitet.v12i3.4988.

[15] A. Yoga Pratama, G. Ananda Sanjaya, N. Khairunisa Lubis, and M. Rangga Aditya, “Analisis Sentimen Publik Terkait Danantara Menggunakan Algoritma IndoBERT pada Platform Media Sosial,” Metik Jurnal Volume 9 No.1, vol. 9, p. 2025, 2025, doi: 10.47002/metik.v9i1.1055.

[16] Z. Purwanti and Sugiyono, “Pemodelan Text Mining untuk Analisis Sentimen Terhadap Program Makan Siang Gratis di Media Sosial X Menggunakan Algoritma Support Vector Machine (SVM),” Jurnal Indonesia : Manajemen Informatika dan Komunikasi, vol. 5, no. 3, pp. 3065–3079, 2024, doi: 10.35870/jimik.v5i3.1001.

[17] F. Smote, “Pemodelan Klasifikasi Efisiensi Kalori Berbasis Data Aktivitas dan Kondisi Fisiologis Menggunakan Random,” vol. 2, no. 1, pp. 54–62, 2026.

[18] N. S. Sediatmoko, Y. Nataliani, and I. Suryady, “Sentiment Analysis of Customer Review Using Classification Algorithms and SMOTE for Handling Imbalanced Class,” Indonesian Journal of Information Systems, vol. 7, no. 1, pp. 38–52, 2024, doi: 10.24002/ijis.v7i1.8879.

[19] M. F. Kono, I. N. Fajri, and Y. Pristyanto, “Public Sentiment Analysis on Corruption Issues in Indonesia Using IndoBERT Fine-Tuning, Logistic Regression, and Linear SVM,” Journal of Applied Informatics and Computing, vol. 9, no. 5, pp. 2616–2628, 2025, doi: 10.30871/jaic.v9i5.10537.

[20] R. R. Anugrah, “Penerapan Cosine Similarity Dan Pembobotan TF-IDF Untuk Klasifikasi Pengaduan Masyarakat Berbasis Web (Studi Kasus : Bagwassidik Ditreskrimum Polda Kalbar),” Coding Jurnal Komputer dan Aplikasi, vol. 11, no. 1, p. 100, 2023, doi: 10.26418/coding.v11i1.55598.

[21] N. Putu, D. Agustina, I. D. Ayu, P. Pratiwi, I. G. Ngurah, and L. Wijayakusuma, “Public Sentiment Analysis on Demonstration Actions Using IndoBERT Based on Transfer Learning,” vol. 9, no. 6, 2026.

[22] G. Hakim, T. N. Fatyanosa, and A. W. Widodo, “Analisis Sentimen Masyarakat terhadap Kereta Cepat Whoosh pada Platform X menggunakan IndoBERT,” 2024. [Online]. Available: http://j-ptiik.ub.ac.id

[23] R. Merdiansah, S. Siska, and A. Ali Ridha, “Analisis Sentimen Pengguna X Indonesia Terkait Kendaraan Listrik Menggunakan IndoBERT,” Jurnal Ilmu Komputer dan Sistem Informasi (JIKOMSI), vol. 7, no. 1, pp. 221–228, 2024, doi: 10.55338/jikomsi.v7i1.2895.