Comparative Analysis of Machine Learning and IndoBERT Models for Sentiment Analysis of YouTube Comments on the Free Nutritious Meals Program
DOI:
https://doi.org/10.30871/jaic.v10i3.12754Keywords:
Free Nutritious Meals, Sentiment Analysis, YouTube, Random Forest, Support Vector MachineAbstract
The Free Nutritious Meals Program has become one of the most widely discussed public policies in Indonesia and has generated various public responses on social media, particularly YouTube. Public comments on YouTube can be utilized as a valuable data source to understand public sentiment toward the implementation of the program. Therefore, this study aims to analyze and compare the performance of several classification algorithms in sentiment analysis of YouTube comments related to the Free Nutritious Meals Program. The dataset used in this study was obtained through a crawling process on one of Raymond Chin’s YouTube videos discussing the MBG program. A total of 903 comments were collected, and after the preprocessing stage, 401 comments were selected for further analysis. The preprocessing steps included cleaning, normalization, tokenization, stopword removal, and stemming. Furthermore, the text data were transformed using the TF-IDF weighting method. This study compared several classification algorithms, namely Random Forest, Gradient Boosting, Support Vector Machine (SVM), XGBoost, Multinomial Naïve Bayes, IndoBERT, and LightGBM. Model evaluation was conducted using confusion matrix analysis and performance metrics consisting of accuracy, precision, recall, and F1-score. The experimental results show that the Random Forest algorithm achieved the best performance with an accuracy of 0.9672, precision of 0.9683, recall of 0.9672, and F1-score of 0.9620. However, the confusion matrix analysis indicates that the model tends to be biased toward the positive sentiment class due to the imbalance in sentiment distribution within the dataset. In addition, the relatively small dataset and the use of comments from a single YouTube source may affect the generalization of the model results. Based on these findings, Random Forest can be considered the most effective algorithm for sentiment classification in this study. The results of this research are expected to provide insights into public perceptions regarding the MBG program and serve as evaluation material for policymakers in improving the implementation of public nutrition programs in Indonesia.
Downloads
References
[1] M. F. Saleh and R. Imanda, “Public Sentiment Analysis of the Free Meal Program : A Comparison of Naive Bayes and Support Vector Machine Methods on the Twitter ( X ) Social Media Platform,” vol. 9, no. 1, pp. 131–139, 2025.
[2] F. Nutritious, M. Program, and L. R. Methods, “Research Horizon,” vol. 0696, 2025.
[3] N. Putu, A. Noviyanti, I. G. Ngurah, and A. Cahyadi, “Penerapan Multinomial Naïve Bayes dan Chi-Square pada Analisis Sentimen Makan Bergizi Gratis,” vol. 3, pp. 785–794, 2025.
[4] M. S. Dewi and A. H. Hasugian, “Mutiara Sintia Dewi, 2) Abdul Halim Hasugian,” vol. 10, no. 2, pp. 911–922, 2025.
[5] E. Setiadi and D. A. Sulistyo, “Analisis Sentimen Kebijakan Makan Bergizi Gratis Menggunakan IndoBERT dan Machine Learning,” vol. 15, no. 3, pp. 507–513, 2025.
[6] R. E. Saputro, “Literature Review : Komparasi Algoritma Machine Learning dalam Analisis Sentimen Makan Bergizi Gratis Literature Review : Comparison of Machine Learning Algorithms for Sentiment Analysis of Free Nutritious Meals,” vol. 15, pp. 1110–1120, 2026.
[7] F. A. Hakim, I. Wisma, D. Prastya, and J. R. Budiani, “Sentiment Analysis of the Free Nutritious Meal Program ( MBG ) on Social Media X ( Twitter ) Using K-Nearest Neighbor and Artificial Neural Network,” vol. 10, no. 1, 2026.
[8] W. Wahyuni, T. P. Lestari, M. Apriliana, and R. Gumelta, “Implementation of BERTopic for Topic Modeling Analysis of the Free Nutritious Meal Program Based on YouTube Comments,” vol. 9, no. 4, pp. 1964–1971, 2025.
[9] I. Hermansyah and M. S. Hasibuan, “Sentiment Analysis of Free Nutritious Meal Programme on Social Media X using Linear Regression and Random Forest Algorithms,” vol. 13, no. 225, pp. 49–54, 2026, doi: 10.33558/piksel.v13i1.10633.
[10] T. A. Aziz and I. Ismayadi, “Analisis Sentimen Terhadap Program Makan Siang Gratis pada Media Sosial X Menggunakan Logistic Regression dan SVM,” vol. 24, no. 1, pp. 18–28, 2025.
[11] M. Ilham and B. Priambodo, “Analisis Sentimen Publik Terhadap Program Makan Siang Gratis Menggunakan BERT Neural Network Pada Platform X,” vol. 6, no. 2, pp. 1039–1047, 2024.
[12] M. Haikal and A. Erfina, “JURNAL LOCUS : Penelitian & Pengabdian Analisis Sentimen Warganet terhadap Program Makan Bergizi Gratis ( MBG ) Menggunakan Model Indobert,” vol. 5, no. 3, 2026.
[13] D. A. Vonega, A. Fadila, and D. E. Kurniawan, “Analisis Sentimen Twitter Terhadap Opini Publik Atas Isu Pencalonan Puan Maharani dalam PILPRES 2024”, JAIC, vol. 6, no. 2, pp. 129–135, Nov. 2022.
[14] J. Friadi, and D. E. Kurniawan, "Analisis Sentimen Ulasan Wisatawan Terhadap Alun-Alun Kota Batam: Perbandingan Kinerja Metode Naive Bayes dan Support Vector Machine," Jurnal Sistem Informasi Bisnis, vol. 14, no. 4, pp. 403-407, Oct. 2024. https://doi.org/10.21456/vol14iss4pp403-407.
[15] N. N. Aprianti, N. M. M. R. Desmayani, L. G. B. Libraeni, I. G. A. Indrawan, and M. L. Radhitya, “Public Sentiment Analysis of the Free Nutritious Meals Program (MBG) on Social Media X Using the Naive Bayes Method”, JAIC, vol. 9, no. 6, pp. 3929–3936, Dec. 2025.
[16] F. A. Hakim, I. W. D. Prastya, and J. R. Budiani, “Sentiment Analysis of the Free Nutritious Meal Program (MBG) on Social Media X (Twitter) Using K-Nearest Neighbor and Artificial Neural Network”, JAIC, vol. 10, no. 1, pp. 865–876, Feb. 2026.
[17] A. P. Arunia, R. R. Sani, I. N. Dewi, and M. T. Sulistyono, “Exploring Public Opinion on the ’Makan Bergizi Gratis’ Program on X: A Comparative Analysis of IndoBERT-Large and NusaBERT-Large Models”, JAIC, vol. 10, no. 1, pp. 856–864, Feb. 2026.
[18] I. Nugroho and S. Mujiyono, “Analysis of Public Sentiment Towards the Free Nutritious Meals Program on TikTok Social Media Using the K-Nearest Neighbor Algorithm”, JAIC, vol. 10, no. 1, pp. 975–983, Feb. 2026.
[19] N. P. Zakiyah, K. Umam, and A. A. Mahfudh, “Public Opinion on The MBG Program: Comparative Evaluation of InSet and VADER Lexicon Labeling Using SVM on Platform X”, JAIC, vol. 9, no. 6, pp. 3937–3944, Dec. 2025.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Irvan Theo Shandy; Ucta Pradema Sanjaya
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
