Analisis Sentimen Purbaya Effect pada X Menggunakan VADER Sentiment, SVM, dan SMOTE
Abstract
The rapid growth of social media as a platform for public expression has generated a substantial volume of unstructured opinion data, creating the need for computational-based analytical approaches. One phenomenon that attracted public attention on platform X is the Purbaya Effect, which triggered various public responses reflected in positive, neutral, and negative sentiments. This study aims to analyze public sentiment toward this phenomenon by integrating VADER Sentiment, Support Vector Machine (SVM), and Synthetic Minority Oversampling Technique (SMOTE) to address class imbalance in the dataset. This research employed a quantitative approach based on text mining using 2,871 Indonesian-language tweets collected from platform X during the period of October 2025 to May 2026. The research procedure consisted of data collection, preprocessing (cleaning, case folding, tokenization, and stopword removal), sentiment labeling using VADER, data balancing using SMOTE, sentiment classification using SVM, and model evaluation through accuracy, precision, recall, and F1-score metrics. The results indicate that the sentiment distribution was dominated by the neutral category, while positive and negative sentiments appeared in considerably smaller proportions. The SVM model before applying SMOTE achieved an accuracy of 91.80%, but demonstrated a strong bias toward the majority class, resulting in limited capability to identify minority classes. After implementing SMOTE, the dataset became more balanced and the model’s ability to detect minority classes improved, as reflected by increased recall and F1-score values, although the overall accuracy decreased to 77.87%. These findings suggest that applying SMOTE improves the quality of multiclass sentiment classification and provides a more representative evaluation than relying solely on accuracy as a performance indicator.
Downloads
References
H. Hutto and E. Gilbert, “VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text,” Proceedings of the International AAAI Conference on Web and Social Media, vol. 8, no. 1, pp. 216–225, 2018.DOI: https://doi.org/10.1609/icwsm.v8i1.14550
H. T. Phan, N. T. Nguyen, and D. Hwang, “Sentiment Analysis for Social Media: A Survey,” Journal of Computer Science and Cybernetics, vol. 37, no. 4, pp. 403–428, 2021.DOI: https://doi.org/10.15625/1813-9663/37/4/15892
M. V. Mäntylä, D. Graziotin, and M. Kuutila, “The Evolution of Sentiment Analysis—A Review of Research Topics, Venues, and Top Cited Papers,” Computer Science Review, vol. 27, pp. 16–32, 2018.DOI: https://doi.org/10.1016/j.cosrev.2018.10.002
D. Elreedy and A. F. Atiya, “A Comprehensive Analysis of Synthetic Minority Oversampling Technique (SMOTE) for Handling Class Imbalance,” Information Sciences, vol. 505, pp. 32–64, 2019.DOI: https://doi.org/10.1016/j.ins.2019.07.070
C. Cortes and V. Vapnik, “Support-Vector Networks,” Machine Learning, vol. 20, pp. 273–297, 2018.DOI: https://doi.org/10.1007/BF00994018
N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: Synthetic Minority Over-sampling Technique,” Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2020.DOI: https://doi.org/10.1613/jair.953
M. Sokolova and G. Lapalme, “A Systematic Analysis of Performance Measures for Classification Tasks,” Information Processing & Management, vol. 45, no. 4, pp. 427–437, 2019.DOI: https://doi.org/10.1016/j.ipm.2019.03.002
F. Sebastiani, “Machine learning in automated text categorization,” ACM Computing Surveys, vol. 34, no. 1, pp. 1–47, 2020.DOI: https://doi.org/10.1145/505282.505283
B. Pang and L. Lee, “Opinion mining and sentiment analysis,” Foundations and Trends in Information Retrieval, vol. 2, nos. 1–2, pp. 1–135, 2018.DOI: https://doi.org/10.1561/1500000011
H. He and E. A. Garcia, “Learning from imbalanced data,” IEEE Transactions on Knowledge and Data Engineering, vol. 21, no. 9, pp. 1263–1284, 2019. DOI: https://doi.org/10.1109/TKDE.2008.239
G. E. A. P. A. Batista, R. C. Prati, and M. C. Monard, “A study of the behavior of several methods for balancing machine learning training data,” SIGKDD Explorations Newsletter, vol. 6, no. 1, pp. 20–29, 2019. DOI: https://doi.org/10.1145/1007730.1007735
G. Salton and C. Buckley, “Term-weighting approaches in automatic text retrieval,” Information Processing & Management, vol. 24, no. 5, pp. 513–523, 2019. DOI: https://doi.org/10.1016/0306-4573(88)90021-0
E. Kouloumpis, T. Wilson, and J. Moore, “Twitter sentiment analysis: The good the bad and the OMG!,” in Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media, vol. 5, no. 1, pp. 538–541, 2019. DOI: https://doi.org/10.1609/icwsm.v5i1.14185
F. Koto and G. Y. Rahmaningtyas, “InSet lexicon: Evaluation of a word list for Indonesian sentiment analysis in microblogs,” in Proceedings of the 2017 International Conference on Asian Language Processing (IALP), pp. 391–394, 2018. DOI: https://doi.org/10.1109/IALP.2017.8300625
L. Zhang, S. Wang, and B. Liu, “Deep learning for sentiment analysis: A survey,” WIREs Data Mining and Knowledge Discovery, vol. 8, no. 4, Art. no. e1253, 2018. DOI: https://doi.org/10.1002/widm.1253
M. Buda, A. Maki, and M. A. Mazurowski, “A systematic study of the class imbalance problem in convolutional neural networks,” Neural Networks, vol. 106, pp. 249–259, 2018. DOI: https://doi.org/10.1016/j.neunet.2018.07.011
H. Han, W. Y. Wang, and B. H. Mao, “Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning,” in Advances in Intelligent Computing, Lecture Notes in Computer Science, vol. 3644, pp. 878–887, 2020. DOI: https://doi.org/10.1007/11538059_91
R. A. Pranata, R. Rudiman, and N. A. Verdikha, “Metode pembobotan TF-IDF untuk klasifikasi teks quick count pemilihan wakil presiden Indonesia 2024 pada X Twitter dengan metode SVM,” Jurnal Teknologi Informasi: Jurnal Keilmuan dan Aplikasi Bidang Teknik Informatika, vol. 18, no. 2, 2024. DOI: https://doi.org/10.47111/jti.v18i2.14934
M. A. Nulhakim, Y. Sibaroni, and K. M. N. K. Khalif, “Geospatial sentiment analysis using Twitter data on natural disasters in Indonesia with Support Vector Machine (SVM) algorithm,” International Journal on Information and Communication Technology, vol. 10, no. 2, pp. 242–258, 2025. DOI: https://doi.org/10.21108/ijoict.v10i2.1032
T. Fawcett, “An introduction to ROC analysis,” Pattern Recognition Letters, vol. 27, no. 8, pp. 861–874, 2019. DOI: https://doi.org/10.1016/j.patrec.2005.10.010
Dini Andriyani, Ahmad Faqih, and Sandy Eka Permana, “The Effect of SMOTE Application on Support Vector Machine Performance in Sentiment Classification on Imbalanced Datasets,” Journal of Artificial Intelligence and Engineering Applications, vol. 4, no. 2, pp. 752–757, 2025. DOI: https://doi.org/10.59934/jaiea.v4i2.742.
Ulya Ilhami Arsyah, Mutiana Pratiwi, and Abulwafa Muhammad, “Twitter Sentiment Analysis of Public Space Opinions using SVM and TF-IDF Methods,” The Indonesian Journal of Computer Science, vol. 13, no. 1, 2024. DOI: https://doi.org/10.33022/ijcs.v13i1.3594.
M. Badri, E. Haerani, F. Syafria, O. Okfalisa, and L. Oktavia, “Penerapan Support Vector Machine dengan SMOTE untuk Klasifikasi Sentimen pada Data Ulasan Aplikasi Trading View,” Bulletin of Computer Science Research, vol. 6, no. 1, pp. 314–324, Dec. 2025, doi: 10.47065/bulletincsr.v6i1.793
S. Sutikman, H. Sutanto, and A. P. Widodo, “Resolving Data Imbalance using SMOTE for the Analysis and Prediction of Hate Speech Sentences,” Jurnal Sistem Informasi Bisnis, vol. 15, no. 2, pp. 198–203, Jun. 2025, doi: 10.14710/vol15iss2pp198-203
K. Aen, F. A. Tyas, and H. Rakhmawati, “Optimasi Algoritma Support Vector Machine (SVM) Menggunakan Teknik SMOTE untuk Analisis Sentimen Publik terhadap Dampak Penggunaan Artificial Intelligence (AI),” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 9, no. 5, 2025, doi: 10.36040/jati.v9i5.15061
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Analisis Sentimen Purbaya Effect pada X Menggunakan VADER Sentiment, SVM, dan SMOTE
Pages: 35-50
Copyright (c) 2026 Taki Imay, Baginda Oloan Lubis, Besus Maula Sulthon

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).


