Analisis Sentimen Purbaya Effect pada X Menggunakan VADER Sentiment, SVM, dan SMOTE


  • Taki Imay * Mail Universitas Bina Sarana Informatika, DKI Jakarta, Indonesia
  • Baginda Oloan Lubis Universitas Bina Sarana Informatika, DKI Jakarta, Indonesia
  • Besus Maula Sulthon Universitas Bina Sarana Informatika, DKI Jakarta, Indonesia
  • (*) Corresponding Author
Keywords: Sentiment Analysis; VADER Sentiment; Support Vector Machine (SVM); SMOTE; Social Media X; Purbaya Effect

Abstract

The rapid growth of social media as a platform for public expression has generated a substantial volume of unstructured opinion data, creating the need for computational-based analytical approaches. One phenomenon that attracted public attention on platform X is the Purbaya Effect, which triggered various public responses reflected in positive, neutral, and negative sentiments. This study aims to analyze public sentiment toward this phenomenon by integrating VADER Sentiment, Support Vector Machine (SVM), and Synthetic Minority Oversampling Technique (SMOTE) to address class imbalance in the dataset. This research employed a quantitative approach based on text mining using 2,871 Indonesian-language tweets collected from platform X during the period of October 2025 to May 2026. The research procedure consisted of data collection, preprocessing (cleaning, case folding, tokenization, and stopword removal), sentiment labeling using VADER, data balancing using SMOTE, sentiment classification using SVM, and model evaluation through accuracy, precision, recall, and F1-score metrics. The results indicate that the sentiment distribution was dominated by the neutral category, while positive and negative sentiments appeared in considerably smaller proportions. The SVM model before applying SMOTE achieved an accuracy of 91.80%, but demonstrated a strong bias toward the majority class, resulting in limited capability to identify minority classes. After implementing SMOTE, the dataset became more balanced and the model’s ability to detect minority classes improved, as reflected by increased recall and F1-score values, although the overall accuracy decreased to 77.87%. These findings suggest that applying SMOTE improves the quality of multiclass sentiment classification and provides a more representative evaluation than relying solely on accuracy as a performance indicator.

Downloads

Download data is not yet available.

References

H. Hutto and E. Gilbert, “VADER: A Parsimonious Rule-Based Model for Sentiment Analysis of Social Media Text,” Proceedings of the International AAAI Conference on Web and Social Media, vol. 8, no. 1, pp. 216–225, 2018.DOI: https://doi.org/10.1609/icwsm.v8i1.14550

H. T. Phan, N. T. Nguyen, and D. Hwang, “Sentiment Analysis for Social Media: A Survey,” Journal of Computer Science and Cybernetics, vol. 37, no. 4, pp. 403–428, 2021.DOI: https://doi.org/10.15625/1813-9663/37/4/15892

M. V. Mäntylä, D. Graziotin, and M. Kuutila, “The Evolution of Sentiment Analysis—A Review of Research Topics, Venues, and Top Cited Papers,” Computer Science Review, vol. 27, pp. 16–32, 2018.DOI: https://doi.org/10.1016/j.cosrev.2018.10.002

D. Elreedy and A. F. Atiya, “A Comprehensive Analysis of Synthetic Minority Oversampling Technique (SMOTE) for Handling Class Imbalance,” Information Sciences, vol. 505, pp. 32–64, 2019.DOI: https://doi.org/10.1016/j.ins.2019.07.070

C. Cortes and V. Vapnik, “Support-Vector Networks,” Machine Learning, vol. 20, pp. 273–297, 2018.DOI: https://doi.org/10.1007/BF00994018

N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: Synthetic Minority Over-sampling Technique,” Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2020.DOI: https://doi.org/10.1613/jair.953

M. Sokolova and G. Lapalme, “A Systematic Analysis of Performance Measures for Classification Tasks,” Information Processing & Management, vol. 45, no. 4, pp. 427–437, 2019.DOI: https://doi.org/10.1016/j.ipm.2019.03.002

F. Sebastiani, “Machine learning in automated text categorization,” ACM Computing Surveys, vol. 34, no. 1, pp. 1–47, 2020.DOI: https://doi.org/10.1145/505282.505283

B. Pang and L. Lee, “Opinion mining and sentiment analysis,” Foundations and Trends in Information Retrieval, vol. 2, nos. 1–2, pp. 1–135, 2018.DOI: https://doi.org/10.1561/1500000011

H. He and E. A. Garcia, “Learning from imbalanced data,” IEEE Transactions on Knowledge and Data Engineering, vol. 21, no. 9, pp. 1263–1284, 2019. DOI: https://doi.org/10.1109/TKDE.2008.239

G. E. A. P. A. Batista, R. C. Prati, and M. C. Monard, “A study of the behavior of several methods for balancing machine learning training data,” SIGKDD Explorations Newsletter, vol. 6, no. 1, pp. 20–29, 2019. DOI: https://doi.org/10.1145/1007730.1007735

G. Salton and C. Buckley, “Term-weighting approaches in automatic text retrieval,” Information Processing & Management, vol. 24, no. 5, pp. 513–523, 2019. DOI: https://doi.org/10.1016/0306-4573(88)90021-0

E. Kouloumpis, T. Wilson, and J. Moore, “Twitter sentiment analysis: The good the bad and the OMG!,” in Proceedings of the Fifth International AAAI Conference on Weblogs and Social Media, vol. 5, no. 1, pp. 538–541, 2019. DOI: https://doi.org/10.1609/icwsm.v5i1.14185

F. Koto and G. Y. Rahmaningtyas, “InSet lexicon: Evaluation of a word list for Indonesian sentiment analysis in microblogs,” in Proceedings of the 2017 International Conference on Asian Language Processing (IALP), pp. 391–394, 2018. DOI: https://doi.org/10.1109/IALP.2017.8300625

L. Zhang, S. Wang, and B. Liu, “Deep learning for sentiment analysis: A survey,” WIREs Data Mining and Knowledge Discovery, vol. 8, no. 4, Art. no. e1253, 2018. DOI: https://doi.org/10.1002/widm.1253

M. Buda, A. Maki, and M. A. Mazurowski, “A systematic study of the class imbalance problem in convolutional neural networks,” Neural Networks, vol. 106, pp. 249–259, 2018. DOI: https://doi.org/10.1016/j.neunet.2018.07.011

H. Han, W. Y. Wang, and B. H. Mao, “Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning,” in Advances in Intelligent Computing, Lecture Notes in Computer Science, vol. 3644, pp. 878–887, 2020. DOI: https://doi.org/10.1007/11538059_91

R. A. Pranata, R. Rudiman, and N. A. Verdikha, “Metode pembobotan TF-IDF untuk klasifikasi teks quick count pemilihan wakil presiden Indonesia 2024 pada X Twitter dengan metode SVM,” Jurnal Teknologi Informasi: Jurnal Keilmuan dan Aplikasi Bidang Teknik Informatika, vol. 18, no. 2, 2024. DOI: https://doi.org/10.47111/jti.v18i2.14934

M. A. Nulhakim, Y. Sibaroni, and K. M. N. K. Khalif, “Geospatial sentiment analysis using Twitter data on natural disasters in Indonesia with Support Vector Machine (SVM) algorithm,” International Journal on Information and Communication Technology, vol. 10, no. 2, pp. 242–258, 2025. DOI: https://doi.org/10.21108/ijoict.v10i2.1032

T. Fawcett, “An introduction to ROC analysis,” Pattern Recognition Letters, vol. 27, no. 8, pp. 861–874, 2019. DOI: https://doi.org/10.1016/j.patrec.2005.10.010

Dini Andriyani, Ahmad Faqih, and Sandy Eka Permana, “The Effect of SMOTE Application on Support Vector Machine Performance in Sentiment Classification on Imbalanced Datasets,” Journal of Artificial Intelligence and Engineering Applications, vol. 4, no. 2, pp. 752–757, 2025. DOI: https://doi.org/10.59934/jaiea.v4i2.742.

Ulya Ilhami Arsyah, Mutiana Pratiwi, and Abulwafa Muhammad, “Twitter Sentiment Analysis of Public Space Opinions using SVM and TF-IDF Methods,” The Indonesian Journal of Computer Science, vol. 13, no. 1, 2024. DOI: https://doi.org/10.33022/ijcs.v13i1.3594.

M. Badri, E. Haerani, F. Syafria, O. Okfalisa, and L. Oktavia, “Penerapan Support Vector Machine dengan SMOTE untuk Klasifikasi Sentimen pada Data Ulasan Aplikasi Trading View,” Bulletin of Computer Science Research, vol. 6, no. 1, pp. 314–324, Dec. 2025, doi: 10.47065/bulletincsr.v6i1.793

S. Sutikman, H. Sutanto, and A. P. Widodo, “Resolving Data Imbalance using SMOTE for the Analysis and Prediction of Hate Speech Sentences,” Jurnal Sistem Informasi Bisnis, vol. 15, no. 2, pp. 198–203, Jun. 2025, doi: 10.14710/vol15iss2pp198-203

K. Aen, F. A. Tyas, and H. Rakhmawati, “Optimasi Algoritma Support Vector Machine (SVM) Menggunakan Teknik SMOTE untuk Analisis Sentimen Publik terhadap Dampak Penggunaan Artificial Intelligence (AI),” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 9, no. 5, 2025, doi: 10.36040/jati.v9i5.15061


Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel Analisis Sentimen Purbaya Effect pada X Menggunakan VADER Sentiment, SVM, dan SMOTE

Dimensions Badge
Article History
Published: 2026-10-28
Abstract View: 23 times
PDF Download: 29 times
How to Cite
Imay, T., Lubis, B., & Sulthon, B. (2026). Analisis Sentimen Purbaya Effect pada X Menggunakan VADER Sentiment, SVM, dan SMOTE. Bulletin of Data Science, 6(1), 35-50. https://doi.org/10.47065/bulletinds.v6i1.11264
Section
Articles