Analisis Sentimen Ulasan Berbahasa Inggris Apex Legends di Steam Menggunakan TF-IDF N-Gram dan Multinomial Naive Bayes


  • M. Akbar Zidane Sekolah Tinggi Manajemen Informatika dan Komputer El Rahma Yogyakarta, Yogyakarta, Indonesia
  • Yuli Praptomo Pamungkas Hari Sungkowo * Mail Sekolah Tinggi Manajemen Informatika dan Komputer El Rahma Yogyakarta, Yogyakarta, Indonesia
  • (*) Corresponding Author
Keywords: Sentiment Analysis; Apex Legends; Multinomial Naïve Bayes; Unigram-Bigram; Steam Reviews; Dashboard

Abstract

The number of users of the online game Apex Legends continues to increase along with the always active community, which also leads to an increase in the number of user reviews. In this condition, conducting manual review analysis becomes ineffective, especially due to the numerous reviews written in informal English, containing negation words, and also showing an imbalanced sentiment class distribution. In this study, the aim is to classify reviews from Apex Legends users on the Steam platform into positive and negative sentiments using the Multinomial Naive Bayes algorithm with TF-IDF weighting based on N-Gram features with a combination of Unigram and Bigram. The dataset was obtained through web scraping from the Steam platform with a total of 9,000 reviews, followed by preprocessing which resulted in 8,981 valid reviews. However, the data still showed class imbalance. The random undersampling process was then applied to obtain 5,512 balanced data points. The test results show that the model can achieve an accuracy of 0.8132 or 81.32%. For the negative class, the model obtained a precision of 0.79, recall of 0.85, and f1-score of 0.82, while the positive class obtained a precision of 0.83, recall of 0.78, and f1-score of 0.81. The trained model is also applied to a Streamlit based dashboard to support the visualization and prediction of new review sentiments. The contributions of this study are the application of combined N-Gram features (unigram and bigram) to Multinomial Naive Bayes for handling negation context and informal language, the use of random undersampling to address class imbalance, and the deployment of the trained model into a Streamlit-based dashboard that enables direct visualization and sentiment prediction of new reviews.

Downloads

Download data is not yet available.

References

Valve Corporation, “User Reviews,” Steamworks Documentation, 2026. Accessed: May 15, 2026. [Online]. Available: https://partner.steamgames.com/doc/store/reviews

D. Jurafsky and J. H. Martin, Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition with Language Models, 3rd ed., 2026. [Online]. Available: https://web.stanford.edu/~jurafsky/slp3/

Y. Mao, Q. Liu, and Y. Zhang, “Sentiment Analysis Methods, Applications, and Challenges: A Systematic Literature Review,” Journal of King Saud University - Computer and Information Sciences, vol. 36, no. 4, 2024, doi: 10.1016/j.jksuci.2024.102048.

Valve Corporation, “User Reviews - Get List,” Steamworks Documentation, 2026. Accessed: May 15, 2026. [Online]. Available: https://partner.steamgames.com/doc/store/getreviews

M. A. Palomino and F. Aider, “Evaluating the Effectiveness of Text Pre-Processing in Sentiment Analysis,” Applied Sciences, vol. 12, no. 17, 2022, doi: 10.3390/app12178765.

J. R. Jim, M. A. R. Talukder, P. Malakar, M. M. Kabir, K. Nur, and M. F. Mridha, “Recent Advancements and Challenges of NLP-Based Sentiment Analysis: A State-of-the-Art Review,” Natural Language Processing Journal, vol. 6, Art. no. 100059, 2024, doi: 10.1016/j.nlp.2024.100059.

M. Siino, I. Tinnirello, and M. La Cascia, “Is Text Preprocessing Still Worth the Time? A Comparative Survey on the Influence of Popular Preprocessing Methods on Transformers and Traditional Classifiers,” Information Systems, vol. 121, Art. no. 102342, 2024, doi: 10.1016/j.is.2023.102342.

L. B. Ilmawan, Muladi, and D. D. Prasetya, “Negation Handling for Sentiment Analysis Task: Approaches and Performance Analysis,” International Journal of Electrical and Computer Engineering (IJECE), vol. 14, no. 3, pp. 3382-3393, 2024, doi: 10.11591/ijece.v14i3.pp3382-3393.

I. N. O. Darmayasa, N. A. Sanjaya ER, I. G. A. G. A. Kadyanan, and A. A. I. N. E. Karyawati, “Pengaruh Teknik Penanganan Negasi dalam Analisis Sentimen,” Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 12, no. 2, pp. 275-282, 2025, doi: 10.25126/jtiik.2025129079.

N. Punetha and G. Jain, “Advancing Sentiment Analysis by Addressing Negation Handling Challenge via Unsupervised Mathematical Approach,” Social Network Analysis and Mining, vol. 15, no. 1, Art. no. 20, 2025, doi: 10.1007/s13278-025-01416-z.

S. N. Almuayqil, M. Humayun, N. Z. Jhanjhi, M. F. Almufareh, and N. A. Khan, “Enhancing Sentiment Analysis via Random Majority Under-Sampling with Reduced Time Complexity for Classifying Tweet Reviews,” Electronics, vol. 11, no. 21, 2022, doi: 10.3390/electronics11213624.

N. Habbat, H. Nouri, H. Anoun, and L. Hassouni, “Sentiment Analysis of Imbalanced Datasets Using BERT and Ensemble Stacking for Deep Learning,” Engineering Applications of Artificial Intelligence, vol. 126, Art. no. 106999, 2023, doi: 10.1016/j.engappai.2023.106999.

C. Kaope and Y. Pristyanto, “The Effect of Class Imbalance Handling on Datasets Toward Classification Algorithm Performance,” MATRIK: Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer, vol. 22, no. 2, pp. 227-238, 2023, doi: 10.30812/matrik.v22i2.2515.

J. Y. Tan, A. S. K. Chow, and C. W. Tan, “A Comparative Study of Machine Learning Algorithms for Sentiment Analysis of Game Reviews,” IEM Journal, vol. 82, no. 3, pp. 63-68, 2022, doi: 10.54552/v82i3.101.

A. K. Saputra, M. R. Handayani, N. C. H. Wibowo, and K. Umam, “Sentiment Analysis of User Reviews on the Game GTA V Using Support Vector Machine,” Jurnal SISFOKOM (Sistem Informasi dan Komputer), vol. 14, no. 3, pp. 284-290, 2025, doi: 10.32736/sisfokom.v14i3.2368.

S. Aura and D. Novianto, “Comparative Sentiment Analysis of TheoTown Reviews on Steam and Google Play Store Using Support Vector Machine,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 6, no. 2, pp. 886-896, 2026, doi: 10.57152/malcom.v6i2.2661.

M. D. Purbolaksono, U. K. Dewi, R. L. Wicaksono, and A. P. Wibowo, “Sentiment Analysis of Game Review Using Random Forest,” International Journal on Information and Communication Technology (IJoICT), vol. 10, no. 2, pp. 161-169, 2024, doi: 10.21108/ijoict.v10i2.1007.

A. D. Adyatma, L. Afuan, and E. Maryanto, “The Effect of Unigram and Bigram in the Naïve Bayes Multinomial for Analyzing of Comment Sentiment of Gojek Application in Google Play Store,” Jurnal Teknik Informatika (JUTIF), vol. 4, no. 6, pp. 1535-1540, 2023, doi: 10.52436/1.jutif.2023.4.6.1310.

A. Gerliandeva, Y. H. Chrisnanto, and H. Ashaury, “Optimasi Klasifikasi Sentimen pada Komentar Online Menggunakan Multinomial Naïve Bayes dan Ekstraksi Fitur TF-IDF serta N-Grams,” Jurnal Pekommas, vol. 9, no. 2, pp. 259-272, 2024, doi: 10.56873/jpkm.v9i2.5585.

A. Kho and F. F. Tampinongkol, “Analisis Sentimen Pengguna Aplikasi Steam dengan Algoritma Naive Bayes,” Ranah Research: Journal of Multidisciplinary Research and Development, vol. 7, no. 6, pp. 4620-4627, 2025, doi: 10.38035/rrj.v7i6.1803.

B. J. Rizqullah, L. Afuan, and N. Chasanah, “Sentiment Analysis of Apex Legends Game Reviews on Steam Using Naïve Bayes Classifier,” Jurnal Ilmiah Teknik Komputer, vol. 1, no. 1, pp. 41-50, 2026, doi: 10.20884/1.jitk.1.1.33.

A. Géron, Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow, 3rd ed. Sebastopol, CA: O’Reilly Media, 2022. [Online]. Available:https://www.oreilly.com/library/view/hands-on-machine-learning/9781098125967/

Streamlit, “Streamlit Documentation,” Streamlit Documentation, 2026. Accessed: May 24, 2026. [Online]. Available: https://docs.streamlit.io/


Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel Analisis Sentimen Ulasan Berbahasa Inggris Apex Legends di Steam Menggunakan TF-IDF N-Gram dan Multinomial Naive Bayes

Dimensions Badge
Article History
Submitted: 2026-06-02
Published: 2026-07-05
Abstract View: 0 times
How to Cite
Zidane, M. A., & Sungkowo, Y. (2026). Analisis Sentimen Ulasan Berbahasa Inggris Apex Legends di Steam Menggunakan TF-IDF N-Gram dan Multinomial Naive Bayes. Journal of Information System Research (JOSH), 7(4). https://doi.org/10.47065/josh.v7i4.10141
Section
Articles