Analisis Sentimen Terhadap Ulasan Google Review Honda Malang Sekawan Motor Menggunakan IndoRoBERTa


  • Fera Dhea Sagita Institut Teknologi Sains dan Kesehatan RS DR. Soepraoen Kesdam V/BRW, Kota Malang, Indonesia
  • M. Syauqi * Mail Institut Teknologi Sains dan Kesehatan RS DR. Soepraoen Kesdam V/BRW, Kota Malang, Indonesia
  • Risqy Siwi Pradini Institut Teknologi Sains dan Kesehatan RS DR. Soepraoen Kesdam V/BRW, Kota Malang, Indonesia
  • (*) Corresponding Author
Keywords: Sentiment Analysis; Fine-Tuning; Google Review; IndoRoBERTa; Weak Labeling

Abstract

Customer reviews on Google Review contain important information about service quality, but the large and unstructured amount of data makes manual analysis difficult. This research aims to analyze the sentiment of customer reviews on Google Review Honda Malang Sekawan Motor Singosari using the IndoRoBERTa model thru a fine-tuning process. The dataset was obtained thru web scraping, followed by preprocessing which included cleaning, case folding, normalization, tokenization, stopword removal, and stemming. Sentiment labeling is performed using the lexicon-based InSet method as the initial labeling (weak labeling), then the dataset is divided into training and testing data with an 80:20 ratio. The model is used to classify sentiment into three classes: positive, neutral, and negative. The test results show that the model achieved an accuracy of 0.94, precision of 0.92, recall of 0.94, and an F1-score of 0.92. The model shows good performance in classifying positive sentiment, but still has limitations in recognizing negative sentiment due to data distribution imbalance. The contribution of this research is to provide an evaluation of the application of fine-tuning IndoRoBERTa in the domain of Google Review reviews of Indonesian-language automotive dealers, which have different characteristics from previous studies that mostly used social media data, while also analyzing the influence of InSet-based weak labeling and class imbalance on classification performance. The research results can serve as a basis for utilizing sentiment analysis to help dealers understand customer perceptions and identify aspects of service that need to be maintained or improved. The evaluation of the research also shows that the classification results still represent the label patterns generated by InSet, so further research needs to use human annotation as ground truth to improve the validity of the results.

Downloads

Download data is not yet available.

References

Abidin, M. I., & Pamungkas, E. W. (2025). Analisis Sentimen Terhadap Timnas Indonesia di Piala Asia 2023 dengan Model Transformer Berbahasa Indonesia. Jurnal Teknologi Dan Sistem Informasi Univrab, 10(2), 482–496. https://doi.org/https://doi.org/10.36341/rabit.v10i2.6142

Ahn, Y., & Lee, J. (2024). The Impact of Online Reviews on Consumers ’ Purchase Intentions : Examining the Social Influence of Online Reviews , Group Similarity , and Self-Construal. Journal of Theorectical and Applied Electronic Commerce Research, 19(2), 1060–1078. https://doi.org/https://doi.org/10.3390/jtaer19020055

Al-zaelani, R. S. A., Ramadhan, Y. R., & Komara, M. A. (2023). Analisis Sentimen Review Produk Motor Honda PCX dan Yamaha N-MAX Pada Twitter Menggunakan Algoritma Naive Bayes. JATI (Jurnal Mahasiswa Teknik Informatika), 7(3), 1812–1816. https://doi.org/https://doi.org/10.36040/jati.v7i3.7008

Anshory, M. N., Mazdadi, M. I., Saragih, T. H., & Saputro, S. W. (2025). Application of Adaboost Algorithm with SMOTE and Optuna Techniques in Sleep Disorder Classification. Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics, 2, 415–426. https://doi.org/https://doi.org/10.35882/ijeeemi.v7i2.99

Berry, S. (2024). Consumer lying in online reviews : recent evidence. 2010, 1–16. https://doi.org/https://doi.org/10.48550/arXiv.2405.12743

Chintya Ayu Maharani, Budi Warsito, R. S. (2024). Analisis sentimen vaksin covid-19 pada twitter menggunakan recurrent neural network (rnn) dengan algoritma long short-term memory (lstm) 1,2,3. Jurnal Gaussian, 12, 403–413. https://doi.org/10.14710/j.gauss.12.3.403-413

Chockalingam, D. (2023). Impact of Online Reviews and Ratings on Vehicle Purchase Decisions. International Journal for Multidisciplinary Research (IJFMR), 5(4), 1–4.

Dzakwan, M., Lazuardi, B., & Fatyanosa, T. N. (2025). Klasifikasi Emosi Multikelas Berbasis Teks Bahasa Indonesia Menggunakan IndoRoBERTa. Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer, 9(9), 1–9.

Egha Arya Affandi, Sumarno Sumarno, Uce Indahyanti, Y. F. (2026). Analisis Sentimen Ulasan Masyarakat Aplikasi Brompit Menggunakan Algoritma Naive Bayes dan SVM. 10(1), 1160–1167. https://doi.org/https://doi.org/10.36040/jati.v10i1.16955

Fernandes, S. (2022). Measuring the Impact of Online Reviews on Consumer Purchase Decisions – A Scale Development Study Measuring the Impact of Online Reviews on Consumer Purchase Decisions – A Scale Development Study. Elsevier, 0–34. https://www.sciencedirect.com/science/article/pii/S096969892200159X

Fitri, E., Yuliani, Y., Rosyida, S., & Gata, W. (2020). Analisis Sentimen Terhadap Aplikasi Ruangguru Menggunakan Algoritma Naive Bayes , Random Forest Dan Support Vector Machine. 18(1), 71–80.

Girsang, A. S. (2022). Sentiment Analysis of COVID-19 Public Activity Restriction ( PPKM ) Impact using BERT Method. International Journal of Engineering Trends and Technology, 70(12), 281–288. https://doi.org/https://doi.org/10.14445/22315381/IJETT-V70I12P226

Guo, W., & Luo, Q. (2023). Journal of Retailing and Consumer Services Investigating the impact of intelligent personal assistants on the purchase intentions of Generation Z consumers : The moderating role of brand credibility. Journal of Retailing and Consumer Services, 73(April).

Haris, M., Suharso, A., Nurkifli, E. H., Informatika, P. S., Karawang, U. S., & Timur, T. (2024). Analisis Sentimen Pada Game Efootball di Google Play Store Menggunakan Algoritma IndoBERT. JATI (Jurnal Mahasiswa Teknik Informatika), 8(6), 12108–12121. https://doi.org/https://doi.org/10.36040/jati.v8i6.11810

Hidayat, J. J., Setyowati, C., Dikaisa, M., Amin, I., Bimasakti, K., & Werdana, A. P. (2025). Deep Learning-based Sentiment Analysis of Public Comments on Military Education Using RoBERTa Algorithm and Rule-Based Hybird Parameters. Jurnal Media Computer Science, 4(2), 277–292. https://doi.org/https://doi.org/10.37676/jmcs.v4i2.8769

Koto, F. (2017). InSet Lexicon : Evaluation of a Word List for Indonesian Sentiment Analysis in Microblogs. IEEE, 391–394. https://doi.org/10.1109/IALP.2017.8300625

Lee, D. (n.d.). Factors that affect consumer trust in product quality: a focus on online reviews and shopping platforms. 2023, 1–10. https://doi.org/10.1057/s41599-023-02277-7

Liang, T. (2022). A study on the influence of online reviews of new products on consumers ’ purchase decisions : An empirical study on. September, 1–22. https://doi.org/10.3389/fpsyg.2022.983060

Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. 1. http://arxiv.org/abs/1907.11692

Mukherjee, R. K. (2024). Transforming Digitally: A Systematic Literature Review of Consumer Behavior & Digital Transformation Interaction. International Journal of Development Research, 14(2015), 67052–67062. https://doi.org/doi.org/10.37118/ijdr.28942.11.2024

Opitz, J. (2024). A Closer Look at Classification Evaluation Metrics and a Critical Reflection of Common Evaluation Practice. 12(2018), 820–836.

Purnama, A. (2023). Analisis Sentimen Terhadap Review Pengguna Indrive di Google Playstore Menggunakan Algoritma Support Vector Machine. Jurnal Darma Agung, 31(1), 1015–1025.

Purwati, K. Y. (2023). Analisis Sentimen Berita Vaksin COVID-19 dengan Robustly Optimized BERT Pre-Training Approach (RoBERTa). Skripsi, UIN Syarif Hidayatullah Jakarta.

Roberta, M. (n.d.). Prediksi Sentimen Pada Teks Media Sosial Corporate University. 302–316.

Sandra, L., Marcel, Gunarso, G., Fredicia, & Riruma, O. W. (2022). Are University Students Independent: Twitter Sentiment Analysis of Independent Learning in Independent Campus Using RoBERTa Base IndoLEM Sentiment Classifier Model. 2021 International Seminar on Machine Learning, Optimization, and Data Science (ISMODE), 249–253. https://doi.org/10.1109/ISMODE53584.2022.9743110

Sukma, F. D., Wijaya, R., & Romadhony, A. (2025). Speech to Text Correction for Indonesian Early Marriage Counseling Chatbots Using. Journal on Computing, 10(August), 72–87. https://doi.org/10.21108/indojc.v10i1.9708

Walther, M., Watson, S., Boden, A., Stel, M., Walther, M., Watson, S., Boden, A., A, M. S., & Walther, M. (2026). A grounded theory of how consumers determine the veracity of online user reviews. 3001. https://doi.org/10.1080/0144929X.2025.2528764


Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel Analisis Sentimen Terhadap Ulasan Google Review Honda Malang Sekawan Motor Menggunakan IndoRoBERTa

Dimensions Badge
Article History
Published: 2026-08-31
Abstract View: 53 times
PDF Download: 30 times
Issue
Section
Articles