Sentiment Analysis of YouTube Comments on Indonesia-U.S. Trade Agreement: A Comparison of Machine Learning and Deep Learning
-
Dea Amanda
*
Universitas Bina Sarana Informatika Kampus Kota Pontianak, Pontianak,
Indonesia
- Muhammad Iqbal Universitas Bina Sarana Informatika Kampus Kota Pontianak, Pontianak, Indonesia
- Mia Rosmiati Universitas Bina Sarana Informatika Kampus Kota Pontianak, Pontianak, Indonesia (*) Corresponding Author
Abstract
The Indonesia–United States Trade Agreement has sparked much public debate on YouTube, but due to the large volume of data and the informal nature of the text, manual analysis is ineffective. Through a comparative study of machine learning (Naïve Bayes and Support Vector Machine) and deep learning (Long Short-Term Memory and IndoBert), this research aims to identify the polarity of public opinion and evaluate the best computational model. This study contributes a comprehensive empirical comparison of the four algorithms within an identical experimental pipeline on an issue that has not been previously explored, thereby offering methodological insights for future sentiment analysis research on similarly informal, domain-specific social media text. The dataset consists of 2,284 comments labeled using the InSet Lexicon. The analysis results show that the neutral class dominates the sentiment distribution (52,0%), followed by the positive class (20,2%) and the negative class (27,8%). Performance evaluation reveals that IndoBERT significantly outperforms other models with an accuracy of 87.71% and a Macro F1-Score of 0.87. Support Vector Machine ranked second (79.00%), followed by Naïve Bayes (61.71%). In contrast, Long Short-Term Memory failed completely (accuracy of 52.00%) due to the “majority class collapse” phenomenon in small-scale datasets. This study concludes that the Transformer architecture (IndoBert) is the most robust approach for classifying sentiment in informal Indonesian-language text containing specific geopolitical and economic terms.
Downloads
References
R. Qoni’ah, “Kemitraan Strategis Perdagangan Indonesia-Amerika Serikat : Menavigasi Tantangan Global dan Potensi Keunggulan Kompetitif,” J. Transform. Glob., vol. 11, no. 2, 2024, doi: https://doi.org/10.21776/ub.jtg.011.02.5
M. S. Mandalika and V. D. Muaja, “Analisis Hukum terhadap Dampak Pengenaan Tarif 32% oleh Amerika Serikat terhadap Perdagangan Indonesia: Tinjauan Perjanjian Perdagangan Internasional dan Kebijakan Ekonomi,” J. Polit. Sos. Huk. dan Hum., vol. 3, no. 2, 2025, doi: https://doi.org/10.59246/aladalah.v3i2.1285
S. D. Ariapramuda, “Transformasi Pembatasan Kedaulatan Regulasi dalam Hukum Investasi Indonesia Pasca Agreement on Reciprocal Trade ( ART ) Indonesia – Amerika Serikat 2026,” J. Glob. Ilm., vol. 3, no. 8, pp. 1942–1953, 2026, doi: https://doi.org/10.55324/jgi.v3i8.370
I. Sartika and I. Saputra, “Analisis Sentimen Masyarakat Terhadap Pembatasan Akses Media Sosial Bagi Anak Pada Platform YouTube Menggunakan Metode Support Vector Machine ( SVM ),” JIBEMA J. Ilmu Bisnis, Ekon. Manajemen, dan Akunt., vol. 3, no. 4, pp. 567–578, 2026, doi: https://doi.org/10.62421/jibema.v3i4.251
A. Pangestu and F. Maulana, “Implementasi Analisis Sentimen Komentar YouTube Berbasis IndoBERT dengan Evaluasi Confidence Score,” Semin. Nas. Teknol. Sains, vol. 5, no. 1, pp. 664–672, 2026, [Online]. Available: https://proceeding.unpkediri.ac.id/index.php/stains/article/view/9348
A. A. Qolbu, N. Fitriyati, and N. Inayah, “Performa Naïve Bayes, SVM, dan IndoBERT pada Analisis Sentimen Twitter IndiHome dengan Strategi Penanganan Data Tidak Seimbang,” J. Fourier, vol. 814, no. 1, pp. 29–44, 2025, [Online]. Available: https://fourier.or.id/index.php/FOURIER/article/view/252
D. D. Purwanto, “Empirical Evaluation of IndoBERT and LSTM for Sentiment Analysis of Tourism Reviews : A Data-Driven Study on Kenjeran Park,” J. Tek. Inform., vol. 7, no. 1, pp. 463–474, 2026, doi: https://doi.org/10.52436/1.jutif.2026.7.1.4901
S. A. Rahmadhani, L. D. Rusanti, and H. Al Rosyid, “Klasifikasi Sentimen Komentar Youtube Demo DPR RI Menggunakan Support Vector Machine,” Arcitech J. Comput. Sci. Artif. Intell., vol. 5, no. 2, pp. 356–375, 2025, doi: https://doi.org/10.29240/arcitech.v5i2.15316
S. F. Huwaida, R. Kusumawati, and B. Isnaini, “Analisis sentimen komentar youtube terhadap pemindahan ibu kota negara menggunakan metode Naïve Bayes,” Jambura J. Informatics, vol. 6, no. 1, pp. 26–39, 2024, doi: https://doi.org/10.37905/jji.v6i1.24718
E. Darmawan, M. A. Hasan, N. Rahmawati, and V. Kurniawan, “PEMANFAATAN LSTM UNTUK MENGANALISIS SENTIMEN PENGGUNA TWITTER : STUDI KASUS PADA TWEET BERITA TERKINI,” JATI (Jurnal Mhs. Tek. Inform., vol. 9, no. 2, pp. 2954–2963, 2025, doi: https://doi.org/10.36040/jati.v9i2.13194
N. R. Ramadhan and N. Hendrastuty, “Perbandingan Algoritma Naïve Bayes dan LSTM untuk Analisis Sentimen Terhadap Opini Masyarakat Tentang Sandwich Generation,” Build. Informatics, Technol. Sci., vol. 6, no. 3, pp. 1677–1687, 2024, doi: https://doi.org/10.47065/bits.v6i3.6385
H. Abriananta et al., “Comparison of Naive Bayes, Support Vector Machine, and Indobert Methods for Classifying Public Sentiment towards the MBG Program on Platform X,” J. Appl. Informatics Comput., vol. 10, no. 3, pp. 2806–2815, 2026, [Online]. Available: https://jurnal.polibatam.ac.id/index.php/JAIC/article/view/12721
M. R. Manoppo, I. C. Kolang, D. N. Fiat, R. Michelly, and C. Mawara, “ANALISIS SENTIMEN PUBLIK DI MEDIA SOSIAL TERHADAP KENAIKAN PPN 12% DI INDONESIA MENGGUNAKAN INDOBERT,” J. Kecerdasan Buatan dan Teknol. Inf., vol. 4, no. 2, pp. 152–163, 2025, doi: https://doi.org/10.69916/jkbti.v4i2.322
D. Nuryadi et al., “FINE TUNING INDOBERT UNTUK ANALISIS SENTIMEN PADA ULASAN PENGGUNA APLIKASI TIKET . COM DI GOOGLE PLAY STORE,” JATI (Jurnal Mhs. Tek. Inform., vol. 9, no. 2, pp. 3577–3583, 2025, doi: https://doi.org/10.36040/jati.v9i2.13204
I. W. A. Agetia, N. Luh, E. Armoni, I. P. Ari, and U. Irawan, “Evaluasi Kinerja Algoritma Naïve Bayes , SVM , dan IndoBERT pada Analisis Sentimen Ulasan Pengguna Gojek Berbasis Text Mining,” TIN Terap. Inform. Nusant., vol. 7, no. 1, pp. 89–98, 2026, [Online]. Available: https://ejurnal.seminar-id.com/index.php/tin/article/view/9617
E. Daniati et al., “Perbandingan Kinerja Algoritma SVM , LSTM , dan Fine-tuned IndoBERT dalam Analisis Sentimen Opini Masyarakat Indonesia terhadap Mobil Listrik,” IJCSR, vol. 5, no. 1, pp. 1–13, Jan. 2026, doi: 10.59095/ijcsr.v5i1.245.
M. Fahrezi, Y. B. Pratama, and A. Pramudiyantoro, “Analisis Sentimen Debat Publik Pilpres 2024 Menggunakan Metode Algoritma LSTM dan IndoBERT Pada Platform Youtube,” JPIM J. Penelit. Ilm. Multidsipliner, vol. 02, no. 03, pp. 1936–1961, 2025, [Online]. Available: https://ojs.ruangpublikasi.com/index.php/jpim/article/view/1110
D. Pratiwi, N. Khoerani, S. Sari, U. Trisakti, J. Barat, and P. Korespondensi, “ANALISIS SENTIMEN TERHADAP KEBIJAKAN SUBSIDIPEMBELIAN KENDARAAN BERTENAGA LISTRIK DI INDONESIA MENGGUNAKAN PENDEKATAN INSET LEXICON DAN METODE SUPPORT VECTOR MACHINE,” J. Teknol. Inf. dan Ilmu Komput., vol. 12, no. 6, pp. 1303–1314, 2025, [Online]. Available: https://jtiik.ub.ac.id/index.php/jtiik/article/view/9548
J. Siringoringo, S. P. Tanjung, H. Budi, S. Lukito, and J. Prancis, “Klasifikasi Sentimen Opini Publik pada Isu Anggaran DPR Menggunakan Support Vector Machine Berbasis Pembobotan Kelas,” J. Algoritm., pp. 1780–1790, 2026, doi: https://doi.org/10.33364/algoritma/v.23-1.3539
D. Septiani and I. Isabela, “Analisis Term Frequency Inverse Document Frequency (TF-IDF) Dalam Temu Kembali Informasi pada Dokumen Teks,” SINTESIA J. Sist. dan Teknol. Inf. Indones., vol. 25, no. 2, pp. 81–88, 2022, [Online]. Available: https://journal.unj.ac.id/unj/index.php/SINTESIA/article/view/39364
A. M. Yolanda and R. T. Mulya, “Implementasi Metode Support Vector Machine untuk Analisis Sentimen pada Ulasan Aplikasi Sayurbox di Google Play Store,” VARIANSI J. Stat. Its Appl. Teach. Res. Vol., vol. 6, no. 2, pp. 76–83, 2024, [Online]. Available: https://jurnalvariansi.unm.ac.id/index.php/variansi/article/view/258
D. S. Hani and C. I. Ratnasari, “Klasifikasi Masalah Pada Komunitas Marah-Marah di Twitter Menggunakan Long Short-Term Memory,” J. MEDIA Inform. BUDIDARMA, vol. 7, no. 4, pp. 1829–1837, 2023, [Online]. Available: https://paperity.org/p/341530804/klasifikasi-masalah-pada-komunitas-marah-marah-di-twitter-menggunakan-long-short-term
T. Gori et al., “PREPROCESSING DATA DAN KLASIFIKASI UNTUK PREDIKSI KINERJA AKADEMIK SISWA,” JTIIK, vol. 11, no. 1, pp. 215–224, Feb. 2024, doi: 10.25126/jtiik.20241118074.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Sentiment Analysis of YouTube Comments on Indonesia-U.S. Trade Agreement: A Comparison of Machine Learning and Deep Learning
Pages: 1067-1075
Copyright (c) 2026 Dea Amanda, Muhammad Iqbal, Mia Rosmiati
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
