Classification of English Language Anxiety Using Support Vector Machine on Twitter User
- Ericho Marozi Telkom University, Bandung, Indonesia
-
Kemas Muslim Lhaksmana
*
Telkom University, Bandung,
Indonesia
(*) Corresponding Author
Abstract
This study aims to classify expressions of language anxiety in English as a foreign language, as reflected in user-generated texts on Twitter. The research applies machine learning approaches Support Vector Machine (SVM) and Convolutional Neural Network (CNN) to perform automatic classification of anxiety levels. The dataset was collected through Twitter crawling, filtered for relevance, and annotated manually using a three-point scale (low, medium, high) based on psychological indicators such as fear of speaking, avoidance, and self-perceived inability. Preprocessing included text normalization, tokenization, stopword removal, and feature extraction using TF-IDF with unigram to trigram representations. Model training was conducted on a balanced dataset, and performance was evaluated through cross-validation and tuning of key hyperparameters. SVM achieved the highest accuracy of 98.40%, showing strong stability across various test conditions. CNN initially performed competitively but experienced a slight performance drop after tuning, suggesting its sensitivity to parameter settings and data volume. The findings demonstrate that SVM is more robust and suitable for limited-data environments, making it a practical tool for classifying psychological traits like language anxiety in digital communication. This research offers insight into the potential of machine learning in psychological and linguistic analysis, especially through social media platforms.
Downloads
References
A. Deani, G. J. Putri, Adib Alfalah, and A. Perizga, “Kecemasan Penggunaan Bahasa Asing di Kelas AFL Dewasa,” Jurnal Pengabdian Masyarakat dan Riset Pendidikan, vol. 3, no. 4, pp. 1594–1603, May 2025, doi: 10.31004/jerkin.v3i4.696.
J. M. Dewaele, E. Botes, and R. Meftah, “A Three-Body Problem: The effects of foreign language anxiety, enjoyment, and boredom on academic achievement,” Annu Rev Appl Linguist, vol. 43, pp. 7–22, 2023, doi: 10.1017/S0267190523000016.
K. Rahayu, V. Fitria, D. Septhya, R. Rahmaddeni, and L. Efrizoni, “Klasifikasi Teks untuk Mendeteksi Depresi dan Kecemasan pada Pengguna Twitter Berbasis Machine Learning,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 3, no. 2, pp. 108–114, 2023, doi: 10.57152/malcom.v3i2.780.
H. Wang, J. He, X. Zhang, and S. Liu, “A Short Text Classification Method Based on NGram and CNN,” Chinese Journal of Electronics, vol. 29, no. 2, pp. 248–254, Mar. 2020, doi: 10.1049/cje.2020.01.001.
S. Bhatnagar, J. Agarwal, and O. R. Sharma, “Detection and classification of anxiety in university students through the application of machine learning,” Procedia Comput Sci, vol. 218, no. 2022, pp. 1542–1550, 2022, doi: 10.1016/j.procs.2023.01.132.
M. Kang, S. Shin, G. Zhang, J. Jung, and Y. T. Kim, “Mental Stress Classification Based on a Support Vector Machine and Naive Bayes Using Electrocardiogram Signals,” Sensors, vol. 21, no. 23, p. 7916, Nov. 2021, doi: 10.3390/s21237916.
P. Rathnayaka, N. Mills, D. Burnett, D. De Silva, D. Alahakoon, and R. Gray, “A Mental Health Chatbot with Cognitive Skills for Personalised Behavioural Activation and Remote Health Monitoring,” Sensors, vol. 22, no. 10, p. 3653, May 2022, doi: 10.3390/s22103653.
K. G. Ginting, N. Prasetyo, A. V. Gunawan, M. Sihombing, and A. A. Nababan, “Classification of Anxiety Levels of IGD Patients at RSU Royal Prima Medan Using Support Vector Machine (SVM) Algorithm,” Teknika, vol. 14, no. 2, pp. 255–263, Jul. 2025, doi: 10.34148/teknika.v14i2.1243.
T. Sadariya and S. Verma, “Early Prediction and Detection of Anxiety Level Using Support Vector Machine,” Lecture Notes in Networks and Systems, vol. 787 LNNS, no. November, pp. 279–291, 2023, doi: 10.1007/978-981-99-6550-2_22.
T. M. Wijiasih, R. N. S. Amriza, and D. A. Prabowo, “The Classification of Anxiety, Depression, and Stress on Facebook Users Using the Support Vector Machine,” JISA(Jurnal Informatika dan Sains), vol. 5, no. 1, pp. 75–79, 2022, doi: 10.31326/jisa.v5i1.1273.
D. Rhamadian, “Dampak Kecemasan (Anxiety) Dalam Olahraga Terhadap Atlet,” Journal of Sport Science and Tourism Activity (JOSITA), vol. 1, no. 1, p. 31, 2022, doi: 10.52742/josita.v1i1.15433.
S. Han, Y. Li, and S. A. Haider, “Impact of Foreign Language Classroom Anxiety on Higher Education Students Academic Success: Mediating Role of Emotional Intelligence and Moderating Influence of Classroom Environment,” Front Psychol, vol. 13, Jul. 2022, doi: 10.3389/fpsyg.2022.945062.
A. H. Nasrullah, “Implementasi Algoritma Decision Tree Untuk Klasifikasi Produk Laris,” Jurnal Ilmiah Ilmu Komputer, vol. 7, no. 2, pp. 45–51, 2021, doi: 10.35329/jiik.v7i2.203.
N. B. Putri and A. W. Wijayanto, “Analisis Komparasi Algoritma Klasifikasi Data Mining Dalam Klasifikasi Website Phishing,” Komputika : Jurnal Sistem Komputer, vol. 11, no. 1, pp. 59–66, 2022, doi: 10.34010/komputika.v11i1.4350.
L. Rook, M. C. Mazza, I. Lefter, and F. Brazier, “Toward Linguistic Recognition of Generalized Anxiety Disorder,” Front Digit Health, vol. 4, Apr. 2022, doi: 10.3389/fdgth.2022.779039.
J. Shen et al., “Establishment and psychometric characteristics of emotional words list for suicidal risk assessment in speech emotion recognition,” Front Psychiatry, vol. 13, Nov. 2022, doi: 10.3389/fpsyt.2022.1022036.
A. Nilla and E. B. Setiawan, “Film Recommendation System Using Content-Based Filtering and the Convolutional Neural Network (CNN) Classification Methods,” Jurnal Ilmiah Teknik Elektro Komputer dan Informatika, vol. 10, no. 1, p. 17, 2024, doi: 10.26555/jiteki.v9i4.28113.
A. Loiz and Z. K. Abdurahman Baizal, “KNN-Based Music Recommender System with Feedforward Neural Network,” Jurnal Ilmiah Teknik Elektro Komputer dan Informatika (JITEKI), vol. 10, no. 4, pp. 992–1003, 2024, doi: 10.26555/jiteki.v10i4.30526.
L. Mayasari and D. Indarti, “Klasifikasi Topik Tweet Mengenai Covid Menggunakan Metode Multinomial Naïve Bayes Dengan Pembobotan Tf-Idf,” Jurnal Ilmiah Informatika Komputer, vol. 27, no. 1, pp. 43–53, 2022, doi: 10.35760/ik.2022.v27i1.6184.
R. A. Supono and M. A. Suprayogi, “Perbandingan Metode TF-ABS dan TF-IDF Pada Klasifikasi Teks Helpdesk Menggunakan K-Nearest Neighbor,” Jurnal RESTI, vol. 5, no. 5, pp. 911–918, 2021, doi: 10.29207/resti.v5i5.3403.
E. Mulyani, F. P. B. Muhamad, and K. A. Cahyanto, “Pengaruh N-Gram terhadap Klasifikasi Buku menggunakan Ekstraksi dan Seleksi Fitur pada Multinomial Naïve Bayes,” Jurnal Media Informatika Budidarma, vol. 5, no. 1, p. 264, 2021, doi: 10.30865/mib.v5i1.2672.
W. Li and N. Aletras, “Improving Graph-Based Text Representations with Character and Word Level N-grams,” in Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), Stroudsburg, PA, USA: Association for Computational Linguistics, 2022, pp. 228–233. doi: 10.18653/v1/2022.aacl-short.29.
A. Noviriandini, H. Hermanto, and Y. Yudhistira, “Klasifikasi Support Vector Machine Berbasis Particle Swarm Optimization Untuk Analisa Sentimen Pengguna Aplikasi Pedulilindungi,” JIKA (Jurnal Informatika), vol. 6, no. 1, p. 50, 2022, doi: 10.31000/jika.v6i1.5681.
W. Eko Saputro, H. Yuana, and W. Dwi Puspitasari, “Analisis Sentimen Pengguna Dompet Digital Dana Pada Kolom Komentar Google Play Store Dengan Metode Klasifikasi Support Vector Machine,” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 7, no. 2, pp. 1151–1156, 2023, doi: 10.36040/jati.v7i2.6842.
D. Iswantoro and D. Handayani UN, “Klasifikasi Penyakit Tanaman Jagung Menggunakan Metode Convolutional Neural Network (CNN),” Jurnal Ilmiah Universitas Batanghari Jambi, vol. 22, no. 2, p. 900, 2022, doi: 10.33087/jiubj.v22i2.2065.
Verdy and E. Hartati, “Klasifikasi Penyakit Mata Menggunakan Convolutional Neural Network Model Resnet-50,” Jurnal Rekayasa Sistem Informasi dan Teknologi, vol. 1, no. 3, pp. 199–206, 2024, doi: 10.59407/jrsit.v1i3.529.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Classification of English Language Anxiety Using Support Vector Machine on Twitter User
Pages: 1122-1130
Copyright (c) 2025 Ericho Marozi, Kemas Muslim Lhaksmana
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
