Predicting Depressive Disorder Based on DASS-42 on Twitter Using XLNet's Pretrained Model Classification Text

Intan Ramadhani; Warih Maharani

doi:10.47065/josyc.v3i4.2157

Intan Ramadhani Telkom University, Bandung, Indonesia
Warih Maharani * Telkom University, Bandung, Indonesia

(*) Corresponding Author

DOI: https://doi.org/10.47065/josyc.v3i4.2157

Keywords: Tweet; Depression; DASS-42; Predict; XLNet

Abstract

Twitter is a free social media site that is not only a place to share posts and multimedia content but also offers its users to express their feelings, emotions, and sentiments about an issue. So with this, it is often found that Twitter users make posts that show how the user's behavior includes mental problems experienced users such as symptoms of depression, anxiety, and stress disorders. Only about half of depression cases can be detected by doctors or other experts, this is because until now, the diagnosis of depression starts from reports of patients, family, or close friends of patients, or also starts from the results of certain tests such as questionnaires. So this research builds a model to predict depression by building a model that predicts whether someone is depressed through tweets on Twitter using the XLNet pre-trained text classification model. Testing is done by removing stemming from the preprocessing stage. Testing is also done by adding hyperparameters for fine-tuning the XLNet model. Testing is also carried out using a dataset that filters out foreign words where foreign data is translated into Indonesian. The data stored is data that uses words based on the KBBI dictionary. Based on the results of model testing that has been carried out using confusion matrix, the model can predict tweets that indicate depression and get an accuracy value of 78.57%.

Downloads

Download data is not yet available.

References

Islam, Md. R., Kabir, M. A., Ahmed, A., Kamal, A. R. M., Wang, H., & Ulhaq, A. (2018). Depression detection from social network data using machine learning techniques. Health Information Science and Systems, 6(1). https://doi.org/10.1007/s13755-018-0046-0

Cunha, M., Ribeiro, A., & André, S. (2016). Anxiety, Depression and Stress in Patients with Rheumatoid Arthritis. Procedia - Social and Behavioral Sciences, 217. https://doi.org/10.1016/j.sbspro.2016.02.098

Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behaviour Research and Therapy, 33(3). https://doi.org/10.1016/0005-7967(94)00075-U

Rodrigo Martınez-Castano1, Amal Htait, Leif Azzopardi, and Yashar Moshfeghi. (2020). Early Risk Detection of Self-Harm and Depression Severity using BERT-based Transformers. http://ceur-ws.org/Vol-2696/paper_50.pdf

Al-Rfou, R., Choe, D., Constant, N., Guo, M., & Jones, L. (2019). Character-level language modeling with deeper self-attention. 33rd AAAI Conference on Artificial Intelligence, AAAI 2019, 31st Innovative Applications of Artificial Intelligence Conference, IAAI 2019 and the 9th AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019. https://doi.org/10.1609/aaai.v33i01.33013159

Kevin Clark, Minh-Thang Luong, Urvashi Khandelwal, Christopher D. Manning, and Quoc V. Le. (2019). Bam! born-again multitask networks for natural language understanding. anonymous preprint under review.

Christian, H., Suhartono, D., Chowanda, A., & Zamli, K. Z. (2021). Text based personality prediction from multiple social media data sources using pre-trained language model and model averaging. Journal of Big

S. Kusumadewi and H. Wahyuningsih, “Model Sistem Pendukung Keputusan Kelompok untuk Penilaian Gangguan Depresii, Kecemasan dan Stress Berdasarkan DASS-42,” J. Teknol. Inf. dan Ilmu Komput., vol. 7, no. 2, p. 219, 2020, doi: 10.25126/jtiik.2020721052.

Depression Anxiety and Stress Scale DASS (-42). https://www.healthfocuspsychology.com.au/tools/dass-42/

Buani, D. C. P. (2016). Optimasi Algoritma Naive Bayes dengan Menggunakan Algoritma Genetika untuk Prediksi Kesuburan (Fertility). Jurnal Evolusi

Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R., & Le, Q. v. (2019). XLNet: Generalized autoregressive pretraining for language understanding. Advances in Neural Information Processing Systems, 32.

Pedregosa, F. and Varoquaux, G., Gramfort, A. and Michel, V., Thirion, B. and Grisel, O., Blondel, M. and Prettenhofer, P., Weiss, R. and Dubourg, V., Vanderplas, J. and Passos, A., Cournapeau, D. and Brucher, M., Perrot, M., & Duchesnay, E. (2011). Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, 12(85).

Singh, A., & Jain, G. (2021). Sentiment Analysis of News Headlines Using Simple Transformers. 2021 Asian Conference on Innovation in Technology, ASIANCON 2021. https://doi.org/10.1109/ASIANCON51346.2021.9544806

Visa, S., Ramsay, B., Ralescu, A., & van der Knaap, E. (2011). Confusion matrix-based feature selection. CEUR Workshop Proceedings, 710.

Dj Novakovi, J., Veljovi, A., Ili, S. S., Zeljko Papi, ˇ, & Tomovi, M. (2017). Evaluation of Classification Models in Machine Learning. In Theory and Applications of Mathematics & Computer Science (Vol. 7, Issue 1).

Smith, S. L., Kindermans, P. J., Ying, C., & Le, Q. v. (2018). Don’t decay the learning rate, increase the batch size. 6th International Conference on Learning Representations, ICLR 2018 - Conference Track Proceedings.

Loshchilov, I., & Hutter, F. (2017). SGDR: Stochastic gradient descent with warm restarts. 5th International Conference on Learning Representations, ICLR 2017 - Conference Track Proceedings.

Bila bermanfaat silahkan share artikel ini

Berikan Komentar Anda terhadap artikel Predicting Depressive Disorder Based on DASS-42 on Twitter Using XLNet's Pretrained Model Classification Text