Optimization Chatbot Services Based on DNN-Bert for Mental Health of University Students
Abstract
Attention to mental health is increasing in Indonesia, especially with the recent increase in the number of cases of stress and suicide among students. Therefore, this research aims to provide a solution to overcome mental health problems by introducing a chatbot system based on Deep Neural Networks (DNN) and BiDirectional Encoder Representation Transformers (BERT). The primary objective is to enhance accessibility and offer a more effective solution concerning the mental health of students. This chatbot utilizes Natural Language Processing (NLP) and Deep Learning to provide appropriate responses to mild mental health issues. The dataset, comprising objectives, tags, patterns, and responses, underwent processing using Indonesian language rules within NLP. Subsequently, the system was trained and tested using the DNN model for classification, integrated with the TokenSimilarity model to identify word similarities. Experimental results indicate that the DNN model yielded the best outcomes, with a training accuracy of 98.97%, validation accuracy of 71.74%, and testing accuracy of 71.73%. Integration with the TokenSimilarity model enhanced the responses provided by the chatbot. TokenSimilarity searches for input similarities from users within the knowledge generated from the training data. If the similarity is high, the input is then processed by the DNN model to provide the chatbot response. This integration of both models has proven to enhance the responsiveness of the chatbot in providing various responses even when the user inputs remain the same. The chatbot also demonstrates the capability to recognize various inputs more effectively with similar intentions or purposes. Additionally, the chatbot exhibits the ability to comprehend user inputs although there are many writing errors.
Downloads
References
D. Tadmon and P. S. Bearman, “Differential spatial-social accessibility to mental health care and suicide,” Proc. Natl. Acad. Sci. U. S. A., vol. 120, no. 19, pp. 1–8, 2023, doi: 10.1073/pnas.2301304120.
E. Astutik, S. K. Sebayang, S. I. Puspikawati, T. D. Tama, and D. M. S. K. Dewi, “Depression, anxiety, and stress among students in newly established remote university campus in Indonesia,” Malaysian J. Med. Heal. Sci., vol. 16, no. 1, pp. 270–277, 2020.
G. I. Rina Suprayanti, Fathra Annis Nauli, “GAMBARAN PERILAKU SELF INJURY DAN RISIKO BUNUH DIRI PADA MAHASISWA,” Heal. CARE J. Kesehat., no. December, pp. 31–37, 2021, doi: https://doi.org/10.36763/healthcare.v10i2.133.
S. D. Pratiwi and R. Djuwita, “Hubungan Gaya Hidup dengan Kesehatan Mental Remaja di Indonesia (Analisis Data Global School-Based Student Health Survey Indonesia 2015),” J. Epidemiol. Kesehat. Komunitas, vol. 7, no. 1, pp. 382–393, 2022, doi: 10.14710/jekk.v7i1.11905.
Y. Himayanti, R. Ratnawati, L. Yuliatun, and H. D. Windarwati, “Phenomenology Study of High School Students’ Experiences Who Do Suicidal-Attempt in Malang City, Indonesia,” Int. J. Sci. Soc., vol. 2, no. 3, pp. 259–268, 2020, doi: 10.54783/ijsoc.v2i3.168.
M. Janota, V. Kovess-Masfety, C. Gobin-Bourdet, and M. M. Husky, “Use of mental health services and perceived barriers to access services among college students with suicidal ideation,” J. Behav. Cogn. Ther., vol. 32, no. 3, pp. 183–196, 2022, doi: 10.1016/j.jbct.2022.02.003.
L. Munira, P. Liamputtong, and P. Viwattanakulvanid, “Barriers and facilitators to access mental health services among people with mental disorders in Indonesia: A qualitative study,” Belitung Nurs. J., vol. 9, no. 2, pp. 110–117, 2023, doi: 10.33546/bnj.2521.
S. Prakasam, N. Balakrishnan, T. R. Kirthickram, B. Ajith Jerom, and S. Deepak, “Design and Development of AI-Powered Healthcare WhatsApp Chatbot,” ViTECoN 2023 - 2nd IEEE Int. Conf. Vis. Towar. Emerg. Trends Commun. Netw. Technol. Proc., 2023, doi: 10.1109/ViTECoN58111.2023.10157423.
S. D’Alfonso, “AI in mental health,” Curr. Opin. Psychol., vol. 36, pp. 112–117, 2020, doi: 10.1016/j.copsyc.2020.04.005.
A. Yakisir and Z. C. Duman, “Mental health‐related internet use by people with a diagnosis of chronic psychiatric disorder, attending community mental health centres,” Heal. Inf. Libr. J., no. May, pp. 1–11, 2022, doi: 10.1111/hir.12449.
J. Madan and S. Madan, “Intelligent and Personalized Factoid Question and Answer System,” 2022 10th Int. Conf. Reliab. Infocom Technol. Optim. (Trends Futur. Dir. ICRITO 2022, pp. 1–7, 2022, doi: 10.1109/ICRITO56286.2022.9964818.
T. Nabarian, Y. Wirani, M. P. Siddiq, Aseptianova, M. Z. Aziz, and A. D. Saputro, “E-counseling-based Expressive Writing Therapy Platform for Overcoming Student Mental Health Problems,” Int. Conf. Electr. Eng. Comput. Sci. Informatics, vol. 2022-Octob, no. October, pp. 250–255, 2022, doi: 10.23919/EECSI56542.2022.9946453.
M. Jaiwai, K. Shiangjen, S. Rawangyot, S. Dangmanee, T. Kunsuree, and A. Sa-Nguanthong, “Automatized Educational Chatbot using Deep Neural Network,” 2021 Jt. 6th Int. Conf. Digit. Arts, Media Technol. with 4th ECTI North. Sect. Conf. Electr. Electron. Comput. Telecommun. Eng. ECTI DAMT NCON 2021, pp. 85–89, 2021, doi: 10.1109/ECTIDAMTNCON51128.2021.9425716.
M. Wang and F. Hu, “The application of nltk library for python natural language processing in corpus research,” Theory Pract. Lang. Stud., vol. 11, no. 9, pp. 1041–1049, 2021, doi: 10.17507/tpls.1109.09.
M. A. Rosid, A. S. Fitrani, I. R. I. Astutik, N. I. Mulloh, and H. A. Gozali, “Improving Text Preprocessing for Student Complaint Document Classification Using Sastrawi,” IOP Conf. Ser. Mater. Sci. Eng., vol. 874, no. 1, 2020, doi: 10.1088/1757-899X/874/1/012017.
F. Koto, A. Rahimi, J. H. Lau, and T. Baldwin, “IndoLEM and IndoBERT: A Benchmark Dataset and Pre-trained Language Model for Indonesian NLP,” COLING 2020 - 28th Int. Conf. Comput. Linguist. Proc. Conf., pp. 757–770, 2020, doi: 10.18653/v1/2020.coling-main.66.
R. Anusuya and K. Sakkarapani, “Efficient Training Strategy for Classification Using Deep Neural Network With Hybridization of Quantum Enthused Artificial Bee Colony Algorithm,” Int. J. Health Sci. (Qassim)., vol. 6, no. March, pp. 6864–6884, 2022, doi: 10.53730/ijhs.v6ns4.9958.
Y. Liu, Y. Gao, and W. Yin, “An improved analysis of stochastic gradient descent with momentum,” Adv. Neural Inf. Process. Syst., vol. 2020-Decem, no. 2, pp. 1–11, 2020.
A. Al-Besher, K. Kumar, M. Sangeetha, and T. Butsa, “BERT for conversational question answering systems using semantic similarity estimation,” Comput. Mater. Contin., vol. 70, no. 3, pp. 4763–4780, 2022, doi: 10.32604/cmc.2022.021033.
B. Wilie et al., “IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding,” 2020, [Online]. Available: http://arxiv.org/abs/2009.05387
A. Rogers, O. Kovaleva, and A. Rumshisky, “A primer in bertology: What we know about how bert works,” Trans. Assoc. Comput. Linguist., vol. 8, pp. 842–866, 2020, doi: 10.1162/tacl_a_00349.
W. A. Qader, M. M. Ameen, and B. I. Ahmed, “An Overview of Bag of Words;Importance, Implementation, Applications, and Challenges,” Proc. 5th Int. Eng. Conf. IEC 2019, pp. 200–204, 2019, doi: 10.1109/IEC47844.2019.8950616.
G. H. G Krishna Vamsi, Akhtar Rasool, “Chatbot A Deep Neural Network Based Human to Machine Conversation Model,” Int. Conf. Comput. Netw. Technol., 2020, doi: https://doi.org/10.1109/ICCCNT49239.2020.9225395.
E. T. Anzaku, H. Wang, A. Van Messem, and W. De Neve, “A principled evaluation protocol for comparative investigation of the effectiveness of DNN classification models on similar-but-non-identical datasets,” arXiv Prepr., 2022, [Online]. Available: http://arxiv.org/abs/2209.01848
J. S. Hyatt and M. S. Lee, “Requirements for Developing Robust Neural Networks,” pp. 2–5, 2019, [Online]. Available: http://arxiv.org/abs/1910.02125
Copyright (c) 2024 Azmi Abiyyu Dzaky, Junta Zeniarja, Catur Supriyanto, Guruh Fajar Shidik, Cinantya Paramita, Egia Rosi Subhiyakto, Sindhu Rakasiwi
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) ) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
