VALIDATION OF A CHATBOT FOR HEALTHCARE
Article Sidebar
Main Article Content
Abstract
The Covid-19 pandemic has brought changes to the organization and structure of health services. Artificial Intelligence has proved to be an important tool for providing care and health-related information. The aim was to validate a chatbot on mental health care in the context of Covid-19 with professionals from Psychosocial Care Centers. This methodological study was carried out in three stages: construction, content validation and appearance validation. The theoretical-methodological basis used followed Pasquali's presuppositions, being based on the theoretical, empirical and analytical poles. The research was carried out between May 2021 and July 2022. The minimum Content Validation Index (CVI) adopted was 0.70. The instruments used to collect the data were content validation, appearance validation and usability validation. The binomial test and content validity index were carried out. In terms of content, objectives, structure and relevance, the validations and evaluation of appearance were satisfactory, demonstrating the chatbot's potential for use in health and mental health care. It can be concluded that the use of Artificial Intelligence has been gaining prominence in the health area to modify the experience of users and professionals in the health-disease process and its variables involved, such as forms of prevention, health and mental health promotion, health guidance, among others.
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c). Conjuncture Bulletin (BOCA)
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
ALMANASREH, E.; MOLES, R.; CHEN, T. F. “Evaluation of methods used for estimating content validity”. Research in Social and Administrative Pharmacy, vol. 15, n. 2, 2019.
ALVIM, A. L. S.; GAZZINELLI, A.; COUTO, B. R. G. M. “Construção e validação de instrumento para avaliação da qualidade dos programas de controle de infecção”. Revista Gaúcha de Enfermagem, vol. 42, n. 1, 2021.
AMIRI, P.; KARAHANNA, E. “Chatbot use cases in the Covid-19 public health response”. Journal of the American Medical Informatics Association, vol. 29, n. 5, 2022.
ATIQUE, S. et al. “A Nursing informatics response to COVID-19: Perspectives from five regions of the world”. Journal of Advanced Nursing, vol. 76, n. 10, 2020.
BARDIN, L. Análise de conteúdo. Lisboa: Editora Edições 70, 2011.
BOUABIDA, K.; LEBOUCHÉ, B.; POMEY, M. P. “Telehealth and COVID-19 Pandemic: An Overview of the Telehealth Use, Advantages, Challenges, and Opportunities during COVID-19 Pandemic”. Healthcare, vol. 10, n. 11, 2022
BROWNSTEIN, J. S. et al. “Advances in Artificial Intelligence for Infectious-Disease Surveillance”. New England Journal of Medicine, vol. 388, n. 17, 2023.
CHIN, H. et al. “User-Chatbot Conversations During the COVID-19 Pandemic: Study Based on Topic Modeling and Sentiment Analysis”. Journal of Medical Internet Research, vol. 25, n. 1, 2023.
CHIZHIK, A.; ZHEREBTSOVA, Y. “Challenges of Building an Intelligent Chatbot”. CEUR-WS [2020]. Disponível em: . Acesso em: 10/02/2024.
CHUTIYAMI, M. et al. “COVID-19 Pandemic and Overall Mental Health of Healthcare Professionals Globally: A Meta-Review of Systematic Reviews”. Frontiers in Psychiatry, vol. 12, n. 1, 2021.
COELHO, L. E. S.; MARQUES, G. L. W. B.; WANZINACK, C. “Saúde docente na pandemia: um estudo de caso com profissionais do ensino superior da Universidade Federal do Paraná–Setor Litoral”. Boletim de Conjuntura (BOCA), vol. 11, n. 33, 2022.
ETTMAN, C. K.; GALEA, S. “The Potential Influence of AI on Population Mental Health”. JMIR -Mental Health, vol. 10, n. 1, 2023.
GABRIELLI, S. et al. “Engagement and Effectiveness of a Healthy-Coping Intervention via Chatbot for University Students During the COVID-19 Pandemic: Mixed Methods Proof-of-Concept Study”. JMIR mhealth and uhealth, vol. 9, n. 5, 2021.
GALETSI, P.; KATSALIAKI, K.; KUMAR, S. “The medical and societal impact of big data analytics and artificial intelligence applications in combating pandemics: a review focused on Covid-19”. Social Science and Medicine, vol. 301, n. 5, 2022.
HODGES, A. Alan Turing: The Enigma. Trenton: Princeton University Press, 2014.
IANCU, I.; IANCU, B. “Interagindo com chatbots mais tarde na vida: uma perspectiva de aceitação da tecnologia na situação de pandemia de COVID-19”. Frontiers in Psychology, vol. 13, n. 1, 2023.
KAYWAN, P. et al. “Early detection of depression using a conversational AI bot: A non-clinical trial”. PloS One, vol. 18, n. 2, 2023.
LI, C. et al. “Artificial Intelligence in battling infectious diseases: a transformative role”. Journal of Medical Virology, vol. 96, n. 1, 2024.
LUDIN, N. et al. “A Chatbot to Support Young People During the COVID-19 Pandemic in New Zealand: Evaluation of the Real-World Rollout of an Open Trial”. Journal of Medical Internet Research, vol. 24, n. 11, 2022.
MBUAGBAW, L. et al. “A tutorial on methodological studies: the what, when, how and why”. BMC Medical Research Methodology, vol. 20, n. 226, 2020.
MEDEIROS, R. K. S. et al. “Modelo de validação de conteúdo de Pasquali nas pesquisas em enfermagem”. Referência – Revista de Enfermagem, vol. 4, n. 4, 2015.
MOCKAITIS, A. I.; BUTLER, C. L.; OJO, A. “COVID-19 pandemic disruptions to working lives: a multilevel examination of impacts across career stages”. Journal of Vocational Behavior, vol. 138, n. 1, 2022.
ORDEN-MEJÍA, M. et al. “Modeling users’ satisfaction and visit intention using AI-based chatbots”. PloS One, vol. 18, n. 9, 2023.
PANDEY, S.; SHARMA, S.; WAZIR, S. “Mental healthcare chatbot based on natural language processing and deep learning approaches: Ted the therapist”. International Journal of Information Technology, vol. 14, n. 6, 2022.
PARVIAINEN, J.; RANTALA, J. “Chatbot breakthrough in the 2020s? An ethical reflection on the trend of automated consultations in health care”. Medicine, Health Care and Philosophy, vol. 25, n. 1, 2022.
PASQUALI, L. Instrumentação psicológica: fundamentos e práticas. Porto Alegre: Editora Artmed, 2010.
RIBEIRO, A. A. A. et al. “Impactos da pandemia COVID-19 na vida, saúde e trabalho de enfermeiras”. Acta Paulista de Enfermagem, vol. 35, n. 8, 2022.
ROQUE, G. S. L. et al. “Content validation and usability of a chatbot of guidelines for wound dressing”. International Journal of Medical Informatics, vol. 151, n. 1, 2021.
SEIFERTH, C. et al. “How to e-mental health: a guideline for researchers and practitioners using digital technology in the context of mental health”. Nature Mental Health, vol. 1, n. 8, 2023.
SOMMERVILLE, I. Engenharia de Software. São Paulo: Editora Pearson, 2019.
SOUZA, A. C. C.; MOREIRA, T. M. M.; BORGES, J. W. P. “Desenvolvimento de instrumento para validar aparência de tecnologia educacional em saúde”. Revista Brasileira de Enfermagem, vol. 73, n. 6, 2020.
SOUZA, C. S.; TURRINI, R. N. T.; POVEDA, V. B. “Tradução e adaptação do instrumento “suitability assessment of materials” (sam) para o português”. Revista de Enfermagem UFPE Online, vol. 9, n. 5, 2015.
STIRPARO, G. et al. “Impacto na saúde pública da pandemia de COVID-19 no sistema de saúde de emergência”. Journal of Public Health, vol. 44, n. 1, 2022.
TIMMONS, A. C. et al. “A Call to Action on Assessing and Mitigating Bias in Artificial Intelligence Applications for Mental Health”. Perspectives on Psychological Science, vol. 18, n. 5, 2023.
TURING, A. M. “Computing Machinery and Intelligence”. Mind, vol. 59, n. 236, 1950.
WEI, W. et al. “A study on community older people’s willingness to use smart home—an extended technology acceptance model with intergenerational relationships”. Frontiers in Public Health, vol. 11, n. 1, 2023.
WHITE, B. K.; MARTIN A.; WHITE, J. A. “User Experience of COVID-19 Chatbots: Scoping Review”. Journal of Medical Internet Research, vol. 24, n. 12, 2022.
WILSON, L.; MARASOIU, M. “The development and use of chatbots in public health: scoping review”. JMIR - Hum Factors, vol. 9, n. 4, 2022.
XUE, J. et al. “Evaluation of the Current State of Chatbots for Digital Health: Scoping Review”. Journal of Medical Internet Research, vol. 25, n. 1, 2023.
ZHU, Y.; WANG, R.; PU, C. “I am chatbot, your virtual mental health adviser.” What drives citizens’ satisfaction and continuance intention toward mental health chatbots during the COVID-19 pandemic? An empirical study in China”. Digital Health, vol. 8, n. 1, 2022.