Bridging the Gap or Widening the Divide: A Call for Capacity-Building in Artificial Intelligence for Healthcare in the Philippines

Kurt Lenard T. Gutierrez, Paulene Miriel L. Viacrusis

Oct 2023 DOI 10.35460/2546-1621.2023-0081     Access   

Abstract

The emerging field of generative artificial intelligence (GAI) and some of its well-known technologies: ChatGPT, Google Bard and Claude, have gained substantial popularity due to their enormous potential in healthcare applications, as seen in medically fine-tuned models such as Med-PaLM and ChatDoctor. While these advancements are impressive, the dependence of AI development on data volume and quality raises questions about the generalizability of these models. Regions with lower medical research output risk bias and misrepresentation in AI-generated content, especially when used to assist clinical practice. Upon testing of a prompt concerning the isoniazid dosing of Filipinos versus other ethnic and racial groups, responses from GPT-4, GPT-3, Bard and Claude resulted in 3 out of 4 outputs showing convincing but false content, with extended prompting illustrating how response hallucination happens in GAI models. To address this, model refinement techniques such as fine-tuning and prompt ensembles are suggested; however, refining AI models for local contextualization requires data availability, data quality and quality assurance frameworks. Clinicians and researchers in the Philippines and other underrepresented regions are called to initiate capacity-building efforts to prepare for AI in healthcare. Early efforts from all stakeholders are needed to prevent the exacerbation of health inequities, especially in the new clinical frontiers brought about by GAI.

 

Keywords: Artificial Intelligence, Bias, ChatGPT, Healthcare, Philippines

  1. Tu T, Azizi S, Driess D, Schaekermann M, Amin M, Chang PC, et al. Towards generalist biomedical AI. arXiv [Preprint]. 2023 Jul 26 [cited 2023 Aug 6]. Available from: http://arxiv.org/abs/2307.14334
  2. Singhal K, Azizi S, Tu T, Mahdavi SS, Wei J, Chung HW, et al. Large language models encode clinical knowledge. Nature . 2023 Aug;620(7972):172–80.
  3. Moor M, Banerjee O, Abad ZSH, Krumholz HM, Leskovec J, Topol EJ, et al. Foundation models for generalist medical artificial intelligence. Nature . 2023 Apr;616(7956):259–65.
  4. Wang P. On defining artificial intelligence. J Artif Gen Intell . 2019 Jan 1;10(2):1–37.
  5. Davenport T, Kalakota R. The potential for artificial intelligence in healthcare. Future Healthc J . 2019 Jun;6(2):94–8.
  6. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, et al. Attention is all you need. In: Guyon I, Von Luxburg U, Bengio S, Wallach H, Fergus R, Vishwanathan S, Garnett R. Proceedings of the Advances in Neural Information Processing Systems 30 (NIPS 2017); 2017 December; California, USA.
  7. Emmert-Streib F, Yang Z, Feng H, Tripathi S, Dehmer M. An introductory review of deep learning for prediction models with big data. Front Artif Intell [Internet]. 2020;3. Available from: https://www.frontiersin.org/articles/10.3389/frai.2020.00004
  8. Introducing ChatGPT [Internet]. San Francisco (US): OpenAI; 2022 Nov 30 [cited 2023 Oct 10]. Available from: https://openai.com/blog/chatgpt
  9. Hu K. ChatGPT sets record for fastest-growing user base - analyst note. Reuters [Internet]. 2023 Feb 2. Available from: https://www.reuters.com/technology/chatgpt-sets-record-fastest-growing-user-base-analyst-note-2023-02-01/
  10. OpenAI. GPT-4 technical report. arXiv [Preprint]. 2023 Mar 27 [cited 2023 Aug 6]. Available from: http://arxiv.org/abs/2303.08774
  11. Dave T, Athaluri SA, Singh S. ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front Artif Intell . 2023 May 4;6:1169595.
  12. U.S. Food and Drug Administration. Artificial intelligence and machine learning (AI/ML)-enabled medical devices. Digit Health Cent Excell [Internet]. 2023 Oct 19. Available from: https://www.fda.gov/medical-devices/software-medical-device-samd/artificial-intelligence-and-machine-learning-aiml-enabled-medical-devices
  13. Singhal K, Tu T, Gottweis J, Sayres R, Wulczyn E, Hou L, et al. Towards expert-level medical question answering with large language models. arXiv [Preprint]. 2023 May 16. Available from: http://arxiv.org/abs/2305.09617
  14. Li Y, Li Z, Zhang K, Dan R, Jiang S, Zhang Y, et al. ChatDoctor: A medical chat model fine-tuned on a Large Language Model Meta-AI (LLaMA) using medical domain knowledge. Cureus [Internet]. 2023 Jun 24;15(6). Available from: https://www.cureus.com/articles/152858-chatdoctor-a-medical-chat-model-fine-tuned-on-a-large-language-model-meta-ai-llama-using-medical-domain-knowledge
  15. Touvron H, Lavril T, Izacard G, Martinet X, Lachaux MA, Lacroix T, et al. LLaMA: Open and efficient foundation language models.
  16. Amazon.com, Inc. AWS announces AWS HealthScribe, a new generative AI-powered service that automatically creates clinical documentation [Internet]. Amazon Press Center. 2023. Available from: https://press.aboutamazon.com/2023/7/aws-announces-aws-healthscribe-a-new-generative-ai-powered-service-that-automatically-creates-clinical-documentation
  17. McGuinness, Tom, Nole, Diana. Breaking new ground in healthcare with the next evolution of AI [Internet]. The Official Microsoft Blog. 2023. Available from: https://blogs.microsoft.com/blog/2023/03/20/breaking-new-ground-in-healthcare-with-the-next-evolution-of-ai/
  18. Bommasani R, Hudson DA, Adeli E, Altman R, Arora S, von Arx S, et al. On the opportunities and risks of foundation models. arXiv [Preprint]. 2022 Jul 12. Available from: http://arxiv.org/abs/2108.07258
  19. Lester B, Al-Rfou R, Constant N. The power of scale for parameter-efficient prompt tuning. arXiv [Preprint]. 2021 Sep 2. Available from: http://arxiv.org/abs/2104.08691
  20. Norori N, Hu Q, Aellen FM, Faraci FD, Tzovara A. Addressing bias in big data and AI for health care: A call for open science. Patterns . 2021 Oct 8;2(10):100347.
  21. Kleinberg G, Diaz MJ, Batchu S, Lucke-Wold B. Racial underrepresentation in dermatological datasets leads to biased machine learning models and inequitable healthcare. J Biomed Res . 2022;3(1):42–7.
  22. Alkaissi H, McFarlane SI. Artificial hallucinations in ChatGPT: Implications in scientific writing. Cureus . 15(2):e35179.
  23. Goddard J. Hallucinations in ChatGPT: A cautionary tale for biomedical researchers. Am J Med [Internet]. 2023 Jun 25;0(0). Available from: https://www.amjmed.com/article/S0002-9343(23)00401-1/fulltext
  24. Gregorio G, Cutiongco-dela Paz EM, Gonzales ML, dela Paz EM, Rocamora FM. N-acetyltransferase2 genotype and its association with hepatitis among Filipino children treated with first line anti-tuberculosis drugs. Acta Med Philipp [Internet]. 2010 Dec 31;45(1). Available from: https://www.herdin.ph/index.php/partner/journal?view=research&cid=39818
  25. Autus-Geniston LV, Matias RR, Tuazon AO. Allelic frequencies of single nucleotide polymorphisms (SNPs) in the N-acetyltransferase 2 (NAT2) gene of Filipinos. Acta Med Philipp [Internet]. 2010;44(3). Available from: https://actamedicaphilippina.upm.edu.ph/index.php/acta/article/view/7702
  26. Cai Y, Yi J, Zhou C, Shen X. Pharmacogenetic study of drug-metabolising enzyme polymorphisms on the risk of anti-tuberculosis drug-induced liver injury: A meta-analysis. Plos One . 2012 Oct 17;7(10):e47769.
  27. Wang P, Pradhan K, Zhong X bo, Ma X. Isoniazid metabolism and hepatotoxicity. Acta Pharm Sin B . 2016 Sep;6(5):384–92.
  28. Li Y, Li Z, Zhang K, Dan R, Jiang S, Zhang Y. ChatDoctor: A medical chat model fine-tuned on a Large Language Model Meta-AI (LLaMA) using medical domain knowledge. arXiv [Preprint]. 2023 Jun 24. Available from: http://arxiv.org/abs/2303.14070
  29. Ding N, Qin Y, Yang G, Wei F, Yang Z, Su Y, et al. Parameter-efficient fine-tuning of large-scale pre-trained language models. Nat Mach Intell . 2023 Mar;5(3):220–35.
  30. Varghese J, Chapiro J. ChatGPT: The transformative influence of generative AI on science and healthcare. J Hepatol [Internet]. 2023 Aug 4;0(0). Available from: https://www.journal-of-hepatology.eu/article/S0168-8278(23)05039-0/fulltext
  31. Zhang X, Wu J, He Z, Liu X, Su Y. Medical exam question answering with large-scale reading comprehension. In: Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence and Thirtieth Innovative Applications of Artificial Intelligence Conference and Eighth AAAI Symposium on Education Advances in Artificial Intelligence; 2018 February; Louisiana (USA): AAAI Press. Available from https://dl.acm.org/doi/abs/10.5555/3504035.3504735
  32. Youssef A, Pencina M, Thakur A, Zhu T, Clifton D, Shah NH. External validation of AI models in health should be replaced with recurring local validation. Nat Med . 2023 Oct 18;1–2.
  33. Department of Health, Philippine Health Insurance Corporation. National Health Data Repository Framework [Internet]. Department of Health; 2022. Available from: https://www.philhealth.gov.ph/about_us/NationalHealthDataRepositoryFramework03282022.pdf
  34. Tiangco, Beatrice. Early cancer detection in the liver of Filipinos with chronic hepatitis B using AI-driven integration of clinical and genomic biomarkers (CANDLE Study) [Internet]. National Institutes of Health, University of the Philippines - Manila; 2019. Available from: https://bidsandawards.upm.edu.ph/sites/default/files/PROFESSIONAL%20SERVICES%20Scan.pdf
  35. Baltazar LR, Manzanillo MG, Gaudillo J, Viray ED, Domingo M, Tiangco B, et al. Artificial intelligence on COVID-19 pneumonia detection using chest x-ray images. Plos One . 2021 Oct 14;16(10):e0257884.
  36. Ligue, Kim, Ligue, Kristine. Deep learning approach to forecasting dengue cases in Davao City using long short-term memory (LSTM). Philipp J Sci . 2022 Jun;151(3):797–812.

Articles related to the one you are viewing

There are currently no results to show, please try again later

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License, which permits use, share — copy and redistribute the material in any medium or format, adapt — remix, transform, and build upon the material, as long as you give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use. You may not use the material for commercial purposes. If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original. You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-sa/4.0/.