Autors: Samokisheva, V. G., Trifonov, R. I., Pavlova, G. V.
Title: Risks and Challenges of Using Ai In Healthcare
Keywords: Artificial Intelligence (AI), Ethical Issues, Health Information Technology, Healthcare, Safety Concerns

Abstract: Artificial intelligence (AI) is increasingly utilized in analyzing complex and large-scale data for producing results without intervention of human in various healthcare contexts, such as genomics, bioinformatics, and analysis of image. Given technology give opportunities that are significant in diagnosis, treatment, imaging, analysis of the risk, management of the lifestyle, management of health information, and health assistance. AI is an topic that is used increasingly in many fields, more usually in medicine, which leads to the transformation of the diagnostic system, to make better the development of new drugs, to make the quality improvements for medical services and patient care in general and to reduce costs. Every day stories trend in the media about AI applications and their huge potential for medical practice revolutionizing. However, no matter of the big promises for electronic health records in the early 21st century, the excitement around AI has sometimes leads to focused view of its capabilities while ignoring challenges of technology, and safety of humans and ethical concerns which must be really considered.While AI presents significant opportunities, it also introduces challenges and pitfalls, particularly concerning safety and ethical issues. This article reviews AI in healthcare, emphasizing its implications for safety and ethics. Key strategies for ensuring safer AI technology include safest design, safety reserves, mechanisms of safe fail, and procedural safeguards, while recognizing the importance of addressing cost, risk, and uncertainty. Additionally, the article identifies three critical ethical issues: transparency and privacy, dynamic information, consent, ownership, discrimination. The article suggests that protocols should be established and shared with all stakeholders to mitigate these challenges and clear guidance should be given.

References

  1. Kent, J. (2019, June 25). Could artificial intelligence do more harm than good in healthcare? Health IT Analytics. Retrieved from https://healthitanalytics.com/news/could-artificial-intelligence-do-more-harm-than-good-in-healthcare
  2. Shroff, A. (2022, April 14). Healthcare AI bias: Reasons and resolutions. Healthcare IT Today. Retrieved from www.healthcareittoday.com/2022/04/14/healthcare-ai-biasreasons-and-resolutions/
  3. Challen, R., Denny, J., Pitt, M., Gompels, L., Edwards, T., & Tsaneva-Atanasova, K. (2019, March). Artificial intelligence, bias and clinical safety. BMJ Quality & Safety, 28(3), 231-237. doi: 10.1136/bmjqs-2018-008370
  4. Knight, W. (2017, April 11). The dark secret at the heart of AI. MIT Technology Review. Retrieved from www.technologyreview.com/s/604087/the-dark-secret-atthe-heart-of-ai/
  5. Anderson, M., & Anderson, S. L. (2019, February). How should AI be developed, validated, and implemented in patient care? AMA Journal of Ethics, 21(2), E125-130. doi: 10.1001/amajethics.2019.125
  6. Laura M. Cascella, MA, CPHRM, Artificial Intelligence Risks: Black-Box Reasoning
  7. Angle, J. (2021). Artificial intelligence in healthcare. Cloud Security Alliance. Retrieved from https://cloudsecurityalliance.org/artifacts/artificialintelligence-in-healthcare/
  8. Wartman, S. A., & Combs, S. D. (2019, February). Reimagining medical education in the age of AI. AMA Journal of Ethics, 21(2), E146-152. doi: 10.1001/amajethics.2019.146
  9. Kundu, S. (2021). How will artificial intelligence change medical training? Communication Medicine, 1(8). https://doi.org/10.1038/s43856-021-00003-5
  10. Elle Hunt. Tay, Microsoft's AI chatbot, gets a crash course in racism from Twitter. Got from https://www.theguardian.com/technology/2016/mar/24/taymicrosofts-ai-chatbot-gets-a-crash-course-in-racism-fromtwitter/
  11. J Lumetzberger, S Noiret, M. Kampel Bias and fairness in computer vision applications of the criminal justice system Proceedings of 2021 IEEE Symposium Series on Computational Intelligence (SSCI) (2021), 10.1109/SSCI50451.2021.9660177
  12. Phil McCausland. Self-driving Uber car that hit and killed woman did not recognize that pedestrians jaywalk. Available from https://www.nbcnews.com/tech/tech-news/selfdriving-uber-car-hit-killed-woman-did-not-recognizen1079281/
  13. Facebook Apologizes After A.I. Puts ‘primates’ label on video of black men.
  14. Melissa Heikkilä, Dutch scandal serves as a warning for Europe over risks of using algorithms. Available from https://www.politico.eu/article/dutch-scandal-serves-as-awarning-for-europe-over-risks-of-using-algorithms
  15. Gretton, C. (2017, June 24). The dangers of AI in health care: risk homeostasis and automation bias. Towards Data Science. Retrieved from https://towardsdatascience.com/the-dangers-of-ai-in-health-care-risk-homeostasis-andautomation-bias-148477a9080f

Issue

2024 12th International Scientific Conference on Computer Science, COMSCI 2024 - Proceedings, 2024, , https://doi.org/10.1109/COMSCI63166.2024.10778509

Цитирания (Citation/s):
1. Hristov A., Development of Laboratory Exercise "cybersecurity of IIoT Protocols", 2025, 60th International Scientific Conference on Information Communication and Energy Systems and Technologies Icest 2025 Proceedings, issue 0, DOI 10.1109/ICEST66328.2025.11098378 - 2025 - в издания, индексирани в Scopus

Вид: публикация в международен форум, публикация в реферирано издание, индексирана в Scopus