Source avec lien : Safety Science, 155. 10.1016/j.ssci.2022.105870
Il existe un nombre croissant d’applications d’IA dans le domaine des soins de santé en cours de développement ou déjà utilisées. Cependant, l’impact sur la sécurité de l’utilisation de l’IA dans les soins de santé est largement inconnu. Dans cet article, nous explorons comment les différentes parties prenantes (patients, personnel hospitalier, développeurs de technologies, régulateurs) pensent à la sécurité et à l’assurance de la sécurité de l’IA dans les soins de santé.
Introduction There is an increasing number of healthcare AI applications in development or already in use. However, the safety impact of using AI in healthcare is largely unknown. In this paper we explore how different stakeholders (patients, hospital staff, technology developers, regulators) think about safety and safety assurance of healthcare AI. Methods 26 interviews were undertaken with patients, hospital staff, technology developers and regulators to explore their perceptions on the safety and the safety assurance of AI in healthcare using the example of an AI-based infusion pump in the intensive care unit. Data were analysed using thematic analysis. Results Participant perceptions related to: the potential impact of healthcare AI, requirements for human-AI interaction, safety assurance practices and regulatory frameworks for AI and the gaps that exist, and how incidents involving AI should be managed. Conclusion The description of a diversity of views can support responsible innovation and adoption of such technologies in healthcare. Safety and assurance of healthcare AI need to be based on a systems approach that expands the current technology-centric focus. Lessons can be learned from the experiences with highly automated systems across safety-critical industries, but issues such as the impact of AI on the relationship between patients and their clinicians require greater consideration. Existing standards and best practices for the design and assurance of systems should be followed, but there is a need for greater awareness of these among technology developers. In addition, wider ethical, legal, and societal implications of the use of AI in healthcare need to be addressed.