To AI or not to AI? Key questions to consider

Questions to ask suppliers	What to look out for
What is this AI solution designed to do?	Do the intended uses of the AI solve the issues you are trying to solve? What uses does the AI have regulatory approval and certifications for? Are there any exclusions or limitations you need to be aware of?
2. What evidence is there supporting the effectiveness of the AI? Does evidence exist in real-world settings?	Has the solution been tested in a real-world clinical setting?  How do the results compare to effectiveness without use of the AI component? Is the AI adding value? How similar is the training data cohort to your population?  Are there potential biases that have been raised that you need to consider and explore in more depth? Does the supplier indicate if and how they mitigate against any biases? Has another organisation rolled out the product that you could get in contact with to gather their experience?
3. What implementation support within your existing infrastructure  is required?	What level of effort will be required to integrate the solution into existing digital pathways and for ongoing monitoring?  Will any changes be required in IT and digital systems and data management?  Has another organisation rolled out the product that you could get in contact with to gather their experience?

These questions can be used to gather an understanding of the purpose of the proposed AI, the evidence supporting its use and the implementation support required. 

If after hearing the responses you feel the product may be a good solution to the problem you are trying to solve, deeper exploration is required before a final procurement decision can be made. 

Next steps if moving forward with an AI solution

Following the initial conversation, if you have decided the product could be a good solution, assemble a team of experts from within your organisation with expertise covering data and IT infrastructure, information governance, implementation and transformation, cyber security and clinical leadership (if the AI has a clinical component) to further explore the feasibility of adopting the AI into your organisation. There are several resources that can support AI adopters with navigating the complex environment of adopting AI within the NHS, including: 

• A Buyer’s Guide to AI in Health and Care, developed by NHS Transformation Directorate in 2020 contains additional questions and detailed answers. The majority of the information is still relevant in the 2024 environment; however, elements of the regulatory environment section may not reflect the current situation. 
• Developing Healthcare Workers’ Confidence in AI report developed by the NHS AI Lab and Health Education England in 2022 contains additional questions to consider when conversations with suppliers develop (pages 88-91).
• All Adopters' Guidance lists of all the guidance and regulations that apply to adopters of digital technologies in health and social care.
• Artificial Intelligence where the NHS Digital Academy has curated resources including a framework to support healthcare workers understand their level of understanding in AI.
• Adopt AI on the NHS England Transformation Directorate website curates a selection of resources.