Radiologists’ satisfaction and engagement with artificial intelligence software

The purpose of this study was to evaluate the radiologists’ engagement and satisfaction with artificial intelligence software as a means to support medical decision-making.
A survey of radiologists working in public healthcare facilities under the Moscow Healthcare Department was conducted in 2021 and 2022.
The survey was completed by 333 radiologists in 2021, and by 342 – in 2022. The respondents were CT, MRI, X-ray and MMG specialists of various age and clinical experience. The study found that the physicians’ engagement rate with artificial intelligence more than doubled in 2022 vs. 2021. An assessment of satisfaction with the artificial intelligence technologies in routine clinical practice showed that in 2022 vs. 2021, the opinions shifted from the extreme “excellent” and “unsatisfactory” rates towards moderate “good” and “satisfactory”.
The findings show that artificial intelligence technologies require further improvement from both clinical and technical standpoint, public perception and also as an educational tool for physicians who use artificial intelligence in their routine clinical practice

1. Alekseeva MG, Zubov AI, Novikov MYu. Iskusstvennyi intellekt v meditsine. International Research Journal. 2022; 7: 10-13. (In Russ.)

2. Gusev A, et al. Development of Artificial Intelligence in Healthcare in Russia. Handbook of Artificial Intelligence in Healthcare: Vol 2: Practicalities and Prospects. Springer International Publishing. 2022: 259-279.

3. Arzamasov K.M, et al. Primenenie komp’yuternogo zreniya dlya profilakticheskikh issledovanii na primere mammografii. Profilakticheskaya meditsina. 2023; 26(6): 117-123. (In Russ.)

4. Eksperiment po ispol’zovaniyu innovatsionnykh tekhnologii v oblasti komp’yuternogo zreniya dlya analiza meditsinskikh izobrazhenii i dal’neishego primeneniya v sisteme zdravookhraneniya goroda Moskvy. cited 2023 June 20 Available from: https://mosmed.ai/ai/. (In Russ.)

5. Vasilev YuA, et al. Komp’yuternoe zrenie v luchevoi diagnostike: pervyi etap Moskovskogo eksperimenta. М.: Izdatel’skie resheniya. 2023. 388 р. (In Russ.)

6. . Vasilev YuA, Vladzymyrskyy AV, Omelyanskaya OV. Certificate of state registration of the database №2023621230 RF. MosMedData: Health records of 41,000 people who underwent computed tomography during the COVID-19 pandemic with the follow-up monitoring (results of patient routing, clinical and laboratory data, ICD diagnoses, outcomes): №2023620970, submitted on April 11, 2023. Submitter: Research and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow Health Care Department. (In Russ.)

7. Vladzymyrskyy AV, et al. Effectiveness of using artificial intelligence technologies for dual descriptions of the results of preventive lung examinations. Profil. med. 2022; 25(7): 7.

8. Karpov OA, Klimenko GS, Lebedev GS. Primenenie intellektual’nykh sistem v zdravookhranenii. Modern High Technologies. 2016; 7(1): 38-43. (In Russ.)

9. Higgins DC. OnRAMP for Regulating Artificial Intelligence in Medical Products. Advanced Intelligent Systems. 2021; 3(11): 2100042.

10. Vasilev YuA, Vladzymyrskyy AV, Omelyanskaya OV, et al. Otsenka zrelosti tekhnologii iskusstvennogo intellekta dlya zdravookhraneniya: metodicheskie rekomendatsii. M.: Research and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow Health Care Department. 2023. Р.28. (In Russ.)

11. Huisman M, et al. An international survey on AI in radiology in 1,041 radiologists and radiology residents part 1: fear of replacement, knowledge, and attitude. Eur Radiol. 2021; 31(9): 7058-7066.

12. Morozov SP, et al. Effect of artificial intelligence technologies on the CT scan interpreting time in COVID-19 patients in inpatient setting. Profil. med. 2022: 25(1); 14.

13. Petraikin AV, et al. Tochnost’ avtomaticheskoi diagnostiki kompressionnykh perelomov tel pozvonkov po dannym morfometricheskogo algoritma iskusstvennogo intellekta. Osteoporosis and Bone Diseases. 2023; 25(3): 92-93. (In Russ.)

14. Morozov SP, et al. Issledovanie tselesoobraznosti primeneniya tekhnologii iskusstvennogo intellekta v luchevoi diagnostike. Medical doctor and information technologies. 2022; 1: 12-29. (In Russ.)

15. Zinchenko VV, et al. Methodology for Conducting Post-Marketing Surveillance of Software as a Medical Device Based on Artificial Intelligence Technologies. Sovrem Tehnol Med. 2022; 14(5): 15.

16. Huisman M, et al. An international survey on AI in radiology in 1,041 radiologists and radiology residents part 1: fear of replacement, knowledge, and attitude. Eur Radiol. 2021; 31(9): 7058-7066.

17. Impact of artificial intelligence on radiology: a EuroAIM survey among members of the European Society of Radiology. Insights Imaging. 2019; 10: 105.

18. Coppola F, et al. Artificial intelligence: radiologists’ expectations and opinions gleaned from a nationwide online survey. Radiol med. 2021; 126(1): 63-71.

19. Chen M, et al. Acceptance of clinical artificial intelligence among physicians and medical students: A systematic review with cross-sectional survey. Front Med (Lausanne). 2022; 9: 990604.

20. Becker CD, et al. Current practical experience with artificial intelligence in clinical radiology: a survey of the European Society of Radiology. Insights into Imaging. 2022; 13(1): 107.

21. Waymel Q, et al. Impact of the rise of artificial intelligence in radiology: What do radiologists think? Diagn Interv Imaging. 2019; 100(6): 327-336.

22. Paranjape K, et al. Introducing Artificial Intelligence Training in Medical Education. JMIR Medical Education. 2019; 5(2): 16048.

23. Garin SP, et al. Systematic Review of Radiology Residency Artificial Intelligence Curricula: Preparing Future Radiologists for the Artificial Intelligence Era. Journal of the American College of Radiology. 2023; 20(6): 561-569.

24. Zinchenko VV, et al. Tekhnologicheskie defekty programmnogo obespecheniya s iskusstvennym intellektom. Digital Diagnostics. 2023; 4(4): 593-604. (In Russ.)

25. Rezazade Mehrizi MH, et al. The impact of AI suggestions on radiologists’ decisions: a pilot study of explainability and attitudinal priming interventions in mammography examination. Sci Rep. 2023; 13: 9230.

26. Gusev AV, Dobridnyuk SL. Iskusstvennyj intellekt v medicine i zdravoohranenii. Informacionnoe obshchestvo. 2020; №4-5: 78-93. (In Russ.)

27. Kobrinskij B.A. Iskusstvennyj intellekt v medicine: sostoyanie i goryachie tochki. XIX Nacional’naya konferenciya po iskusstvennomu intellektu s mezhdunarodnym uchastiem KII-2021. YUzhnyj federal’nyj universitet, 2021: 13-29. (In Russ.)