menu

ReachMD

Be part of the knowledge.
Register

We’re glad to see you’re enjoying ReachMD…
but how about a more personalized experience?

Register for free

High-Accuracy AI Improves Lung Cancer Detection

ReachMD Healthcare Image
08/17/2023
medicalxpress.com
(A–C) Chest radiographs obtained as part of a health checkup in a 71-year-old male patient show reader susceptibility to high diagnostic accuracy artificial intelligence (AI). In the first session without AI, a thoracic radiologist with 16 years of experience read the chest radiograph as a normal radiograph (A). High diagnostic accuracy AI observed potential lung cancer in the radiograph with an 89% CI as indicated by the nodule localization map (B) (as the color changes from blue to red, the probability of the presence of a nodule increases). When presented with the AI suggestion at the second reading session, the radiologist changed the decision and annotated lung cancer in the area that overlapped with the right hemidiaphragm (box annotation) (C). (D, E) Contrast-enhanced chest CT scans show a 6.8-cm lung mass (arrow) with an air bronchogram in the right lower lobe in the axial (D) and coronal (E) planes. This mass was pathologically proven to be an invasive mucinous adenocarcinoma. Therefore, the reader’s decision was incorrect in the first session but correct in the second session after following the AI suggestion. Credit: Radiological Society of North America

Assistance from an artificial intelligence (AI) algorithm with high diagnostic accuracy improved radiologist performance in detecting lung cancers on chest X-rays and increased human acceptance of AI suggestions, according to a study published in the journal Radiology.

While AI-based image diagnosis has advanced rapidly in the medical field, the factors affecting radiologists' diagnostic determinations in AI-assisted image reading remain underexplored. Researchers at Seoul National University looked at how these factors might influence the detection of malignant lung nodules during AI-assisted reading of chest X-rays.

In this retrospective study, 30 readers, including 20 thoracic radiologists with five to 18 years of experience and 10 radiology residents with only two to three years of experience, assessed 120 chest X-rays without AI. Of the 120 chest radiographs assessed, 60 were from lung cancer patients (32 males) and 60 were controls (36 males). Patients had a median age of 67 years. In a second session, each group reinterpreted the X-rays, assisted by either a high- or low-accuracy AI. The readers were blind to the fact that two different AIs were used.

Use of the high-accuracy AI improved readers' detection performance to a greater extent than low-accuracy AI. Use of high-accuracy AI also led to more frequent changes in reader determinations—a concept known as susceptibility.

(A, B) Chest radiographs obtained as part of a health checkup in a 65-year-old male patient show reader susceptibility to low diagnostic accuracy performance artificial intelligence (AI). In the first session without AI, a thoracic radiologist with 17 years of experience annotated the mass opacity in the right upper lung zone as lung cancer (box annotation) (A). Low diagnostic accuracy AI suggested the radiograph as normal (B). When presented with the AI suggestion at the second reading session, the radiologist changed the decision and determined this radiograph was normal. (C, D) Contrast-enhanced chest CT scans show a 3-cm lung mass (arrow) in the right upper lobe in the axial (C) and coronal (D) planes. The mass was pathologically proven to be invasive adenocarcinoma. Therefore, the reader’s decision was correct in the first session but incorrect in the second session after following the AI suggestion. Credit: Radiological Society of North America

"It is possible that the relatively large sample size in this study bolstered readers' confidence in the AI's suggestions," said study lead author Chang Min Park, M.D., Ph.D., from the Department of Radiology and Institute of Radiation Medicine at Seoul National University College of Medicine in Seoul. "We think this issue of human trust in AI is what we observed in the susceptibility in this study: humans are more susceptible to AI when using high diagnostic performance AI."

Compared to the first reading session, readers assisted by the high diagnostic accuracy AI at the second reading session showed higher per-lesion sensitivity (0.63 versus 0.53), and specificity (0.94 versus 0.88). Alternatively, readers assisted by the low diagnostic accuracy AI at the second reading session did not show improvement between the two reading sessions for any of these measurements.

"Our study suggests that AI can help radiologists, but only when the AI's diagnostic performance meets or exceeds that of the human reader," Dr. Park said.

The results underline the importance of using high diagnostic performance AI. However, Dr. Park noted that the definition of "high diagnostic performance AI" can vary depending on the task and the clinical context in which it will be used. For example, an AI model that can detect all abnormalities on chest X-rays may seem ideal. But in practice, such a model would have limited value in reducing the workload in a pulmonary tuberculosis mass screening setting.

"Therefore, our study suggests that clinically appropriate use of AI requires both the development of high-performance AI models for given tasks and considerations about the relevant clinical setting to which that AI will be applied," Dr. Park said.

In the future, the researchers want to expand their work on human-AI collaboration to other abnormalities on chest X-rays and CT images.

More information: Jong Hyuk Lee et al, Effect of Human-AI Interaction on Detection of Malignant Lung Nodules on Chest Radiographs, Radiology (2023). DOI: 10.1148/radiol.222976

Citation: High-accuracy AI improves lung cancer detection (2023, June 27) retrieved 27 June 2023 from https://medicalxpress.com/news/2023-06-high-accuracy-ai-lung-cancer.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Facebook Comments

Schedule29 May 2024