The performance of a new artificial intelligence (AI) algorithm used to assess chest X-rays for the presence of tuberculosis was virtually equivalent to that of radiologists.
In a study published Aug. 3 in Radiology, a team of investigators from South Korea shared the results of how well their algorithm evaluated these scans. Chest X-ray is the go-to scan for detecting and assessing tuberculosis.
Finding an effective and efficient way to analyze these scans quickly is critical, they said. The countries most affected by the disease are also ones that are least likely to have enough providers who are skilled in detection.
To meet this need, the team, led by Seowoo Lee from the Seoul National University Hospital’s radiology department, created an algorithm that could identify active pulmonary tuberculosis on chest X-rays. They used 6,654 scans from patients with active disease and those who had recovered to train their tool. Specifically, 3,327 X-rays came from patients with pulmonary tuberculosis, and 3,182 were from patients with normal chest X-rays.
The algorithm performed well. Not only was it capable of pinpointing the presence of tuberculosis, but it outperformed pulmonologists. Its abilities were also comparable to radiologists, the team said, and it could help with categorizing patients in low-resource areas.
“The network may help radiologically triage patients with active tuberculosis by excluding healed tuberculosis in high-burden countries and may assist in monitoring the activity of mycobacterial diseases that require long-term treatment,” they said.
To reach these results, the team assessed their model’s performance with two datasets. Set 1 included 89 patients and 148 X-rays, and Set 2 was comprised on controlled data from 366 patients and more than 3,700 images.
According to the analysis from two pulmonologists and two thoracic radiologists, the algorithm produced a slightly higher area under the curve for Set 1 than one pulmonologist – 0.83 compared with 0.69, respectively. Performance was similar to that from the radiologists – 0.79 to 0.80. With Set 2, the model’s area under the curve (0.84) was, once again, higher than the pulmonologists (0.71) and comparable to the radiologist (0.79 and 0.80).
Based on these outcomes, the team said, the algorithm has the potential to catch more cases of tuberculosis, bringing a higher level of patient care to infected individuals.
“If a deep learning network can accurately differentiate active tuberculosis from healed tuberculosis on radiographs, then this will provide more efficient triage for testing in limited-resource settings by decreasing unnecessary testing individuals less likely to have active tuberculosis,” they said.
Matt Birnholz, MDPeer