A new app which harnesses the power of Artificial Intelligence (AI) to accurately diagnose ear infections, or acute otitis media (AOM) – one of the most common childhood infections.
It is hoped that the use of the tool could help to decrease unnecessary use of antibiotics in young children.
The app has been developed by physician-scientists at UPMC and the University of Pittsburgh, with research published in JAMA Pediatrics.
AOM can be difficult to discern from other ear conditions without intensive training. The new AI tool, which makes a diagnosis by assessing a short video of the eardrum captured by an otoscope connected to a cellphone camera, offers a simple and effective solution that could be more accurate than trained clinicians.
“Acute otitis media is often incorrectly diagnosed,” said senior author Alejandro Hoberman, M.D., professor of pediatrics and director of the Division of General Academic Pediatrics at Pitt’s School of Medicine and president of UPMC Children’s Community Pediatrics.
“Underdiagnosis results in inadequate care and overdiagnosis results in unnecessary antibiotic treatment, which can compromise the effectiveness of currently available antibiotics. Our tool helps get the correct diagnosis and guide the right treatment.”
AOM is often confused with otitis media with effusion, or fluid behind the ear, a condition that generally does not involve bacteria and does not benefit from antimicrobial treatment.
To develop a practical tool to improve accuracy in the diagnosis of AOM, Hoberman and his team started by building and annotating a training library of 1,151 videos of the tympanic membrane from 635 children who visited outpatient UPMC pediatric offices between 2018 and 2023. Two trained experts with extensive experience in AOM research reviewed the videos and made a diagnosis of AOM or not AOM.
“The eardrum, or tympanic membrane, is a thin, flat piece of tissue that stretches across the ear canal,” said Hoberman. “In AOM, the eardrum bulges like a bagel, leaving a central area of depression that resembles a bagel hole. In contrast, in children with otitis media with effusion, no bulging of the tympanic membrane is present.”
The researchers used 921 videos from the training library to teach two different AI models to detect AOM by looking at features of the tympanic membrane, including shape, position, colour and translucency. Then they used the remaining 230 videos to test how the models performed.
Both models were highly accurate, producing sensitivity and specificity values of greater than 93%, meaning that they had low rates of false negatives and false positives. According to Hoberman, previous studies of clinicians have reported diagnostic accuracy of AOM ranging from 30% to 84%, depending on type of health care provider, level of training and age of the children being examined.
“These findings suggest that our tool is more accurate than many clinicians,” said Hoberman. “It could be a gamechanger in primary health care settings to support clinicians in stringently diagnosing AOM and guiding treatment decisions.”
“Another benefit of our tool is that the videos we capture can be stored in a patient’s medical record and shared with other providers,” said Hoberman. “We can also show parents and trainees — medical students and residents — what we see and explain why we are or are not making a diagnosis of ear infection. It is important as a teaching tool and for reassuring parents that their child is receiving appropriate treatment.”
Hoberman hopes that their technology could soon be implemented widely across health care provider offices to enhance accurate diagnosis of AOM and support treatment decisions.
