Agreement between Five Experts and the Laguna ONhE Automatic Colourimetric Application Interpreting the Glaucomatous Aspect of the Optic Nerve

Abstract

Background: Optic nerve head (ONH) interpretation is a glaucoma screening method which may be influenced by criteria variability. Laguna ONhE software is a low-cost and non-invasive method of ONH analysis. Methods: We analysed the results of the Laguna ONhE application, interpreting 552 ONH images from the ACRIMA database, publicly available on the Internet, and compared them with the opinion of five experts. Diagnostic agreement was investigated using Cohen’s kappa (κ) with 95% confidence. Results: The kappa concordance index obtained with Laguna ONhE and the majority of the experts’ criterion (0.77) was significantly higher compared to that obtained with ACRIMA and the majority of the experts’ criterion (0.61). In 44.7% of the cases there was absolute agreement among the 5 experts and the Laguna ONhE program. Removing borderline cases from the analysis yielded increased diagnostic agreement (0.81). The area under the receiver operating characteristic (AUROC) of the Laguna ONhE program (0.953, p < 0.001) was not significantly different than AUROC of the majority of the experts’ criterion (0.925, p < 0.001), p = 0.052. Individually obtained expert’s AUROCs were significantly lower (0.636 to 0.913; p < 0.01). Conclusions: Laguna ONhE’s agreement with the experts is high, particularly where the diagnosis may be more obvious by the appearance of the ONH.