Structured Knowledge Graphs for Classifying Unseen Patterns in Radiographs

Chinmay Prabhakar, Anjany Sekuboyina, Hongwei Bran Li, Johannes C. Paetzold, Suprosanna Shit, Tamaz Amiranashvili, Jens Kleesiek, Bjoern Menze
Proceedings of the First International Workshop on Geometric Deep Learning in Medical Image Analysis, PMLR 194:45-60, 2022.

Abstract

The presence of annotated datasets is crucial to the performance of modern machine learning algorithms. However, obtaining richly annotated datasets is not always possible, especially for novel or rare diseases. This becomes especially challenging in the realm of multi-label classification of chest radiographs, due to the presence of numerous unknown disease types and the limited information inherent to x-ray images. Ideally, we would like to develop models that can reliably label such unseen patterns (classes). In this work, we present a knowledge graph-based approach to predict such novel, unseen classes. Our method directly injects the semantic relationships between seen and unseen disease classes. Specifically, we propose a principled approach to parsing and processing a knowledge graph conditioned on the given task. We show that our method matches the labeling performance of the state-of-the-art while outperforming it on unseen classes by a substantial \textbf{2}% gain on chest X-ray classification. Crucially, we demonstrate that embedding disease-specific knowledge as a graph provides inherent explainability. (The code is available at \url{https://github.com/chinmay5/ml-cxr-gzsl-kg})

Cite this Paper

BibTeX
@InProceedings{pmlr-v194-prabhakar22a, title = {Structured Knowledge Graphs for Classifying Unseen Patterns in Radiographs}, author = {Prabhakar, Chinmay and Sekuboyina, Anjany and Li, Hongwei Bran and Paetzold, Johannes C. and Shit, Suprosanna and Amiranashvili, Tamaz and Kleesiek, Jens and Menze, Bjoern}, booktitle = {Proceedings of the First International Workshop on Geometric Deep Learning in Medical Image Analysis}, pages = {45--60}, year = {2022}, editor = {Bekkers, Erik and Wolterink, Jelmer M. and Aviles-Rivero, Angelica}, volume = {194}, series = {Proceedings of Machine Learning Research}, month = {18 Nov}, publisher = {PMLR}, pdf = {https://proceedings.mlr.press/v194/prabhakar22a/prabhakar22a.pdf}, url = {https://proceedings.mlr.press/v194/prabhakar22a.html}, abstract = {The presence of annotated datasets is crucial to the performance of modern machine learning algorithms. However, obtaining richly annotated datasets is not always possible, especially for novel or rare diseases. This becomes especially challenging in the realm of multi-label classification of chest radiographs, due to the presence of numerous unknown disease types and the limited information inherent to x-ray images. Ideally, we would like to develop models that can reliably label such unseen patterns (classes). In this work, we present a knowledge graph-based approach to predict such novel, unseen classes. Our method directly injects the semantic relationships between seen and unseen disease classes. Specifically, we propose a principled approach to parsing and processing a knowledge graph conditioned on the given task. We show that our method matches the labeling performance of the state-of-the-art while outperforming it on unseen classes by a substantial \textbf{2}% gain on chest X-ray classification. Crucially, we demonstrate that embedding disease-specific knowledge as a graph provides inherent explainability. (The code is available at \url{https://github.com/chinmay5/ml-cxr-gzsl-kg})} }
Endnote
%0 Conference Paper %T Structured Knowledge Graphs for Classifying Unseen Patterns in Radiographs %A Chinmay Prabhakar %A Anjany Sekuboyina %A Hongwei Bran Li %A Johannes C. Paetzold %A Suprosanna Shit %A Tamaz Amiranashvili %A Jens Kleesiek %A Bjoern Menze %B Proceedings of the First International Workshop on Geometric Deep Learning in Medical Image Analysis %C Proceedings of Machine Learning Research %D 2022 %E Erik Bekkers %E Jelmer M. Wolterink %E Angelica Aviles-Rivero %F pmlr-v194-prabhakar22a %I PMLR %P 45--60 %U https://proceedings.mlr.press/v194/prabhakar22a.html %V 194 %X The presence of annotated datasets is crucial to the performance of modern machine learning algorithms. However, obtaining richly annotated datasets is not always possible, especially for novel or rare diseases. This becomes especially challenging in the realm of multi-label classification of chest radiographs, due to the presence of numerous unknown disease types and the limited information inherent to x-ray images. Ideally, we would like to develop models that can reliably label such unseen patterns (classes). In this work, we present a knowledge graph-based approach to predict such novel, unseen classes. Our method directly injects the semantic relationships between seen and unseen disease classes. Specifically, we propose a principled approach to parsing and processing a knowledge graph conditioned on the given task. We show that our method matches the labeling performance of the state-of-the-art while outperforming it on unseen classes by a substantial \textbf{2}% gain on chest X-ray classification. Crucially, we demonstrate that embedding disease-specific knowledge as a graph provides inherent explainability. (The code is available at \url{https://github.com/chinmay5/ml-cxr-gzsl-kg})
APA
Prabhakar, C., Sekuboyina, A., Li, H.B., Paetzold, J.C., Shit, S., Amiranashvili, T., Kleesiek, J. & Menze, B.. (2022). Structured Knowledge Graphs for Classifying Unseen Patterns in Radiographs. Proceedings of the First International Workshop on Geometric Deep Learning in Medical Image Analysis, in Proceedings of Machine Learning Research 194:45-60 Available from https://proceedings.mlr.press/v194/prabhakar22a.html.

Related Material