System for pathology categorization and retrieval in chest radiographs

Uri Avni, Hayit Greenspan*, Eli Konen, Michal Sharon, Jacob Goldberger

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


In this paper we present an overview of a system we have been developing for the past several years for efficient image categorization and retrieval in large radiograph archives. The methodology is based on local patch representation of the image content, using a bag of visual words approach and similarity-based categorization with a kernel based SVM classifier. We show an application to pathology-level categorization of chest x-ray data, the most popular examination in radiology. Our study deals with pathology detection and identification of individual pathologies including right and left pleural effusion, enlarged heart and cases of enlarged mediastinum. The input from a radiologist provided a global label for the entire image (healthy/pathology), and the categorization was conducted on the entire image, with no need for segmentation algorithms or any geometrical rules. An automatic diagnostic-level categorization, even on such an elementary level as healthy vs pathological, provides a useful tool for radiologists on this popular and important examination. This is a first step towards similarity-based categorization, which has a major clinical implications for computer-assisted diagnostics.

Original languageEnglish
Title of host publicationMedical Imaging 2011
Subtitle of host publicationComputer-Aided Diagnosis
StatePublished - 2011
EventMedical Imaging 2011: Computer-Aided Diagnosis - Lake Buena Vista, FL, United States
Duration: 15 Feb 201117 Feb 2011

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
ISSN (Print)1605-7422


ConferenceMedical Imaging 2011: Computer-Aided Diagnosis
Country/TerritoryUnited States
CityLake Buena Vista, FL


  • chest radiography
  • image categorization
  • visual words
  • x-ray


Dive into the research topics of 'System for pathology categorization and retrieval in chest radiographs'. Together they form a unique fingerprint.

Cite this