Style encoding for class-specific image generation

Dana Cohen Hochberg, Raja Giryes, Hayit Greenspan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

A fundamental problem in employing deep learning algorithms in the medical field is the lack of labeled data and severe class imbalance. In this work, we present novel ways to enlarge small scale datasets. We introduce an autoencoder framework comprised of an encoder and a StyleGAN generator to embed images into the latent space of StyleGAN. The autoencoder learns the disentangled latent representation of the data allowing for encoding real images to the latent space and manipulating the latent vector in a meaningful manner. We suggest ways to use the encoder along with the unique architecture of the StyleGAN generator to control the synthesized images and thus, create class-specific images that can be used to train and improve existing deep learning algorithms.

Original languageEnglish
Title of host publicationMedical Imaging 2021
Subtitle of host publicationImage Processing
EditorsIvana Isgum, Bennett A. Landman
PublisherSPIE
ISBN (Electronic)9781510640214
DOIs
StatePublished - 2021
EventMedical Imaging 2021: Image Processing - Virtual, Online, United States
Duration: 15 Feb 202119 Feb 2021

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume11596
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2021: Image Processing
Country/TerritoryUnited States
CityVirtual, Online
Period15/02/2119/02/21

Keywords

  • Encoder
  • Generative Adversarial Networks
  • StyleGAN
  • Synthetic data augmentation

Fingerprint

Dive into the research topics of 'Style encoding for class-specific image generation'. Together they form a unique fingerprint.

Cite this