Style encoding for class-specific image generation

Dana Cohen Hochberg, Raja Giryes, Hayit Greenspan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations

Abstract

A fundamental problem in employing deep learning algorithms in the medical field is the lack of labeled data and severe class imbalance. In this work, we present novel ways to enlarge small scale datasets. We introduce an autoencoder framework comprised of an encoder and a StyleGAN generator to embed images into the latent space of StyleGAN. The autoencoder learns the disentangled latent representation of the data allowing for encoding real images to the latent space and manipulating the latent vector in a meaningful manner. We suggest ways to use the encoder along with the unique architecture of the StyleGAN generator to control the synthesized images and thus, create class-specific images that can be used to train and improve existing deep learning algorithms.

Original languageEnglish
Title of host publicationMedical Imaging 2021
Subtitle of host publicationImage Processing
EditorsIvana Isgum, Bennett A. Landman
PublisherSPIE
ISBN (Electronic)9781510640214
DOIs
StatePublished - 2021
EventMedical Imaging 2021: Image Processing - Virtual, Online, United States
Duration: 15 Feb 202119 Feb 2021

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume11596
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2021: Image Processing
Country/TerritoryUnited States
CityVirtual, Online
Period15/02/2119/02/21

Funding

FundersFunder number
Ministry of Science and Technology, Israel

    Keywords

    • Encoder
    • Generative Adversarial Networks
    • StyleGAN
    • Synthetic data augmentation

    Fingerprint

    Dive into the research topics of 'Style encoding for class-specific image generation'. Together they form a unique fingerprint.

    Cite this