TY - JOUR
T1 - Implicit pairs for boosting unpaired image-to-image translation
AU - Ginger, Yiftach
AU - Danon, Dov
AU - Averbuch-Elor, Hadar
AU - Cohen-Or, Daniel
N1 - Publisher Copyright:
© 2020 The Author(s)
PY - 2020/12
Y1 - 2020/12
N2 - In image-to-image translation the goal is to learn a mapping from one image domain to another. In the case of supervised approaches the mapping is learned from paired samples. However, collecting large sets of image pairs is often either prohibitively expensive or not possible. As a result, in recent years more attention has been given to techniques that learn the mapping from unpaired sets. In our work, we show that injecting implicit pairs into unpaired sets strengthens the mapping between the two domains, improves the compatibility of their distributions, and leads to performance boosting of unsupervised techniques by up to 12% across several measurements. The competence of the implicit pairs is further displayed with the use of pseudo-pairs, i.e., paired samples which only approximate a real pair. We demonstrate the effect of the approximated implicit samples on image-to-image translation problems, where such pseudo-pairs may be synthesized in one direction, but not in the other. We further show that pseudo-pairs are significantly more effective as implicit pairs in an unpaired setting, than directly using them explicitly in a paired setting.
AB - In image-to-image translation the goal is to learn a mapping from one image domain to another. In the case of supervised approaches the mapping is learned from paired samples. However, collecting large sets of image pairs is often either prohibitively expensive or not possible. As a result, in recent years more attention has been given to techniques that learn the mapping from unpaired sets. In our work, we show that injecting implicit pairs into unpaired sets strengthens the mapping between the two domains, improves the compatibility of their distributions, and leads to performance boosting of unsupervised techniques by up to 12% across several measurements. The competence of the implicit pairs is further displayed with the use of pseudo-pairs, i.e., paired samples which only approximate a real pair. We demonstrate the effect of the approximated implicit samples on image-to-image translation problems, where such pseudo-pairs may be synthesized in one direction, but not in the other. We further show that pseudo-pairs are significantly more effective as implicit pairs in an unpaired setting, than directly using them explicitly in a paired setting.
KW - Data augmentation
KW - Generative adversarial networks
KW - Image-to-image translation
KW - Synthetic samples
UR - http://www.scopus.com/inward/record.url?scp=85096699194&partnerID=8YFLogxK
U2 - 10.1016/j.visinf.2020.10.001
DO - 10.1016/j.visinf.2020.10.001
M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???
AN - SCOPUS:85096699194
SN - 2543-2656
VL - 4
SP - 50
EP - 58
JO - Visual Informatics
JF - Visual Informatics
IS - 4
ER -