TY - GEN
T1 - IDENTITY AND ATTRIBUTE PRESERVING THUMBNAIL UPSCALING
AU - Gat, Noam
AU - Benaim, Sagie
AU - Wolf, Lior
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - We consider the task of upscaling a low resolution thumbnail image of a person, to a higher resolution image, which preserves the person’s identity and other attributes. Since the thumbnail image is of low resolution, many higher resolution versions exist. Previous approaches produce solutions where the person’s identity is not preserved, or biased solutions, such as predominantly Caucasian faces. We address the existing ambiguity by first augmenting the feature extractor to better capture facial identity, facial attributes (such as smiling or not) and race, and second, use this feature extractor to generate high-resolution images which are identity preserving as well as conditioned on race and facial attributes. Our results indicate an improvement in face similarity recognition and lookalike generation as well as in the ability to generate higher resolution images which preserve an input thumbnail identity and whose race and attributes are maintained.
AB - We consider the task of upscaling a low resolution thumbnail image of a person, to a higher resolution image, which preserves the person’s identity and other attributes. Since the thumbnail image is of low resolution, many higher resolution versions exist. Previous approaches produce solutions where the person’s identity is not preserved, or biased solutions, such as predominantly Caucasian faces. We address the existing ambiguity by first augmenting the feature extractor to better capture facial identity, facial attributes (such as smiling or not) and race, and second, use this feature extractor to generate high-resolution images which are identity preserving as well as conditioned on race and facial attributes. Our results indicate an improvement in face similarity recognition and lookalike generation as well as in the ability to generate higher resolution images which preserve an input thumbnail identity and whose race and attributes are maintained.
KW - Fairness
KW - Generation
KW - Super resolution
UR - http://www.scopus.com/inward/record.url?scp=85125597087&partnerID=8YFLogxK
U2 - 10.1109/ICIP42928.2021.9506290
DO - 10.1109/ICIP42928.2021.9506290
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:85125597087
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 2708
EP - 2712
BT - 2021 IEEE International Conference on Image Processing, ICIP 2021 - Proceedings
PB - IEEE Computer Society
T2 - 2021 IEEE International Conference on Image Processing, ICIP 2021
Y2 - 19 September 2021 through 22 September 2021
ER -