TY - GEN
T1 - SCENE GRAPH TO IMAGE GENERATION WITH CONTEXTUALIZED OBJECT LAYOUT REFINEMENT
AU - Ivgi, Maor
AU - Benny, Yaniv
AU - Ben-David, Avichai
AU - Berant, Jonathan
AU - Wolf, Lior
N1 - Publisher Copyright:
© 2021 IEEE
PY - 2021
Y1 - 2021
N2 - Generating images from scene graphs is a challenging task that attracted substantial interest recently. Prior works have approached this task by generating an intermediate layout description of the target image. However, the representation of each object in the layout was generated independently, which resulted in high overlap, low coverage, and an overall blurry layout. We propose a novel method that alleviates these issues by generating the entire layout description gradually to improve inter-object dependency. We empirically show on the COCO-STUFF dataset that our approach improves the quality of both the intermediate layout and the final image. Our approach improves the layout coverage by almost 20 points, and drops object overlap to negligible amounts. Our code is available at github.com/yanivbenny/COLoR.
AB - Generating images from scene graphs is a challenging task that attracted substantial interest recently. Prior works have approached this task by generating an intermediate layout description of the target image. However, the representation of each object in the layout was generated independently, which resulted in high overlap, low coverage, and an overall blurry layout. We propose a novel method that alleviates these issues by generating the entire layout description gradually to improve inter-object dependency. We empirically show on the COCO-STUFF dataset that our approach improves the quality of both the intermediate layout and the final image. Our approach improves the layout coverage by almost 20 points, and drops object overlap to negligible amounts. Our code is available at github.com/yanivbenny/COLoR.
KW - GAN
KW - Image synthesis
KW - Scene graph
UR - http://www.scopus.com/inward/record.url?scp=85125580583&partnerID=8YFLogxK
U2 - 10.1109/ICIP42928.2021.9506651
DO - 10.1109/ICIP42928.2021.9506651
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:85125580583
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 2428
EP - 2432
BT - 2021 IEEE International Conference on Image Processing, ICIP 2021 - Proceedings
PB - IEEE Computer Society
T2 - 2021 IEEE International Conference on Image Processing, ICIP 2021
Y2 - 19 September 2021 through 22 September 2021
ER -