Specifying object attributes and relations in interactive scene generation

Oron Ashual; Lior Wolf

doi:10.1109/ICCV.2019.00466

Specifying object attributes and relations in interactive scene generation

Oron Ashual, Lior Wolf

School of Computer Sciences

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

We introduce a method for the generation of images from an input scene graph. The method separates between a layout embedding and an appearance embedding. The dual embedding leads to generated images that better match the scene graph, have higher visual quality, and support more complex scene graphs. In addition, the embedding scheme supports multiple and diverse output images per scene graph, which can be further controlled by the user. We demonstrate two modes of per-object control: (i) importing elements from other images, and (ii) navigation in the object space by selecting an appearance archetype. Our code is publicly available at https://www.github.com/ashual/scene-generation.

Original language	English
Title of host publication	Proceedings - 2019 International Conference on Computer Vision, ICCV 2019
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	4560-4568
Number of pages	9
ISBN (Electronic)	9781728148038
DOIs	https://doi.org/10.1109/ICCV.2019.00466
State	Published - Oct 2019
Event	17th IEEE/CVF International Conference on Computer Vision, ICCV 2019 - Seoul, Korea, Republic of Duration: 27 Oct 2019 → 2 Nov 2019

Publication series

Name	Proceedings of the IEEE International Conference on Computer Vision
Volume	2019-October
ISSN (Print)	1550-5499

Conference

Conference	17th IEEE/CVF International Conference on Computer Vision, ICCV 2019
Country/Territory	Korea, Republic of
City	Seoul
Period	27/10/19 → 2/11/19

Access to Document

10.1109/ICCV.2019.00466

Cite this

Ashual, O., & Wolf, L. (2019). Specifying object attributes and relations in interactive scene generation. In Proceedings - 2019 International Conference on Computer Vision, ICCV 2019 (pp. 4560-4568). [9010748] (Proceedings of the IEEE International Conference on Computer Vision; Vol. 2019-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCV.2019.00466

@inproceedings{7e155f8aa39c49a1a09acbf1276fb01a,

title = "Specifying object attributes and relations in interactive scene generation",

abstract = "We introduce a method for the generation of images from an input scene graph. The method separates between a layout embedding and an appearance embedding. The dual embedding leads to generated images that better match the scene graph, have higher visual quality, and support more complex scene graphs. In addition, the embedding scheme supports multiple and diverse output images per scene graph, which can be further controlled by the user. We demonstrate two modes of per-object control: (i) importing elements from other images, and (ii) navigation in the object space by selecting an appearance archetype. Our code is publicly available at https://www.github.com/ashual/scene-generation.",

author = "Oron Ashual and Lior Wolf",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; null ; Conference date: 27-10-2019 Through 02-11-2019",

year = "2019",

month = oct,

doi = "10.1109/ICCV.2019.00466",

language = "אנגלית",

series = "Proceedings of the IEEE International Conference on Computer Vision",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "4560--4568",

booktitle = "Proceedings - 2019 International Conference on Computer Vision, ICCV 2019",

address = "ארצות הברית",

}

Ashual, O & Wolf, L 2019, Specifying object attributes and relations in interactive scene generation. in Proceedings - 2019 International Conference on Computer Vision, ICCV 2019., 9010748, Proceedings of the IEEE International Conference on Computer Vision, vol. 2019-October, Institute of Electrical and Electronics Engineers Inc., pp. 4560-4568, 17th IEEE/CVF International Conference on Computer Vision, ICCV 2019, Seoul, Korea, Republic of, 27/10/19. https://doi.org/10.1109/ICCV.2019.00466

Specifying object attributes and relations in interactive scene generation. / Ashual, Oron; Wolf, Lior.

Proceedings - 2019 International Conference on Computer Vision, ICCV 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 4560-4568 9010748 (Proceedings of the IEEE International Conference on Computer Vision; Vol. 2019-October).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Specifying object attributes and relations in interactive scene generation

AU - Ashual, Oron

AU - Wolf, Lior

PY - 2019/10

Y1 - 2019/10

N2 - We introduce a method for the generation of images from an input scene graph. The method separates between a layout embedding and an appearance embedding. The dual embedding leads to generated images that better match the scene graph, have higher visual quality, and support more complex scene graphs. In addition, the embedding scheme supports multiple and diverse output images per scene graph, which can be further controlled by the user. We demonstrate two modes of per-object control: (i) importing elements from other images, and (ii) navigation in the object space by selecting an appearance archetype. Our code is publicly available at https://www.github.com/ashual/scene-generation.

AB - We introduce a method for the generation of images from an input scene graph. The method separates between a layout embedding and an appearance embedding. The dual embedding leads to generated images that better match the scene graph, have higher visual quality, and support more complex scene graphs. In addition, the embedding scheme supports multiple and diverse output images per scene graph, which can be further controlled by the user. We demonstrate two modes of per-object control: (i) importing elements from other images, and (ii) navigation in the object space by selecting an appearance archetype. Our code is publicly available at https://www.github.com/ashual/scene-generation.

UR - http://www.scopus.com/inward/record.url?scp=85081932345&partnerID=8YFLogxK

U2 - 10.1109/ICCV.2019.00466

DO - 10.1109/ICCV.2019.00466

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85081932345

T3 - Proceedings of the IEEE International Conference on Computer Vision

SP - 4560

EP - 4568

BT - Proceedings - 2019 International Conference on Computer Vision, ICCV 2019

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 27 October 2019 through 2 November 2019

ER -

Specifying object attributes and relations in interactive scene generation

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this