A Layer-Based Sequential Framework for Scene Generation with GANs

Mehmet Ozgur Turkoglu, Luuk Spreeuwers, William Thong, Berkay Kicanaoglu

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    25 Citations (Scopus)
    3 Downloads (Pure)

    Abstract

    The visual world we sense, interpret and interact everyday is a complex composition of interleaved physical entities. Therefore, it is a very challenging task to generate vivid scenes of similar complexity using computers. In this work, we present a scene generation framework based on Generative Adversarial Networks (GANs) to sequentially compose a scene, breaking down the underlying problem into smaller ones. Different than the existing approaches, our framework offers an explicit control over the elements of a scene through separate background and foreground generators. Starting with an initially generated background, foreground objects then populate the scene one-by-one in a sequential manner. Via quantitative and qualitative experiments on a subset of the MS-COCO dataset, we show that our proposed framework produces not only more diverse images but also copes better with affine transformations and occlusion artifacts of foreground objects than its counterparts.
    Original languageEnglish
    Title of host publication33rd AAAI Conference on Artificial Intelligence, AAAI 2019, 31st Innovative Applications of Artificial Intelligence Conference, IAAI 2019 and the 9th AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019
    PublisherAAAI Press
    Pages8901-8908
    Number of pages8
    ISBN (Electronic)9781577358091
    Publication statusPublished - Feb 2019
    Event33rd AAAI Conference on Artificial Intelligence, AAAI 2019 - Hilton Hawaiian Village, Honolulu, United States
    Duration: 27 Jan 20191 Feb 2019
    Conference number: 33
    https://aaai.org/Conferences/AAAI-19/

    Publication series

    Name33rd AAAI Conference on Artificial Intelligence, AAAI 2019, 31st Innovative Applications of Artificial Intelligence Conference, IAAI 2019 and the 9th AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019

    Conference

    Conference33rd AAAI Conference on Artificial Intelligence, AAAI 2019
    Abbreviated titleAAAI-19
    Country/TerritoryUnited States
    CityHonolulu
    Period27/01/191/02/19
    Internet address

    Fingerprint

    Dive into the research topics of 'A Layer-Based Sequential Framework for Scene Generation with GANs'. Together they form a unique fingerprint.

    Cite this