CAFLOW: Conditional autoregressive flows

Georgios Batzolis*, Marcello Carioni, Christian Etmann, Soroosh Afyouni, Zoe Kourtzi, Carola Bibiane Schönlieb

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

5 Downloads (Pure)

Abstract

We introduce CAFLOW, a new diverse image-to-image translation model that simultaneously leverages the power of autoregressive modeling and the modeling efficiency of conditional normalizing flows. We transform the conditioning image into a sequence of latent encodings using a multiscale normalizing flow and repeat the process for the conditioned image. We model the conditional distribution of the latent encodings by modeling the autoregressive distributions with an efficient multi-scale normalizing flow, where each conditioning factor affects image synthesis at its respective resolution scale. Our proposed framework performs well on a range of image-to-image translation tasks. It outperforms former designs of conditional flows because of its expressive autoregressive structure.

Original languageEnglish
Pages (from-to)553-583
Number of pages31
JournalFoundations of Data Science
Volume6
Issue number4
Early online dateJun 2024
DOIs
Publication statusE-pub ahead of print/First online - Jun 2024

Keywords

  • autoregressive modeling
  • conditional likelihood estimation
  • conditional normalizing flows
  • Generative modeling
  • image-to-image translation

Fingerprint

Dive into the research topics of 'CAFLOW: Conditional autoregressive flows'. Together they form a unique fingerprint.
  • Caflow: Conditional Autoregressive Flows

    Batzolis, G., Carioni, M., Etmann, C., Afyouni, S., Kourtzi, Z. & Schönlieb, C. B., 4 Jun 2021, ArXiv.org, 26 p.

    Research output: Working paperPreprintAcademic

    File
    43 Downloads (Pure)

Cite this