/Awesome-Layout-Generators

An awesome list of layout generation papers

Awesome-Layout-Generators

Layout Generation refers to the multi-modal problem of generating layouts of a flyer, magazine, a UI interface or even a natural image.

This is a niche area, which is increasingly receiving attention from the community. This awesome-listing is an attempt to bring together works in this space. This list is not complete and looking for your PRs to improve it. Thanks!

Preprints

  • LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generation [Paper] [Code]
  • CGB-DM: Content and Graphic Balance Layout Generation with Transformer-based Diffusion Model [Paper]
  • PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLM [Paper] [Code]
  • Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models [Paper]
  • Graphic Design with Large Multimodal Model [Paper]
  • Reason out Your Layout: Evoking the Layout Master from Large Language Models for Text-to-Image Synthesis [Paper]
  • COLE: A Hierarchical Generation Framework for Graphic Design [Paper]
  • UniLayout: Taming Unified Sequence-to-Sequence Transformers for Graphic Layout Generation [Paper]

2024

  • LayoutFlow: Flow Matching for Layout Generation (ECCV 2024) [Paper] [Code]
  • PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generation (ECCV 2024) [Paper] [Code]
  • Layout-Corrector: Alleviating Layout Sticking Phenomenon in Discrete Diffusion Model (ECCV 2024)
  • Dolfin: Diffusion Layout Transformers without Autoencoder (ECCV 2024) [Paper]
  • LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer (ECCV 2024) [Paper] [Code]
  • SciPostLayout: A Dataset for Layout Analysis and Layout Generation of Scientific Posters (BMVC 2024) [Paper] [Dataset] [Code]
  • OpenCOLE: Towards Reproducible Automatic Graphic Design Generation (CVPRW 2024) [Paper] [Code]
  • Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation (CVPR 2024) [Paper] [Code]
  • Desigen: A Pipeline for Controllable Design Template Generation (CVPR 2024) [Paper] [Code]
  • Visual Layout Composer: Image-Vector Dual Diffusion Model for Design Layout Generation (CVPR 2024) [Paper]
  • LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Models (ICLR 2024) [Paper] [Code]
  • Towards Aligned Layout Generation via Diffusion Model with Aesthetic Constraints (ICLR 2024) [Paper]
  • Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locator (AAAI 2024) [Paper] [Code]

2023

  • LayoutGPT: Compositional Visual Planning and Generation with Large Language Models (NeurIPS 2023) [Paper] [Code]
  • LayoutPrompter: Awaken the Design Ability of Large Language Models (NeurIPS 2023) [Paper] [Code]
  • A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptions (ICCV 2023) [Paper] [Code]
  • LayoutDiffusion: Improving Graphic Layout Generation by Discrete Diffusion Probabilistic Models (ICCV 2023) [Paper] [Code]
  • DLT: Conditioned layout generation with Joint Discrete-Continuous Diffusion Layout Transformer (ICCV 2023) [Project page] [Paper] [Code]
  • Diffusion-based Document Layout Generation (ICDAR 2023) [Paper]
  • Unifying Layout Generation with a Decoupled Diffusion Model (CVPR 2023) [Paper]
  • LayoutDM: Discrete Diffusion Model for Controllable Layout Generation (CVPR 2023) [Paper] [Code]
  • LayoutDM: Transformer-based Diffusion Model for Layout Generation (CVPR 2023) [Paper]
  • PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layout (CVPR 2023) [Paper] [Code]
  • Towards Flexible Multi-modal Document Models (CVPR 2023) [Paper] [Code]
  • Machine Learning Model to Evaluate the Appropriateness of Layout for Automatic Generation of Graphic Design Works (IMCOM 2023) [Paper]
  • DensityLayout: Density-conditioned Layout GAN for Visual-textual Presentation Designs (ICIG 2023) [Paper]

2022

  • BLT: Bidirectional Layout Transformer for Controllable Layout Generation (ECCV 2022) [Paper] [Code]
  • Coarse-to-Fine Generative Modeling for Graphic Layouts (AAAI 2022) [Paper]
  • Geometry Aligned Variational Transformer for Image-conditioned Layout Generation (MM 2022) [Paper]
  • Composition-aware Graphic Layout GAN for Visual-textual Presentation Designs (IJCAI 2022) [Paper]

2021

  • Variational Transformer Networks for Layout Generation (CVPR 2021) [Paper]
  • LayoutTransformer: Scene Layout Generation with Conceptual and Spatial Diversity (CVPR 2021) [Paper] [Code]
  • Constrained Graphic Layout Generation via Latent Optimization (MM 2021) [Paper] [Code]
  • LayoutTransformer: Layout Generation and Completion with Self-attention (ICCV 2021) [Paper] [Code]
  • CanvasVAE: Learning to Generate Vector Graphic Documents (ICCV 2021) [Paper] [Code]
  • RUITE: Refining UI Layout Aesthetics Using Transformer Encoder (IUI 2021) [Paper] [Code]

2020

  • Neural Design Network: Graphic Layout Generation with Constraints (ECCV 2020) [Paper]
  • Attribute-conditioned Layout GAN for Automatic Graphic Design (T-VCG 2020) [Paper]
  • READ: Recursive Autoencoders for Document Layout Generation (CVPRW 2020) [Paper]

2019

  • LayoutGAN: Synthesizing Graphic Layouts with Vector-Wireframe Adversarial Networks (ICLR 2019, T-PAMI 2021) [ICLR paper] [T-PAMI Paper]
  • LayoutVAE: Stochastic Scene Layout Generation From a Label Set (ICCV 2019) [Paper]

2015

  • Designscape: Design with interactive layout suggestions (CHI 2015) [Paper]

2014

  • Learning Layouts for Single-Page Graphic Designs (TVCG 2014) [Paper]