Git Product home page Git Product logo

awesome-image-inpainting-methods's Introduction

Awesome-Image-Inpainting-Methods

Awesome Maintenance PR's Welcome Survey Paper visitors

image inpainting

Papers

🔥 Text-Guided Image Inpainting

  • Year 2024
    • ICLR
    • arXiv
      • Outline-Guided Object Inpainting with Diffusion Models [Paper]
      • ATask is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpainting [Paper][Code] [[Project]]
      • DesignEdit: Multi-Layered Latent Decomposition and Fusion for Unified & Accurate Image Editing [Paper] [Code] [Project]
      • BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion [Paper] [Code] [Project] [Demo] [Video]
  • Year 2023
    • CVPR
      • NÜWA-LIP: Language-guided Image Inpainting with Defect-free VQGAN [Paper] [Code]
      • Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting [Paper]
      • SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model [Paper]
      • Paint by Example: Exemplar-based Image Editing with Diffusion Models [Paper] [Code] [Demo]
    • CVPRW
      • Scene Graph Driven Text-Prompt Generation for Image Inpainting [Paper]
    • ACM MM
      • Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model [Paper] [Code]
    • SIGGRAPH
    • WACV
      • An Unified Framework for Language Guided Image Completion [Paper]
      • Interactive Image Manipulation with Complex Text Instructions [Paper]
  • Year 2022
    • CVPR
      • Blended Diffusion for Text-driven Editing of Natural Images [Paper] [Code]
  • Year 2021
    • CVPRW
      • Grounded, Controllable and Debiased Image Completion With Lexical Semantics [Paper]
    • ACM MM
      • Adversarial Learning with Mask Reconstruction for Text-Guided Image Inpainting [Paper]
  • Year 2020
    • ACM MM
      • MMFL: Multimodal Fusion Learning for Text-Guided Image Inpainting [Paper] [Code]
      • Text-Guided Neural Image Inpainting [Paper] [Code]
      • Text-Guided Image Inpainting [Paper]

<🎯Back to Top>

Vanilla Image Inpainting

  • Year 2024
    • CVPR
      • ⚠️ Don't Look into the Dark: Latent Codes for Pluralistic Image Inpainting [Paper]
      • ⚠️ Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpainting [Paper]
    • WACV
      • Efficient Layout-Guided Image Inpainting for Mobile Use [Paper]
    • AAAI
      • Text Image Inpainting via Global Structure-Guided Diffusion Models [Paper] [Code]
      • ⚠️ SyFormer: Structure-Guided Synergism Transformer for Large-Portion Image Inpainting [Paper]
      • ⚠️ Large Occluded Human Image Completion via Image-Prior Cooperating [Paper]
    • ICLR
      • Image Inpainting via Tractable Steering of Diffusion Models [Paper]
      • Image Inpainting via Iteratively Decoupled Probabilistic Modeling [Paper] [Code]
    • TMM
      • Mutual Dual-Task Generator With Adaptive Attention Fusion for Image Inpainting [Paper]
    • TCSVT
      • Transformer-Based Image Inpainting Detection via Label Decoupling and Constrained Adversarial Training [Paper]
    • arXiv
      • HINT: High-quality INPainting Transformer with Mask-Aware Encoding and Enhanced Attention [Paper]
      • Rethinking Referring Object Removal [Paper]

<🎯Back to Top>

  • Year 2023
    • CVPRW
      • Image Inpainting with Hypergraphs for Resolution Improvement in Scanning Acoustic Microscopy [Paper]
      • Internal Diverse Image Completion [Paper] [Code]
    • ICCVW
      • TransInpaint: Transformer-based Image Inpainting with Context Adaptation [Paper]
    • AAAI
      • CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Querying [Paper] [Code]
      • Generative Image Inpainting with Segmentation Confusion Adversarial Training and Contrastive Learning [Paper] [Code]
    • WACV
      • Keys to Better Image Inpainting: Structure and Texture Go Hand in Hand [Paper] [Code]
      • GeoFill: Reference-Based Image Inpainting with Better Geometric Understanding [Paper]
      • Image Completion with Heterogeneously Filtered Spectral Hints [Paper] [Code]
    • TMM
      • Learning Adaptive Patch Generators for Mask-Robust Image Inpainting [Paper]
      • W-Net: Structure and Texture Interaction for Image Inpainting [Paper] [Code]
    • TIP
      • Progressive Contextual Aggregation Empowered by Pixel-Wise Confidence Scoring for Image Inpainting [Paper]
      • MagConv: Mask-Guided Convolution for Image Inpainting [Paper]
      • Context Adaptive Network for Image Inpainting [Paper]
    • TPAMI
      • Partial Convolution for Padding, Inpainting, and Image Synthesis [Paper] [Code]
    • TCSVT
      • Deep Image Inpainting With Enhanced Normalization and Contextual Attention [Paper]

<🎯Back to Top>

  • Year 2022
    • CVPR
      • MISF: Multi-level Interactive Siamese Filtering for High-Fidelity Image Inpainting [Paper] [Code]
      • MAT: Mask-Aware Transformer for Large Hole Image Inpainting [Paper] [Code]
      • Reduce Information Loss in Transformers for Pluralistic Image Inpainting [Paper] [Code]
      • Dual-path Image Inpainting with Auxiliary GAN Inversion [Paper]
      • RePaint: Inpainting using Denoising Diffusion Probabilistic Models [Paper] [Code]
      • TFill: Bridging Global Context Interactions for High-Fidelity Image Completion [Paper] [Code] [Project] [Video]
    • CVPRW
      • Zoom-to-Inpaint: Image Inpainting with High-Frequency Details [Paper] [Code]
      • Boundary-aware Image Inpainting with Multiple Auxiliary Cues [Paper] [Code]
      • Comparison of CoModGANs, LaMa and GLIDE for Art Inpainting Completing M.C Escher's Print Gallery [Paper]
      • Image Multi-Inpainting via Progressive Generative Adversarial Networks [Paper]
      • NTIRE 2022 Image Inpainting Challenge: Report [Paper] [Code]
      • GLaMa: Joint Spatial and Frequency Loss for General Image Inpainting [Paper]
      • PersonGONE: Image Inpainting for Automated Checkout Solution [Paper] [Code]
    • ECCV
      • MAE-FAR: Learning Prior Feature and Attention Enhanced Image Inpainting [Paper] [Code]
      • InvertFill: High-Fidelity Image Inpainting with GAN Inversion [Paper] [Code]
      • CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training [Paper] [Code]
      • Unbiased Multi-Modality Guidance for Image Inpainting [Paper] [Code]
      • Inpainting at Modern Camera Resolution by Guided PatchMatch with Auto-Curation [Paper] [Code]
      • Hourglass Attention Network for Image Inpainting [Paper] [Code]
      • Diverse Image Inpainting with Normalizing Flow [Paper]
      • Perceptual Artifacts Localization for Inpainting [Paper] [Code]
      • Iterative Geometry-Aware Cross Guidance Network for Stereo Image Inpainting [Paper]
    • ACM MM
      • Delving Globally into Texture and Structure for Image Inpainting [Paper] [Code]
      • Atrous Pyramid Transformer with Spectral Convolution for Image Inpainting [Paper]
      • Deep Multi-Resolution Mutual Learning for Image Inpainting [Paper]
      • T-former: An Efficient Transformer for Image Inpainting [Paper] [Code]
    • WACV
      • LaMa: Resolution-robust Large Mask Inpainting with Fourier Convolutions [Paper] [Code]
    • NeurIPS
      • Cross-Image Context for Single Image Inpainting [Paper]
    • TMM
      • Deep Generative Model for Image Inpainting With Local Binary Pattern Learning and Spatial Attention [Paper] [Code]
    • TIP
      • Image Inpainting With Local and Global Refinement [Paper]
      • Pseudo Decoder Guided Light-Weight Architecture for Image Inpainting [Paper]
    • TPAMI
      • Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation [Paper] [Code] [Video]
    • TCSVT
      • Dual-Pyramidal Image Inpainting With Dynamic Normalization [Paper]

<🎯Back to Top>

  • Year 2021
    • CVPR
      • TransFill: Reference-Guided Image Inpainting by Merging Multiple Color and Spatial Transformations [Paper] [Code]
      • Image Inpainting With External-Internal Learning and Monochromic Bottleneck [Paper] [Code]
      • Image Inpainting Guided by Coherence Priors of Semantics and Textures [Paper]
      • PD-GAN: Probabilistic Diverse GAN for Image Inpainting [Paper] [Code]
      • Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE [Paper] [Code]
    • ICCV
      • Distillation-guided Image Inpainting [Paper]
      • WaveFill: A Wavelet-based Generation Network for Image Inpainting [Paper] [Code]
      • CR-Fill: Generative Image Inpainting with Auxiliary Contextual Reconstruction [Paper] [Code]
      • Parallel Multi-Resolution Fusion Network for Image Inpainting [Paper]
      • ICT: High-Fidelity Pluralistic Image Completion with Transformers [Paper] [Code] [Project]
    • IJCAI
      • Context-Aware Image Inpainting with Learned Semantic Priors [Paper] [Code]
    • ACM MM
      • BAT-Fill: Diverse Image Inpainting with Bidirectional and Autoregressive Transformers [Paper] [Code]
      • JPGNet: Joint Predictive Filtering and Generative Network for Image Inpainting [Paper] [Code]
      • Learning Contextual Transformer Network for Image Inpainting [Paper]
      • GCM-Net: Towards Effective Global Context Modeling for Image Inpainting [Paper] [Code]
      • An Adaptive Iterative Inpainting Method with More Information Exploration [Paper]
      • Large Scale Image Completion via Co-Modulated Generative Adversarial Networks [[Paper]](Large Scale Image Completion via Co-Modulated Generative Adversarial Networks) [Code]
    • WACV
      • R-MNet: A Perceptual Adversarial Network for Image Inpainting [Paper] [Code]
      • Multi-Level Generative Chaotic Recurrent Network for Image Inpainting [Paper]
      • Hyperrealistic Image Inpainting with Hypergraphs [Paper] [Code]
    • TIP
      • Dynamic Selection Network for Image Inpainting [Paper] [Code]
      • Thanka Mural Inpainting Based on Multi-Scale Adaptive Partial Convolution and Stroke-Like Mask [Paper]
      • Image Inpainting by End-to-End Cascaded Refinement With Mask Awareness [Paper] [Code]
      • Texture Memory-Augmented Deep Patch-Based Image Inpainting [Paper]
    • TCSVT
      • Reference-Guided Landmark Image Inpainting With Deep Feature Matching [Paper] [Project]
      • Generative Memory-Guided Semantic Reasoning Model for Image Inpainting [Paper]

<🎯Back to Top>

  • Year 2020
    • CVPR
      • UCTGAN: Diverse Image Inpainting Based on Unsupervised Cross-Space Translation [Paper]
      • Contextual Residual Aggregation for Ultra High-Resolution Image Inpainting [Paper] [Code]
      • RFR-Net: Recurrent Feature Reasoning for Image Inpainting [Paper] [Code]
      • Prior Guided GAN Based Semantic Inpainting [Paper]
      • Semantic Image Manipulation Using Scene Graph [Paper] [Code]
    • ECCV
      • MEDFE: Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations [Paper] [Code]
      • High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling [Paper]
      • Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenes [Paper]
      • Deep Generative Prior: Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation [Paper] [Code] [Video]
    • AAAI
      • Learning to Incorporate Structure Knowledge for Image Inpainting [Paper] [Code]
      • Region Normalization for Image Inpainting [Paper] [Code]
      • The Missing Data Encoder: Cross-Channel Image Completion with Hide-and-Seek Adversarial Network [Paper] [Code]
    • ACM MM
      • Image Inpainting Based on Multi-frequency Probabilistic Inference Model [Paper]

<🎯Back to Top>

  • Year 2019
    • CVPR
      • Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting [Paper] [Code]
      • Foreground-Aware Image Inpainting [Paper]
      • PEPSI: Fast Image Inpainting With Parallel Decoding Network [Paper] [Code]
      • Pluralistic Image Completion [Paper] [Code]
    • ICCV
      • StructureFlow: Image Inpainting via Structure-Aware Appearance Flow [Paper] [Code]
      • Coherent Semantic Attention for Image Inpainting [Paper] [Code]
      • LBAM: Image Inpainting With Learnable Bidirectional Attention Maps [Paper] [Code]
    • ICCVW
      • Deep Hyperspectral Prior: Single-Image Denoising, Inpainting, Super-Resolution. [Paper] [Code]
    • IJCAI
      • Generative Image Inpainting with Submanifold Alignment [Paper]
      • Coarse-to-Fine Image Inpainting via Region-wise Convolutions and Non-Local Correlation [Paper]
      • MUSICAL: Multi-Scale Image Contextual Attention Learning for Inpainting [Paper] [Code]
      • Single-shot Semantic Image Inpainting with Densely Connected Generative Networks [Paper]
      • GAIN: Gradient Augmented Inpainting Network for Irregular Holes [Paper]
      • Progressive Image Inpainting with Full-Resolution Residual Network [Paper] [Code]
      • Deep Fusion Network for Image Completion [Paper] [Code]

<🎯Back to Top>

  • Year 2018
    • CVPR
      • DeepFill-v1: Generative Image Inpainting With Contextual Attention [Paper] [Code] [Video]
      • Disentangling Structure and Aesthetics for Style-Aware Image Completion [Paper]
    • ECCV
      • Contextual-based Image Inpainting: Infer, Match, and Translate [Paper]
      • Shift-Net: Image Inpainting via Deep Feature Rearrangement [Paper] [Code]
      • Image Inpainting for Irregular Holes Using Partial Convolutions [Paper] [Code] [Video] [Demo]
    • ACM MM
      • Semantic Image Inpainting with Progressive Generative Networks [Paper] [Code]
    • NeurIPS
      • Image Inpainting via Generative Multi-column Convolutional Neural Networks [Paper] [Code]
    • Photo Realistic Image Completion via Dense Correspondence [Paper]
  • Year 2017
    • CVPR
      • High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis [Paper] [Code]
      • Semantic Image Inpainting with Deep Generative Models [Paper] [Code]
      • Structural inpainting [Paper]

<🎯Back to Top>

  • Year 2016
    • CVPR
      • Context Encoders: Feature Learning by Inpainting [Paper] [Code]

<🎯Back to Top>

Blind Image Inpainting

  • Year 2023
    • CVPRW
      • Blind Image Inpainting via Omni-dimensional Gated Attention and Wavelet Queries [Paper] [Code]
    • TMM
      • FT-TDR: Frequency-Guided Transformer and Top-Down Refinement Network for Blind Face Inpainting [Paper]
    • TPAMI
      • Self-Prior Guided Pixel Adversarial Networks for Blind Image Inpainting [Paper]
  • Year 2022
    • ACM MM
      • TransCNN-HAE: Transformer-CNN Hybrid AutoEncoder for Blind Image Inpainting [Paper]
    • IPTA
      • ARIN: Adaptive Resampling and Instance Normalization for Robust Blind Inpainting of Dunhuang Cave Paintings [Paper]
  • Year 2020

<🎯Back to Top>

Edge-Based Image Inpainting

  • Year 2023
    • TPAMI
      • ZITS++: Image Inpainting by Improving the Incremental Transformer on Structural Priors [Paper] [Code] [Project]
  • Year 2022
    • CVPR
      • ZITS: Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding [Paper] [Code] [Project]
  • Year 2021
    • ICCV
      • Learning a Sketch Tensor Space for Image Inpainting of Man-made Scenes [Paper]
      • CTSDG: Image Inpainting via Conditional Texture and Structure Dual Generation [Paper] [Code]
    • TCSVT
  • Year 2019
    • ICCV
    • ICCVW
      • EdgeConnect: Structure Guided Image Inpainting using Edge Prediction [Paper] [Code]

<🎯Back to Top>

Sketch-Guided Image Inpainting

  • Year 2024
    • TMM
  • Year 2023
    • ACM MM
      • Draw2Edit: Mask-Free Sketch-Guided Image Manipulation [Paper] [Code]
  • Year 2022
  • Year 2021
    • CVPR
      • DeFLOCNet: Deep Image Editing via Flexible Low-Level Controls [Paper] [Code]
  • Year 2020
    • ECCV
      • Deep Plastic Surgery: Robust and Controllable Image Editing with Human-Drawn Sketches [Paper] [Code] [Project]
  • Year 2019

<🎯Back to Top>

Conventional Methods

  • Year 2024
    • arXiv
      • HySim: An Efficient Hybrid Similarity Measure for Patch Matching in Image Inpainting [Paper]
  • Year 2020
    • TIP
      • Image Inpainting Using Nonlocal Texture Matching and Nonlinear Filtering [Paper]
      • Truncated Low-Rank and Total p Variation Constrained Color Image Completion and its Moreau Approximation Algorithm [Paper]
  • Year 2019
    • Multiple Pyramids Based Image Inpainting Using Local Patch Statistics and Steering Kernel Feature [Paper]
  • Year 2018
    • TIP
      • A Group-Based Image Inpainting Using Patch Refinement in MRF Framework [Paper]
  • Year 2016
    • CVPR
      • Multiview Image Completion with Space Structure Propagation [Paper]
    • TIP
      • Image Inpainting Through Metric Labeling via Guided Patch Mixing [Paper]
  • Year 2011
    • ICIG
      • Structure-Aware Image Completion with Texture Propagation [Paper]
  • Year 2005
    • TIP
      • Edge-Based Image Restoration [Paper]
    • SIGGRAPH
      • Image Completion with Structure Propagation [Paper]
  • Year 2004
    • TIP
      • Region Filling and Object Removal by Exemplar-Based Image Inpainting [Paper]
  • Year 2000
    • SIGGRAPH

<🎯Back to Top>

Survey Papers

  • [IJCV 2024] Deep Learning-based Image and Video Inpainting: A Survey [Paper]
  • [Pattern Recognit. 2023] Deep Learning for Image Inpainting: A Survey [Paper]

<🎯Back to Top>

Datasets

  • Paris StreetView: Context Encoders: Feature Learning by Inpainting [Paper] [Code] (Since Google's terms of service has forbidden anyone from creating repositories of streetview data, the dataset is currently not available.)
  • Places: A 10 Million Image Database for Scene Recognition [Paper] [Dataset]
  • ImageNet: A Large-Scale Hierarchical Image Database [Paper] [Dataset]
  • CelebA-HQ: Progressive Growing of GANs for Improved Quality, Stability, and Variation [Paper] [Dataset]
  • FFHQ: A Style-Based Generator Architecture for Generative Adversarial Networks [Paper] [Dataset]

<🎯Back to Top>

Q&A

  • Q: The conference sequence of this paper list?
    • This paper list is organized according to the following sequence:
      • Conferences
        • CVPR
        • CVPRW
        • ICCV
        • ICCVW
        • ECCV
        • AAAI
        • IJCAI
        • WACV
        • NeurIPS
        • ICLR
        • ACM MM
        • SIGGRAPH
        • IPTA
      • Journals
        • TMM
        • TIP
        • TPAMI
        • TCSVT
      • arXiv

<🎯Back to Top>

awesome-image-inpainting-methods's People

Contributors

chengyuann avatar

Stargazers

Scott avatar Nemo avatar  avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.