Git Product home page Git Product logo

neural-style-transfer-papers's Introduction

Neural-Style-Transfer-Papers :art:

Selected papers, corresponding codes and pre-trained models in our review paper "Neural Style Transfer: A Review"

(This Paper is under a major revision and the organization below may not be consistent with the original paper. We will release the newest version of the paper ASAP. Any comment is welcomed! Thank you very much!)

Citation

If you find this repository useful for your research, please cite

@article{jing2017neural,
  title={Neural Style Transfer: A Review},
  author={Jing, Yongcheng and Yang, Yezhou and Feng, Zunlei and Ye, Jingwen and Song, Mingli},
  journal={arXiv preprint arXiv:1705.04058},
  year={2017}
}

Pre-trained Models in Our Paper

✅[Coming Soon]

Supplementary Materials

A Taxonomy of Current Methods

1. "Slow" Neural Methods Based On Image Optimization

1.1. Parametric "Slow" Neural Methods with Summary Statistics

✅ [A Neural Algorithm of Artistic Style] [Paper] (First Neural Style Transfer Paper)

❇️ Code:

✅ [Image Style Transfer Using Convolutional Neural Networks] [Paper] (CVPR 2016)

✅ [Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Losses] [Paper] (CVPR 2017)

✅ [Demystifying Neural Style Transfer] [Paper] (Theoretical Explanation) (IJCAI 2017)

❇️ Code:

✅ [Content-Aware Neural Style Transfer] [Paper]

✅ [Towards Deep Style Transfer: A Content-Aware Perspective] [Paper] (BMVC 2016)

1.2. Non-parametric "Slow" Neural Methods with MRFs

✅ [Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis] [Paper] (CVPR 2016)

❇️ Code:

✅ [Neural Doodle_Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artwork] [Paper]

2. "Fast" Neural Methods Based On Model Optimization

2.1. Per-Style-Per-Model "Fast" Neural Methods

✅ [Perceptual Losses for Real-Time Style Transfer and Super-Resolution] [Paper] (ECCV 2016)

❇️ Code:

❇️ Pre-trained Models:

✅ [Texture Networks: Feed-forward Synthesis of Textures and Stylized Images] [Paper] (ICML 2016)

❇️ Code:

✅ [Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesis] [Paper] (CVPR 2017)

❇️ Code:

✅ [Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks] [Paper] (ECCV 2016)

❇️ Code:

✅ [Multimodal Transfer: A Hierarchical Deep Convolutional Neural Network for Fast Artistic Style Transfer] [Paper] (CVPR 2017)

2.2. Multiple-Style-Per-Model "Fast" Neural Methods

✅ [A Learned Representation for Artistic Style] [Paper] (ICLR 2017)

❇️ Code:

✅ [Multi-style Generative Network for Real-time Transfer] [Paper]

❇️ Code:

✅ [StyleBank: An Explicit Representation for Neural Image Style Transfer] [Paper] (CVPR 2017)

✅ [Diversified Texture Synthesis With Feed-Forward Networks] [Paper] (CVPR 2017)

❇️ Code:

2.3. Arbitrary-Style-Per-Model "Fast" Neural Methods

✅ [Fast Patch-based Style Transfer of Arbitrary Style] [Paper]

❇️ Code:

✅ [Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization] [Paper] (ICCV 2017)

❇️ Code:

Slight Modifications of Current Methods

1. Modifications of "Slow" Neural Methods

✅ [Exploring the Neural Algorithm of Artistic Style] [Paper]

✅ [Improving the Neural Algorithm of Artistic Style] [Paper]

✅ [Preserving Color in Neural Artistic Style Transfer] [Paper]

✅ [Controlling Perceptual Factors in Neural Style Transfer] [Paper] (CVPR 2017)

❇️ Code:

2. Modifications of "Fast" Neural Methods

✅ [Instance Normalization:The Missing Ingredient for Fast Stylization] [Paper]

❇️ Code:

✅ [Depth-Preserving Style Transfer] [Paper]

❇️ Code:

✅ [Depth-Aware Neural Style Transfer] (NPAR 2017)

Extensions

✅ [Semantic Style Transfer and Turning Two-Bit Doodles into Fine Artwork] [Paper]

❇️ Code:

✅ [Painting Style Transfer for Head Portraits Using Convolutional Neural Networks] [Paper] (SIGGRAPH 2016)

✅ [Son of Zorn's Lemma Targeted Style Transfer Using Instance-aware Semantic Segmentation] [Paper] (ICASSP 2017)

✅ [Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN] [Paper]

✅ [Artistic Style Transfer for Videos] [Paper] (GCPR 2016)

❇️ Code:

✅ [DeepMovie: Using Optical Flow and Deep Neural Networks to Stylize Movies] [Paper]

✅ [Characterizing and Improving Stability in Neural Style Transfer] [Paper]) (ICCV 2017)

✅ [Coherent Online Video Style Transfer] [Paper] (ICCV 2017) (First end-to-end video style transfer?)

✅ [Real-Time Neural Style Transfer for Videos] [Paper] (CVPR 2017)

✅ [Deep Photo Style Transfer] [Paper] (CVPR 2017)

❇️ Code:

Application

Prisma

Ostagram

❇️ Code:

Deep Forger

Application Papers

✅ [Bringing Impressionism to Life with Neural Style Transfer in Come Swim] [Paper]

✅ [Imaging Novecento. A Mobile App for Automatic Recognition of Artworks and Transfer of Artistic Styles] [Paper]

Blogs

✅ [Caffe2Go][https://code.facebook.com/posts/196146247499076/delivering-real-time-ai-in-the-palm-of-your-hand/]

✅ [Supercharging Style Transfer][https://research.googleblog.com/2016/10/supercharging-style-transfer.html]

✅ [Issue of Layer Chosen Strategy][http://yongchengjing.com/pdf/Issue_layerChosenStrategy_neuralStyleTransfer.pdf]

✅ [Picking an optimizer for Style Transfer][https://blog.slavv.com/picking-an-optimizer-for-style-transfer-86e7b8cba84b]

Exciting New Directions

Character Style Transfer

  • [Awesome Typography: Statistics-based Text Effects Transfer][Paper] (CVPR 2017)

  • [Rewrite: Neural Style Transfer For Chinese Fonts][Project]

Visual Attribute Transfer through Deep Image Analogy[Paper] (SIGGRAPH 2017)

❇️ Code:

Unclassified (To Be Updated Soon)

✅ [Exploring the Structure of a Real-time, Arbitrary Neural Artistic Stylization Network] [Paper]

✅ [Laplacian-Steered Neural Style Transfer] [Paper] (ACM MM 2017)

❇️ Code:

✅ [Incorporating Long-range Consistency in CNN-based Texture Generation] [Paper] (ICLR 2017)

neural-style-transfer-papers's People

Contributors

ycjing avatar zhanghang1989 avatar

Watchers

James Cloos avatar Pengfei Shi avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.