Git Product home page Git Product logo

polynomial_nets's Introduction

Π-nets: Deep Polynomial Neural Networks

License ArXiv Blogpost

Official implementation of several experiments in the paper "**Π-nets: Deep Polynomial Neural Networks**" (CVPR'20) and its extension (T-PAMI'21; also available here ).

Each folder contains a different experiment. Please follow the instructions in the respective folder on how to run the experiments and reproduce the results. This repository contains implementations in MXNet, PyTorch and Chainer.

Browsing the experiments

The folder structure is the following:

More information on Π-nets

A one-minute pitch of the paper is uploaded here. We describe there what generation results can be obtained even without activation functions between the layers of the generator.

Π-nets do not rely on a single architecture, but enable diverse architectures to be built; the architecture is defined by the form of the resursive formula that constructs it. For instance, we visualize below two different Π-net architectures.

Different architectures enables by Π-nets.

Results

The evaluation in the paper [1] suggests that Π-nets can improve state-of-the-art methods. Below, we visualize results in image generation and errors in mesh representation learning.

Generation results by Π-nets when trained on FFHQ.

The image above shows synthesizes faces. The generator is a Π-net, and more specifically a product of polynomials.

Per vertex reconstruction error on an exemplary human body mesh.

Color coded results of the per vertex reconstruction error on an exemplary human body mesh. From left to right: ground truth mesh, first order SpiralGNN, second, third and fourth order base polynomial in Π-nets. Dark colors depict a larger error; notice that the (upper and lower) limbs have larger error with first order SpiralGNN.

Citing

If you use this code, please cite [1] or (and) [2]:

BibTeX:

@inproceedings{
poly2020,
title={$\Pi-$nets: Deep Polynomial Neural Networks},
author={Chrysos, Grigorios and Moschoglou, Stylianos and Bouritsas, Giorgos and Panagakis, Yannis and Deng, Jiankang and Zafeiriou, Stefanos},
booktitle={Conference on Computer Vision and Pattern Recognition (CVPR)},
pages={7325--7335},
year={2020}
}

BibTeX:

@article{poly2021,
author={Chrysos, Grigorios and Moschoglou, Stylianos and Bouritsas, Giorgos and Deng, Jiankang and Panagakis, Yannis and Zafeiriou, Stefanos},
journal={IEEE Transactions on Pattern Analysis and Machine Intelligence},
title={Deep Polynomial Neural Networks},
volume={44},
number={8},
pages={4021--4034},
year={2021},
doi={10.1109/TPAMI.2021.3058891}}

References

[1](1, 2) Grigorios G. Chrysos, Stylianos Moschoglou, Giorgos Bouritsas, Yannis Panagakis, Jiankang Deng and Stefanos Zafeiriou, Π-nets: Deep Polynomial Neural Networks, Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[2]Grigorios G. Chrysos, Stylianos Moschoglou, Giorgos Bouritsas, Jiankang Deng, Yannis Panagakis and Stefanos Zafeiriou, Deep Polynomial Neural Networks, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021.

polynomial_nets's People

Contributors

grigorisg9gr avatar jiankangdeng avatar mostel avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

polynomial_nets's Issues

Question about Licence

As your Face-recognition implementation is a minor alteration to Arcface (MIT-licenced), we are just wondering do you have any plans of using MIT licence for your modification to Arcface and pre-trained models.

Cheers | Yabahu

image classification code

Hi! I read your paper "Deep Polynomial Neural Networks", and I want to know the polynomial networks architecture you implement on image classification. It seems that there is no the folder about image classification part. Could you please share the code? Thanks.

Running the face recognition module

Hi, i'm new to machine learning

I have a faces database - it is just a directory with faces image which are named as man's name on photo. I need to recognize all people from the database in input image
Can you please tell me how to run face recognition module to complete this task? I only see train.py, but no test.py

Thanks

Getting same embedding for all images

I am trying to get embeddings for some images for face recognition. All those embeddings are same. I have checked that the input data is different before the model.forward call. Doing this through the verification.py file in face_recognition module.

Cannot reproduce results on image_generation_pyotch

Hi, I have tried to reproduce the results of the paper for image generation (CIFAR10).
I launched main.py with the default parameters, just varying the activation_fn param.
I get an IS score of:

  • 5.6 using Activation fn
  • 3.7 with the same model that does not use any activation function.

Do you have any recommendation on the parameters to be used to reproduce, and/or any recommendation if I try to create a PolyNet to classify CIFAR10 images ? I also don't get very good results on this task

Exporting Prodpoly to Onnx

I have found pre-trained mxnet model in this repo with .json and .params files.

I plan to consume prodpoly model for face recognition via opencv, and it has binding for onnx instead of mxnet. Do you mind to export mxnet model to onnx?

I tried this but failed because I have no experience on mxnet.

about training dataset

Hi, the download links inside the website link you provided for downloading the training dataset are not working, could you please provide a training dataset to me? A zip file is fine, thanks a lot!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.