Git Product home page Git Product logo

Comments (9)

aprams avatar aprams commented on July 25, 2024

Did you find a solution to this?

from pytorch-pruning.

nekulkarni avatar nekulkarni commented on July 25, 2024

@aprams Yes I did, had to do multiple changes to make that work. I basically flattened the mobilenetv2 model into a flat model before feeding into this code (dealing with the residual links is the trickiest part in the flattening process). Secondly, I changed prune.py significantly to address batchnorm layers, and depthwise convs. I hope that helps.

from pytorch-pruning.

NCHW avatar NCHW commented on July 25, 2024

@nekulkarni Can you share me your code,please? I need to prune the mobilenetv2 for the school project but I am the beginner for python.

from pytorch-pruning.

viviov avatar viviov commented on July 25, 2024

@aprams Yes I did, had to do multiple changes to make that work. I basically flattened the mobilenetv2 model into a flat model before feeding into this code (dealing with the residual links is the trickiest part in the flattening process). Secondly, I changed prune.py significantly to address batchnorm layers, and depthwise convs. I hope that helps.

Thanks for sharing, could you please share more about how to deal with batchnorm layers? Thanks so much.

from pytorch-pruning.

CF2220160244 avatar CF2220160244 commented on July 25, 2024

@nekulkarni , I have pruned mobilenetv2 correctly, but the pruned model is difficult to train on imagenet, the accuracy is very low( I train with a 1080Ti, batchsize=96, lr=0.045, weight decay=0.00004, and decrease the lr 0.98 for each epoch, and i also try lr =0.1, lr = lr * (0.1 ** (epoch // 30)) ). can you tell me your data set and accuracy.
thank you very much!

from pytorch-pruning.

CF2220160244 avatar CF2220160244 commented on July 25, 2024

It seems that mobilenetv2 convergence slowly !

from pytorch-pruning.

guanhuiyan avatar guanhuiyan commented on July 25, 2024

@nekulkarni Can you share me your code about mobilenetv2 pruned ,please? I am a beginner. Thank you very much!

from pytorch-pruning.

guanhuiyan avatar guanhuiyan commented on July 25, 2024

@viviov Can you share me your code about mobilenetv2 pruned ,please? I am a beginner. Thank you very much!

from pytorch-pruning.

bharat3012 avatar bharat3012 commented on July 25, 2024

@nekulkarni Can you share the code with me also? I want to know how to deal with batch norm layers. Thank you very much.!!

from pytorch-pruning.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.