Comments (3)
Sorry, I found the mistake in my code.
For fully connected layer, network_regularizer
should be GroupLassoFlopsRegularizer
.
from morph-net.
Dear not a big fish,
I am sorry to say that for now MorphNet does NOT support conv3d.
What you have observed is the op_regularizer_manager
that looking for an op called FusedBatchNorm
and unfortunately for 3d convolutions this op does not exist. So it appears there is nothing to regularize. Further more, even without batch norm, the cost calculator will need to change in order to correctly handle this case.
Furthermore, It is true that fully_connected
layers are regularized via GroupLassoFlopsRegularizer
but again this is not what you want, as the logits
have a fixed dimension (number of labels, 10 in your example), and therefore there is nothing to learn here. This is always true for the last layer of the network, regardless of if its a fully connected or a conv layer.
We are planning to support Conv3D in the near future but I don't have an exact date. If you would like to contribute and try to code it, we will be happy to share with you the way we see this implemented.
Stay tuned,
Elad
from morph-net.
@eladeban
Dear Elad,
thanks for the detailed explanation. I appreciate this opportunity and would like to try to contribute. Honestly I really don’t know what the first move should be and I’d love to hear your ideas.
Best regards,
notabigfish
from morph-net.
Related Issues (20)
- the morphnet can act on some layers of the model?such as act on backbone. HOT 7
- Questions about batch_normalization HOT 3
- OpRegularizerManager could not handle ops HOT 7
- Getting this Error HOT 1
- Getting error like this HOT 2
- In this case, MorphNet is getting stuck because it doesn't know how to handle the Shape op. You can try a couple options:
- Applying Morph-net while training training Yolov3 using darknet HOT 1
- Query on Morph Net Structure Exporter HOT 2
- What's the tf version this repo used?
- Can morph-net output a pruned model file? HOT 3
- Bad structure HOT 3
- MorphNet not working on google colab HOT 1
- Can I use MorphNet to slim my model trained by Pytorch? HOT 1
- Regularizer Loss remains zero / BatchToSpaceND HOT 1
- Multiple alive files output HOT 1
- Batch Norm layers Assertion Error
- Latency regularizer for a target hardware. HOT 5
- LayerNorm not support?
- Performance issue in the definition of create_test_input, examples/slim/nets/resnet_v1_test.py HOT 1
- Tensorflow 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from morph-net.