Comments (5)
Oh my god, thanks for sharing, and this is really helpful!
Looks like there are still many things for me to learn how to make the learning more stable...
Do you mind to upload your code as a new branch? It would be great to have this version available!
from closerlookfewshot.
after a lot of attemptions,i finally found a robust parameters to re-implement the refined cosine distance method:
1.we rewrite the cosine distance code.
2. we set scale factor s = 30 all the time for training.
3. we use sgd optimizer with m=0.9 and lr=0.1 at begining,and decay with 0.1 at 100,200,300 epoch
4.for conv4 network we use weight-decay = 5e-4,for ResNetX network we use weight-decay = 1e-3
5.when doing finetune,we set the scale factor s = 5.here is the result on ResNet18:
mini-imagenet:
1 shot 56.78+0.84
5 shot 75.46+0.63
Thanks for these hyper-params. Can you still remember the hyper-param when we do fine-tuning for baseline++?
from closerlookfewshot.
@KaleidoZhouYN Thanks for providing this info! I am wondering what is the final training loss value(for l2-normalized softmax) you get under this setting of hyperparameter?
from closerlookfewshot.
Can you explain how do you find these super parameters?
from closerlookfewshot.
I just feel like if you end up with a very different optimizer and learning rate scheduler, the performance of other benchmarks may improve or worse as well. The values reported may have to be updated as well...
from closerlookfewshot.
Related Issues (20)
- Can't reach specified accuracy on CUB dataset ResNet18 HOT 1
- low GPU utilization rate HOT 3
- Could anyone explain why don't use validation for baseline? HOT 1
- GPU memory continue to grow for MAML HOT 1
- Training accuracies are low and their gaps are big when Conv4 backbone is used.
- Question on feature_loader.py:32,33
- The stop_epoch number of maml
- Larger batch size for CUBS.
- Query Regarding Figure 5.
- TypeError: super() argument 1 must be type, not classobj
- assert params.num_classes >= 1597, 'class number need to be larger than max label id in base class' HOT 5
- h
- Training using 'protonet', 'matchingnet', 'relationnet', 'relationnet_softmax', 'maml', 'maml_approx' methods with an unbalanced dataset.
- Baseline++ cross_char accuracy lower than Baseline
- About the lacking of query sample in data_loader and the lacking of target in calculating loss
- h
- CUB dataset's link no longer valid
- Baseline ++ validation wrongly reported in paper?
- What does fid mean in write_miniImagenet_filelist.py ?
- How to fine-tune the Matching Network HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from closerlookfewshot.