Comments (11)
Great, thanks a lot! Re the loading issue, perhaps we shouldn't bother with backward compatibility for earlier finetune versions, if there are more pressing issues.
from finetune.
@dimidd thanks again for the bug reports. Going to dig into it -- did not expect this change to break saved model files.
from finetune.
Could you post a traceback? This is a very sensical problem to be caused by that upgrade but I'm unable to reproduce.
- I installed 0.5.10.
- Checked to ensure the version is set to 0.5.10
- Trained and saved a simple model
- Installed 0.5.11
- Checked to ensure 0.5.11 was installed
- Was able to successfully load the model
from finetune.
Sorry, I think it was even an earlier version than 5.10, perhaps 0.5. Is this metadata somehow saved in the model file?
from finetune.
BTW, I guess the documentation should be updated as well, since it seems that path
must be now a dir.
https://github.com/IndicoDataSolutions/finetune/blob/development/finetune/base.py#L373
from finetune.
P.S. could this change have affected autosave_path
? I've tried to use it in 5.11, but nothing was saved.
from finetune.
path
does not have to be a dir -- the documentation needs to be updated there to reflect the current state of the code, which serializes to a single model file. Sorry for missing that.
from finetune.
Digging into the autosave_path
report now @dimidd
from finetune.
@dimidd OK an update on the autosave_path
problem -- that config argument was actually removed in favor of keeping best model parameters in CPU memory. So to get behavior similar to what you had previously:
model = Classifier(keep_best_model=True)
model.fit(data)
model.save(filepath) # this actually writes the saved model parameters out to disk
You can use this in conjunction with the early_stopping_steps
argument to exit early if the validation loss fails to decrease for early_stopping_steps
batches.
from finetune.
@dimidd Seems like there are substantial holes in the documentation for these things and some out of date docs in a few cases. Going to try to block out some time next week to make your life a bit easier in that regard. Thanks for bearing with us!
from finetune.
@dimidd I think that's wise -- because the project is young we were not too worried about preserving model save files between major finetune versions, but I am sorry we made life hard for you. Hope retraining is not too bad. Thanks again, closing for now!
from finetune.
Related Issues (20)
- Add chunk long sequences support to featurize_sequence HOT 1
- Make tqdm behavior more consistent between train / predict
- ModuleNotFoundError: No module named 'tensorflow.contrib' HOT 1
- Make try/except in visible devices search less broad and print traceback to enable debugging deployed finetune
- Soft targets for sequence labeling models (with use_crf=False) HOT 2
- Add chunk long sequences support to featurize
- Add "download=False" argument to optionally prevent automatic download on instantiation
- Check md5sums of hashes base model file hashes
- McDonalds dataset link is broken HOT 1
- Document tensorflow 2.0 requirement and removal of 1.x support
- How to save checkpoint when finetune?
- Pin Spacy Version to < 3.0 HOT 1
- [Need help] How can I load a created base model HOT 4
- LayoutLM documentation
- Add absl-py to requirements.txt
- Question: Does the Bert base model support multiple languages?
- Use on Colab Fails HOT 2
- Finetune a model Q/A Response
- MultiLabelClassifier predictions bug HOT 2
- Unavailable pre-trained model configs
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from finetune.