Comments (3)
glample
commented on May 27, 2024
What does the full log file contain?
Could you check this is not a problem with permissions and that the script is allowed to create this scores file in the temp directory? (Also, does the temp directory exist?)
from tagger.
Daisy-123
commented on May 27, 2024
- Full log :
WARNING (theano.tensor.blas): Using NumPy C-API based implementation for BLAS functions.
Traceback (most recent call last):
File "train.py", line 222, in
test_data, id_to_tag, dico_tags)
File "/mnt/Storage01/blue90211/tagger-master/utils.py", line 277, in evaluate
eval_lines = [l.rstrip() for l in codecs.open(scores_path, 'r', 'utf8')]
File "/tools/anaconda2/lib/python2.7/codecs.py", line 896, in open
file = builtin.open(filename, mode, buffering)
IOError: [Errno 2] No such file or directory: './evaluation/temp/eval.1181043.scores' - Temp directory is generated by script (not exited before).
- I got eval.1181043.output file in temp directory ,but I can't find eval.1181043.scores.
- The process seems on going ... as below (stopped in epoch 0) :
"
..............
27900, cost average: 0.028285
27950, cost average: 0.456446
processed 1307517 tokens with 3937 phrases; found: 324 phrases; correct: 192.
accuracy: 99.30%; precision: 59.26%; recall: 4.88%; FB1: 9.01
Claim: precision: 59.26%; recall: 15.79%; FB1: 24.94 324
PriorArt: precision: 0.00%; recall: 0.00%; FB1: 0.00 0
ID NE Total OI-ClaimB-PriorArtI-PriorArtB-Claim Percent
0 O12952511294615 583 0 0 53 99.951
1I-Claim 6480 2950 3530 0 0 0 54.475
2B-PriorArt 2721 2655 65 0 0 1 0.000
3I-PriorArt 1849 1839 10 0 0 0 0.000
4B-Claim 1216 922 24 0 0 270 22.204
1298415/1307517 (99.30387%)
processed 1133259 tokens with 4170 phrases; found: 302 phrases; correct: 171.
accuracy: 99.20%; precision: 56.62%; recall: 4.10%; FB1: 7.65
Claim: precision: 56.90%; recall: 14.07%; FB1: 22.56 297
PriorArt: precision: 40.00%; recall: 0.07%; FB1: 0.13 5
ID NE Total OI-ClaimB-PriorArtI-PriorArtB-Claim Percent
0 O11213951120900 443 2 0 50 99.956
1I-Claim 5686 2610 3074 0 0 2 54.063
2B-PriorArt 2969 2906 58 2 0 3 0.067
3I-PriorArt 2008 1981 24 1 0 2 0.000
4B-Claim 1201 926 40 0 0 235 19.567
1124211/1133259 (99.20159%)
Score on dev: 9.01000
Score on test: 7.65000
New best score on dev.
Saving model to disk...
New best score on test.
28000, cost average: 0.016292
28050, cost average: 0.545872
28100, cost average: 0.665584
28150, cost average: 0.817216
28200, cost average: 0.029983
28250, cost average: 0.342566
28300, cost average: 0.429246
28350, cost average: 0.035073
28400, cost average: 0.009134
28450, cost average: 0.274903
28500, cost average: 0.448717
28550, cost average: 0.014378
28600, cost average: 0.342188
28650, cost average: 0.033076
28700, cost average: 0.010674
28750, cost average: 0.009748
28800, cost average: 0.018098
28850, cost average: 0.020268
28900, cost average: 0.022872
28950, cost average: 0.271496
processed 1307517 tokens with 3937 phrases; found: 534 phrases; correct: 30.
accuracy: 99.24%; precision: 5.62%; recall: 0.76%; FB1: 1.34
Claim: precision: 5.62%; recall: 2.47%; FB1: 3.43 534
PriorArt: precision: 0.00%; recall: 0.00%; FB1: 0.00 0
ID NE Total OI-ClaimB-PriorArtI-PriorArtB-Claim Percent
0 O12952511292716 2424 0 0 111 99.804
1I-Claim 6480 1968 4509 0 0 3 69.583
2B-PriorArt 2721 2324 370 0 0 27 0.000
3I-PriorArt 1849 1702 137 0 0 10 0.000
4B-Claim 1216 749 88 0 0 379 31.168
1297604/1307517 (99.24185%)
....................
"
from tagger.
junchenzhi
commented on May 27, 2024
- Full log :
WARNING (theano.tensor.blas): Using NumPy C-API based implementation for BLAS functions.
Traceback (most recent call last):
File "train.py", line 222, in
test_data, id_to_tag, dico_tags)
File "/mnt/Storage01/blue90211/tagger-master/utils.py", line 277, in evaluate
eval_lines = [l.rstrip() for l in codecs.open(scores_path, 'r', 'utf8')]
File "/tools/anaconda2/lib/python2.7/codecs.py", line 896, in open
file = builtin.open(filename, mode, buffering)
IOError: [Errno 2] No such file or directory: './evaluation/temp/eval.1181043.scores'- Temp directory is generated by script (not exited before).
- I got eval.1181043.output file in temp directory ,but I can't find eval.1181043.scores.
- The process seems on going ... as below (stopped in epoch 0) :
"
..............
27900, cost average: 0.028285
27950, cost average: 0.456446
processed 1307517 tokens with 3937 phrases; found: 324 phrases; correct: 192.
accuracy: 99.30%; precision: 59.26%; recall: 4.88%; FB1: 9.01
Claim: precision: 59.26%; recall: 15.79%; FB1: 24.94 324
PriorArt: precision: 0.00%; recall: 0.00%; FB1: 0.00 0
ID NE Total OI-ClaimB-PriorArtI-PriorArtB-Claim Percent
0 O12952511294615 583 0 0 53 99.951
1I-Claim 6480 2950 3530 0 0 0 54.475
2B-PriorArt 2721 2655 65 0 0 1 0.000
3I-PriorArt 1849 1839 10 0 0 0 0.000
4B-Claim 1216 922 24 0 0 270 22.204
1298415/1307517 (99.30387%)
processed 1133259 tokens with 4170 phrases; found: 302 phrases; correct: 171.
accuracy: 99.20%; precision: 56.62%; recall: 4.10%; FB1: 7.65
Claim: precision: 56.90%; recall: 14.07%; FB1: 22.56 297
PriorArt: precision: 40.00%; recall: 0.07%; FB1: 0.13 5
ID NE Total OI-ClaimB-PriorArtI-PriorArtB-Claim Percent
0 O11213951120900 443 2 0 50 99.956
1I-Claim 5686 2610 3074 0 0 2 54.063
2B-PriorArt 2969 2906 58 2 0 3 0.067
3I-PriorArt 2008 1981 24 1 0 2 0.000
4B-Claim 1201 926 40 0 0 235 19.567
1124211/1133259 (99.20159%)
Score on dev: 9.01000
Score on test: 7.65000
New best score on dev.
Saving model to disk...
New best score on test.
28000, cost average: 0.016292
28050, cost average: 0.545872
28100, cost average: 0.665584
28150, cost average: 0.817216
28200, cost average: 0.029983
28250, cost average: 0.342566
28300, cost average: 0.429246
28350, cost average: 0.035073
28400, cost average: 0.009134
28450, cost average: 0.274903
28500, cost average: 0.448717
28550, cost average: 0.014378
28600, cost average: 0.342188
28650, cost average: 0.033076
28700, cost average: 0.010674
28750, cost average: 0.009748
28800, cost average: 0.018098
28850, cost average: 0.020268
28900, cost average: 0.022872
28950, cost average: 0.271496
processed 1307517 tokens with 3937 phrases; found: 534 phrases; correct: 30.
accuracy: 99.24%; precision: 5.62%; recall: 0.76%; FB1: 1.34
Claim: precision: 5.62%; recall: 2.47%; FB1: 3.43 534
PriorArt: precision: 0.00%; recall: 0.00%; FB1: 0.00 0
ID NE Total OI-ClaimB-PriorArtI-PriorArtB-Claim Percent
0 O12952511292716 2424 0 0 111 99.804
1I-Claim 6480 1968 4509 0 0 3 69.583
2B-PriorArt 2721 2324 370 0 0 27 0.000
3I-PriorArt 1849 1702 137 0 0 10 0.000
4B-Claim 1216 749 88 0 0 379 31.168
1297604/1307517 (99.24185%)
....................
"
Hi, I have the same bug. Have you solved it? How did you solve it? Thanks~
from tagger.
Related Issues (20)
- utils.py issue line 303 list index out of range HOT 8
- Why my program goes into infinite loop? HOT 2
- Cuda and Theano Version HOT 4
- Can you
- Can my Chinese data be used in this program?(character-level) HOT 3
- Which tokenizer did you use? HOT 11
- Script for training embeddings HOT 9
- SGD x Adam HOT 2
- Are you planning to release models in German, Spanish and Dutch as well? HOT 1
- Confidence score for the predicted entity HOT 4
- Data size and decoding time
- Pretrained word embedding HOT 5
- Confusion about lable conversion. HOT 2
- Inconsistent conversion for IOBES to IOB HOT 1
- Token level or Entity level? HOT 2
- Equations of LSTM
- transition scores HOT 1
- How to set the parameters of a small dataset？ HOT 1
- . HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tagger.