Comments (4)
Are you sure that the CoNLL-U file that you are trying to load contains the syntactic annotation? It looks like you are trying to evaluate the blind test data, which serves as the input for a parser and it cannot be evaluated until it has been parsed.
from conll2017.
This is test file
This is gold file :
I assume both are parsed.
from conll2017.
I see. The test file is not a valid CoNLL-U file and it would have been rejected in the CoNLL 2017 shared task. There is only morphological but no syntactic annotation (the underscores in the seventh and the eighth columns, HEAD and DEPREL).
If you are not interested in syntax and only want to evaluate morphology with the official evaluation script, you have to put some fake tree structure there and make the file valid. E.g., the first node in each sentence could have HEAD=0 and DEPREL="root", and all other nodes could have HEAD=1 and DEPREL="dep".
from conll2017.
Thank you so much. I will change that.
from conll2017.
Related Issues (14)
- The TIRA platform HOT 4
- Parallel data HOT 9
- Languages with multiple treebanks HOT 4
- Chinese word segmentation HOT 2
- Suggestion for dealing with tokenisation mismatches HOT 5
- Definition of "very small corpora" HOT 4
- How to compute the overall score HOT 8
- Additional Resources? HOT 28
- Task definition HOT 4
- Evaluation metrics HOT 15
- Token count for evaluation corpus HOT 4
- Shifting to domain adaptation task? HOT 11
- Surprise languages vs. trainable parser task HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from conll2017.