ontonotes / conll-formatted-ontonotes-5.0 Goto Github PK

Hi,

I'm currently using OntoNotes to do some linguistic research. When looking into some gold_conll files, I noticed there is no coreference annotation. For instance, nw_wsj_0257 and many other more in the translated parallel corpora.

Is there any specific reason for this missing part?

It appears that there are some files in the Ontonotes 5.0 corpus that don't appear in this data, specifically files that start match *_0000.gold_skel.

I don't have the Onotenotes 5.0 data in front of me at the moment, but I will give an example from the 4.0 corpus. The following files match:

# conll-formatted-ontonotes-5.0
conll-formatted-ontonotes-5.0/data/train/data/english/annotations/bc/cnn/00/cnn_0001.gold_skel
# ontonotes-release-4.0
data/files/data/english/annotations/bc/cnn/00/cnn_0001.parse

But the same version with 0000 instead of 0001 only exists in ontonotes, but not this repo:

# conll-formatted-ontonotes-5.0: doesn't exist
conll-formatted-ontonotes-5.0/data/train/data/english/annotations/bc/cnn/00/cnn_0000.gold_skel
# ontonotes-release-4.0: exists
data/files/data/english/annotations/bc/cnn/00/cnn_0000.parse

Hey,
I am starting to work with ontonotes 5 and I am kind of lost.
I found this repo because I needed the conll format for ontonotes but if I look at the annotations the words are missing and replaced with [WORD].
Is this intended, because only LDC is allowed to publish the corpus?
How do I get the words back in?
Is there a simple script I can follow to recreate these files but with the corresponding words?

I hope someone can help! ❤️

So, am I right to say that the provided data is just the OntoNotes 5.0 formatted but without the actual text (I see [WORD] mask for all the words in the dataset)

Is it possible to add License information to this repo? Who can use it, in what context, etc.

I can't find any resource except the origin ontonotes 5.0 free data at LDC which I don't have permission to access. If you have the chinese coNLL files or the origin data, I would be obliged if you could share it with me. Thanks again.

Description
I am currently stucked in running the script at #3 under "Steps for assembling the data" section from the instruction. As a newbie, I have little understanding of converting the skeleton files to conll files. Here are the commands specified in the guide:

skeleton2conll.sh -D /path/to/ontonotes-v5.0-release/data/files/data] [path/to/conll-formatted-ontonotes-5.0]

Result

Here is my command where I followed the script.

Here is the output in case image wont load:

$ ".\conll-formatted-ontonotes-5.0\scripts\skeleton2conll.sh" -D ".\ontonotes-release-5.0\data\files\data\" ".\conll-formatted-ontonotes-5.0\"
please make sure that you are pointing to the directory 'conll-formatted-ontonotes-5.0'

Data + Script
OntoNotes 5.0 from LDC (thru email)
CoNLL-formatted OntoNotes 5.0 scripts (from the same website)

Steps to reproduce

1. Download the data and script
2. Extract the data and script (I placed the 'scripts' folder inside 'conll-formatted-ontonotes-5.0')
3. Run the command skeleton2conll.sh -D /path/to/ontonotes-v5.0-release/data/files/data] [path/to/conll-formatted-ontonotes-5.0]

Build/Platform
Windows 10
Git Bash (mingw64)
python 3.6
cpu (no CUDA)

This is a CoNLL formatted version of the OntoNotes 5.0 release with english corpus. Can you help with the Chinese? Please