sameersingh / wiki-link Goto Github PK

What is rawTextOffset supposed to be ? 

I just want to extract the text from the HTMLs together with the exact offset 
of each of the Wikipedia hyperlinks.

See comments on the Wiki page about this issue.

I've been playing with the code provided in the repository to generate the 
dataset.
I wonder if it is possible to contribute, I found the following issues:

1. I had problems calling retrieve.sh part of the problem was that I was using 
OSX and the script  uses GNU terminal commands. I changed some of those parts 
of the scripts so that they are cross OS.

2. a bug in retrieve_chunk.sh, the script was getting the wrong parameter to 
use as URL, this was solved by changing the index used by awk.

3. Added a 'how to' with steps on how to generate the dataset.

Here is my fork:
https://code.google.com/r/davalejandro-wikilink/source/list

      <groupId>org.sameersingh.utils</groupId>
      <artifactId>timing(also for coref and cmdots)</artifactId>
      <version>0.1.1-SNAPSHOT</version>