Git Product home page Git Product logo

lookaheadfeature's Introduction

This implementation is based on the cnn library for this software to function. The paper is "Shift-Reduce Constituent Parsing with Neural Lookahead Features".

Building

mkdir build
cd build
cmake .. -DEIGEN3_INCLUDE_DIR=/path/to/eigen
make    

Preprocessing

You can get the constituent hierarchy by scripts/conhier_s.py for s-type constituent hierarchy and scripts/conhier_e.py for e-type constituent hierachy

./scripts/conhier_s.py [training data in bracketed format] > [s-type training data]
./scripts/conhier_e.py [training data in bracketed format] > [e-type training data]

./scripts/conhier_s.py [development data in bracketed format] > [s-type development data]
./scripts/conhier_e.py [development data in bracketed format] > [e-type development data]

./scripts/conhier_s.py [test data in bracketed format] > [s-type test data]
./scripts/conhier_e.py [test data in bracketed format] > [e-type test data]

The directory data contains the related data.

Training

./build/impl/s-hierarchy-trainer train.s dev.s 
./build/impl/e-hierarchy-trainer train.e dev.e

Decoding

./build/impl/s-hierarchy-trainer train.s test.s [s_model]
./build/impl/e-hierarchy-decoder train.e test.e [e_model]

It will automatically generate the output file test.sOUT and test.eOUT, respectively, which then can be used as extra features on the lookahead implementation of ZPar

Usage of ZPar

./scripts/combine.py [.sOUT] [.eOUT] > [extra feature]

You can follow the ZPar instruction to complie constituent parser with implementation of "jiangming".

./conparser [in] [out] zpar_model [extra feature]

Citation

@article{TACL927,
    author = {Liu, Jiangming  and Zhang, Yue },
    title = {Shift-Reduce Constituent Parsing with Neural Lookahead Features},
    journal = {Transactions of the Association for Computational Linguistics},
    volume = {5},
    year = {2017},
    issn = {2307-387X},
    url = {https://transacl.org/ojs/index.php/tacl/article/view/927},
    pages = {45--58}
}

lookaheadfeature's People

Contributors

leoncrashcode avatar

Watchers

James Cloos avatar Shubham Pachori avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.