Light

lixinsu / rczoo Goto Github PK

View Code? Open in Web Editor NEW

167.0 15.0 43.0 13.04 MB

question answering, reading comprehension toolkit

License: MIT License

Shell 0.63% Python 99.37%

reading-comprehension question-answering deep-learning

rczoo's Introduction

Introduction

The RCZoo project is a toolkit for reading comprehension model. It contains the PyTorch reimplement of multiple reading comprehension models

Usage

run sh download.sh to download the dataset and the glove embeddings.
run sh runs/train_squad.sh [bidaf|drqa|slqa|fusionnet|docqa] to start the train process. (Check the xxx.sh scripts before run, as the preprocessing only need to be executed once)

Dependencies

python 3.5
Pytorch 0.4
tqdm

performance

We train each model on train set for 40 epoch, and report the best performance on dev set.

Model	Exact Match	F1	EM(+ELMo)	F1(+ELMo)
Rnet	69.25	78.97
BiDAF	70.47	79.90	73.04	81.48
documentqa	71.47	80.84
DrQA	68.39	77.90
QAnet	...	...
SLQA	67.09	76.67
FusionNet	68.27	77.79

Current progress

acknowledgement

some code are borrowed from DrQA, a cool project about reading comprehension.

rczoo's People

Contributors

Stargazers

Watchers

rczoo's Issues

how to get predict file

how to use the predict script for squad? could you add a readme?
and what's the sogou data?

support marco dataset in bert model

update for squad2.0

will you update the dataset? or support more dataset?

What's the difference with SMRCToolkit?

https://github.com/sogou/SMRCToolkit/

Performance of slqa and bidaf++

Hello.
It seems that the performance of slqa is worse than bidaf(with self-attention?). I wanna know that are there some problems implementation slqa? In my own implementation, it seems also worse than bidaf++, which is different from leaderboard.

all bash scripts are divided by the dataset, and added to difference folder

Add RL loss

add RL loss for bert

rouge-reward loss

change dataset
add rouge function

[Test] update the metrics of slqa

error in readme

request for simpleqa model

a strong baseline model for reading comprehension

There are many useless arguments in config.py, and some parameter in rnn_reader.py should be added in the config.py

Add label smoothing

OOM of QAnet model

Add bert

Adapt bert for RCZoo

Could not fond scripts/convert/squad.py

When I use download.sh,I could not find the file squad.py,Can you upload it ?

Bug not use GPU when evaluate on bert

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.