Light

lgw863 / logiqa-dataset Goto Github PK

logiqa-dataset's Introduction

LogiQA

This dataset consists of 8,678 QA instances.(Train:7376; Eval:651; Test:651)

The files is divided into English version: Train.txt, Eval.txt, Test.txt, and Chinese version: zh_train.txt, zh_eval.txt, zh_test.txt.

Each 8 lines constitute an example of a problem. (8,678 * 8 = 69,424)

In each 8 lines:

             The first line is blank line;

             The second is right choice;

             The third is context;

             The fourth is question;

             The remaining four lines are four options.

logiqa-dataset's People

Contributors

Stargazers

Watchers

Forkers

dadaqingjian niteshbhatia008 nlp-shiba wengbenjue yyht scape1989 oriyor gemsouls jon-tow stellardragon

logiqa-dataset's Issues

请问可以分享一下数据集的生成的代码吗？

Hi,

请问可以分享一下LogiQA数据集生成的代码吗？感谢

另外推荐一篇也是做逻辑推理的工作，也是考虑的deductive reasoning，不过是给一个知识库（facts+rules）以及一个问题，需要判断这个问题是true还是false。
https://arxiv.org/abs/2002.05867

Implementation Details

Hello,
Thanks for this excellent work. Could you please provide more Implementation Details including hyper-parameters?
Thank you!

Reasoning type of each question.

Thanks for releasing this dataset!

I'm wondering whether there is annotation about the reasoning type of each question as described in Table 7 of your paper?

Looking forward to your reply!

Chinese LogiQA?

Hi Liu,

请问论文中提到的 Chinese-LogiQA 是否已经公开？如果已经公开的话，可以分享一下链接吗？谢谢！

Could you provide the data split?

Hi,

Thank you for your great work. Is it possible to provide the data split that you use to get the results?

Thanks!

请问能提供一下数据集吗？

Liu 同学:
您好！这个工作非常有趣，我对它非常感兴趣，希望能够follow你们的工作，请问方便提供一下数据集吗？

English translation has lots of issues

Hi, I was evaluating models on the English version, and I noticed they did very poorly. So, I decided to look at the questions myself by hand, and I cannot answer them either, since, at least the 4-5 I looked at all have translation errors that make the questions un-answearable. Specially, in the answers, which contain small snippets of text, some times the translations do not make any sense at all. I wonder if there are any plans for a revised translation.

When will the English-version dataset release?

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.