This challenge provides a partial conversation, and requires participants to select the correct next utterances from a set of candidates. Unlike previous similar challenges, this task tries to push towards real world problems by introducing:
- A large number of candidates
- Cases where no candidate is correct
- External data
This challenge is offered with two goal oriented dialog datasets, used in 5 tasks. A participant may participate in one, several, or all the subtasks.
If you use this data or code in your work, please cite the task description paper:
@InProceedings{dstc19task1,
title = {DSTC7 Task 1: Noetic End-to-End Response Selection},
author = {Chulaka Gunasekara, Jonathan K. Kummerfeld, Lazaros Polymenakos, and Walter S. Lasecki},
year = {2019},
booktitle = {7th Edition of the Dialog System Technology Challenges at AAAI 2019},
url = {http://workshop.colips.org/dstc7/papers/dstc7_task1_final_report.pdf},
month = {January},
}
If you use the Ubuntu data, please also cite the paper in which we describe its creation:
@Article{arxiv18disentangle,
author = {Jonathan K. Kummerfeld, Sai R. Gouravajhala, Joseph Peper, Vignesh Athreya, Chulaka Gunasekara, Jatin Ganhotra, Siva Sankalp Patel, Lazaros Polymenakos, and Walter S. Lasecki},
title = {Analyzing Assumptions in Conversation Disentanglement Research Through the Lens of a New Dataset and Model},
journal = {ArXiv e-prints},
archivePrefix = {arXiv},
eprint = {1810.11118},
primaryClass = {cs.CL},
year = {2018},
month = {October},
url = {https://arxiv.org/pdf/1810.11118.pdf},
}
For more detail, please visit our website.
Lazaros Polymenakos, Chulaka Gunasekara โ IBM Research AI
Walter Lasecki, Jonathan K. Kummerfeld โ University of Michigan