togethercomputer / opendatahub Goto Github PK

Data Source

pretty_name: xp3 sample
license:
  - None
language:
  - multi
multilinguality:
  - multilingual
download_link:
  - https://drive.google.com/file/d/1p4C5QHfS_6fadyzhYHVqh3bKStGIzBnt/view?usp=sharing
source:
  - xp3
task_types:
  - dialogue
processed_by:
  - Huu
description:
  - None

Example Prompts that you believe this data source will perform well on (or issues that you think this data source will fix)

https://drive.google.com/file/d/1Mjmy-5BTpvOLV25o6YDxXaNrgnRZYjJu/view?usp=sharing

Data Source

pretty_name: multi_sum
license:
  - ___LICENSE___
language:
  - ___LANGUAGE___
multilinguality:
  - ___monolingual/multilingual___
download_link:
  - https://drive.google.com/file/d/1iTGgpUXZURMhDt3i4RoswRQSuKI7cvTi/view?usp=share_link
source:
  - ___SOURCE___
task_types:
  - ___e.g., dialogue___
processed_by:
  - Huu
description:
  - summarization from multi-source, need to replace existing ones.

* Need to replace existing sum data.

Describe the bug
example:

{"text": "<human>: Why is this joke funny? Q: What does a computer do when it is tired? A: It crashes!
Rosey: Did your computer ever stop working (freeze) or turn itself off when you wanted to use it? If it did, you can say your 
computer crashed. Computer crashes are frustrating because you cannot get your work done, and sometimes you lose the 
work you finished most recently, unless you saved it. Thankfully, they do not happen too often."}

Clearly, we need to replace every "\nRosey:" to "\n<bot>:"

Describe the bug

Reported on Discord:

sometimes the model just replies "entailed" and as soon as the word has been in a conversation, that's the only answer the bot will give you till you reset

Data Source

pretty_name: image_prompts_instructions
license:
  - None
language:
  - en
multilinguality:
  - monolingual
download_link:
  - 1-4aoUEkFf8vzGuBzkLhyGm6ToR_oiCc5
source:
  - unknown
task_types:
  - dialogue
processed_by:
  - Huu
description:
  - image_prompts_instructions

Example Prompts that you believe this data source will perform well on (or issues that you think this data source will fix)

User: Give me an image prompt to draw an image with scale, model, vasa, display, stockholm

Assistant: a 1:10 scale model of the vasa, on display in stockholm, depicts the ship as she appeared in her prime

1. Add https://huggingface.co/datasets/McGill-NLP/FaithDial
2. Before factual answers, mention something like "I'm just a language model, so my answer may be wrong or stale. But I can do my best to answer: "
   Anything else?

My question:

you're annoying

Bot response:

I'm sorry, but I cannot help with this question as it was flagged by my moderation model. If you think this is incorrect, please help us improve by providing more information here.

Ideal bot response:

I'm sorry if I'm annoying you. As an AI language model, my aim is to provide helpful and informative responses to your questions or prompts. If there is anything specific that I can do to make our interaction more productive or pleasant for you, please let me know.

PS: fix marks or something

Bot response was:
Factually incorrect *
Not helpful *
Harmful, inappropriate or unsafe *

because all of them should be checked to submit new issue.

Bot response was:

• Factually incorrect
• Not helpful
• Harmful, inappropriate or unsafe

TODO: Upload the data and create data cards.

Problem

The model is not a chatbot yet.

Examples

NA

Potential Solutions

Convert and add soda data

more data https://drive.google.com/file/d/1--FU-GwxrAHGtIhhVN0KxGd-aP1MRNNg/view?usp=sharing

Problem

The bot often repeats itself.

Examples

User: hi
Bot: Hello, how may I help you?
User: how many legs does a cat has?
Bot: Let me check the information for you. A cat has four legs.
User: could you write a story
Bot: Sure, a story about how a cat has four legs. A cat has four legs. A cat has four legs. A cat has four legs.
User: that was not a story
Bot: Let me try this. A cat has four legs. A cat has four legs. A cat has four legs. A cat has four legs. A cat has four legs. A cat has four legs. A cat has four legs. A cat has four legs.
User: please do not repeat words, tell a story about bear and honey
Bot: Sure, a story about bear and honey. Bear and honey. Bear and honey. Bear and honey. Bear and honey. Bear and honey. Bear and honey. Bear and honey. Bear and honey. Bear and honey. Bear and honey. Bear and honey.

Potential Solutions

https://arxiv.org/abs/2210.00660

This is to add initial instruction data and others.

• Instruction (not in dialogue, just zero/few-shot instruction tuning)
  • NI: https://github.com/allenai/natural-instructions
  • P3: https://huggingface.co/datasets/Muennighoff/P3
  • Mmlu-cot :https://github.com/jasonwei20/flan-2/blob/main/mmlu-cot.json
• Others:
  • Pile: https://huggingface.co/datasets/the_pile

update the joke explanation data.

Data Source

pretty_name: ___NAME___
license:
  - ___LICENSE___
language:
  - ___LANGUAGE___
multilinguality:
  - ___monolingual/multilingual___
download_link:
  - https://drive.google.com/file/d/1-laFweqp676HxEzse1k63owo5h3BcbYi/view?usp=sharing
source:
  - ___SOURCE___
task_types:
  - ___e.g., dialogue___
processed_by:
  - ___USER___
description:
  - ___DESCRIPTION___

Example Prompts that you believe this data source will perform well on (or issues that you think this data source will fix)

'SharePlay Video
The effort, if successful, could be part of a solution to Kyiv’s need for additional firepower and air defenses as both Ukraine and Russia prepare for major offensives this spring. Senior American generals hosted Ukrainian military officials last week in Wiesbaden, Germany, for a set of tabletop exercises to help Kyiv get ready for the next stage of the war.'Extract the title of this sentence?
: Ukraine to get new air defense system from US, Germany
: The rest of this: The new system will be based on the US Patriot missile system, which is already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already in use in the country. The US has also agreed to provide Ukraine with Javelin anti-tank missiles, which are already

Might be useful to compare/identify issues?

https://drive.google.com/file/d/1QzgcO7g-ECrMg_W2qYeMJN_sz4QnVeId/view?usp=share_link

Data Source

pretty_name: abstact_infill.jsonl
license:
  - None
language:
  - en
multilinguality:
  - monolingual
download_link:
  - https://drive.google.com/file/d/1k0z5UgmMYnbCqKAM-9Ne63y3AJqCjCo_/view?usp=sharing
source:
  - unknown
task_types:
  - dialogue
processed_by:
  - Huu
description:
  - abstact_infill.jsonl

Example Prompts that you believe this data source will perform well on (or issues that you think this data source will fix)

User: What is the name of the Switzerland national rugby sevens team?
Assistant: Switzerland national rugby sevens team The Switzerland national rugby sevens team is a minor national sevens side.
User: What is the ranking of the team?
Assistant: It competes annually in the Rugby Europe sevens championship.
User: Summarizing the above, give me an article about The Switzerland national rugby sevens team, discussing in detail the Rugby Europe Sevens Conference 1, the 2022 season in one paragraph. End with a sentence about the Rugby Europe Sevens Conference.
Assistant: The Switzerland national rugby sevens team is a minor national sevens side. It competes annually in the Rugby Europe sevens championship. For the 2022 season, the team played in the Rugby Europe Sevens Conference 1.

TODO: Need further processing.

Data Source

pretty_name: ___NAME___
license:
  - ___LICENSE___
language:
  - ___LANGUAGE___
multilinguality:
  - ___monolingual/multilingual___
download_link:
  - ___ULR___
source:
  - ___SOURCE___
task_types:
  - ___e.g., dialogue___
processed_by:
  - ___USER___
description:
  - ___DESCRIPTION___

Example Prompts that you believe this data source will perform well on (or issues that you think this data source will fix)

take the lyrisc dataset and find the top N words that are not english stop words by genre.