error_norm_truncation's Introduction

Error Norm Truncation

This is the code repository for the paper Error Norm Truncation: Robust Training in the Presence of Data Noise for Text Generation Models (Under Construction).

Getting Started

Machine Translation code is at ./fairseq

Language Modeling code is at ./language_modeling

Text Summarization code is at ./t5_finetune

Citation

@article{li2023errornormtruncation,
  title={Error Norm Truncation: Robust Training in the Presence of Data Noise for Text Generation Models},
  author={Tianjian Li and Haoran Xu and Philipp Koehn and Daniel Khashabi and Kenton Murray},
  year={2023},
  eprint={2310.00840},
  archivePrefix={arXiv},
  primaryClass={cs.CL}, 
  url={https://arxiv.org/abs/2310.00840}
}

error_norm_truncation's People

Contributors

Stargazers

Watchers

error_norm_truncation's Issues

why 'start truncate iteration' in translation task?

I thought the strength of the method is no need to specify the starting iteration for truncation.
Is it practically better to designate a starting iteration for truncation? If then, what iteration is recommended?

Thank you for the nice work.

Recommend Projects