Source-Side Spans about wmt-mqm-human-evaluation HOT 5 CLOSED

Hi,

In one of our data cleaning steps, we did remove the annotations from the source side. If needed, I can re-add the error span to the source sentences? Let mw know if this is what you are looking for and I will work on that.

Markus

from wmt-mqm-human-evaluation.

Hi Markus,

Yes, the error span in the source, where available, would indeed by very useful for a project I am currently working on.

If it's easier for you, you could also send me the raw data from before that cleaning step, and I will work on a pull request.

Best,
Jannis

from wmt-mqm-human-evaluation.

Hi,

I am trying to add these at the end of this week.

Markus

from wmt-mqm-human-evaluation.

Hi, Markus

I find that the omission errors in newstest2020 are still labeled on the target side, have you re-add the error span to the source sentences?

from wmt-mqm-human-evaluation.

I added the source erros as additional files to the WMT20 directories.

The source errors were also annotated on the target side. I am not sure why the annotators decided to do so. Hope that helps.

from wmt-mqm-human-evaluation.