sebastian-hofstaetter / teaching Goto Github PK

This is the coordination issue for fixing the closed captions of Lecture 7: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%207%20-%20Closed%20Captions.md

If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!

This is the coordination issue for fixing the closed captions of Lecture 0: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%200%20-%20Closed%20Captions.md

If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!

Hey,

One reference on slide 11 for lecture 6 has a typo in a year:

• Transformer-XH [Zhao et al., 2014]
  Should be 2020 instead of 2014

Best,
Wojtek

This is the coordination issue for fixing the closed captions of Lecture 9: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%209%20-%20Closed%20Captions.md

If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!

Is there a BibTeX entry that I can use to cite this lecture? Thanks in advance.

Only the generated captions are available in the video.

This is the coordination issue for fixing the closed captions of Lecture 6: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%206%20-%20Closed%20Captions.md

If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!

On Slide 32 of Lecture 6 - Transformer and BERT Pre-training.pdf it says "[...], as man more moving parts are involved" instead of "[...], as many more moving parts are involved".

This is the coordination issue for fixing the closed captions of Lecture 10: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%2010%20-%20Closed%20Captions.md

If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!

In lecture 5 video from 10:00 until 10:30 the sound is missing.

hi, It's really awesome and useful learning materials.
But can you support us the PowerPoint files for the lectures PDF files ?

thanks

This is the coordination issue for fixing the closed captions of Lecture 2: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%203%20-%20Closed%20Captions.md

This time it also missed a couple of titles (i don't know why), please add them as well from the slides.

If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!

This is the coordination issue for fixing the closed captions of Lecture 8: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%208%20-%20Closed%20Captions.md

If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!

In the formula for the score (last line, Part 2), shouldn't this be subscripted to the CLS output as for r in slide 9 ?

In shortened Latex-Notation:

s = W * BERT_{b..l}(...)_{CLS}

This is the coordination issue for fixing the closed captions of Lecture 2: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%202%20-%20Closed%20Captions.md

If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!

This is the coordination issue for fixing the closed captions of Lecture 4: https://github.com/sebastian-hofstaetter/teaching/blob/master/advanced-information-retrieval/Lecture%204%20-%20Closed%20Captions.md

If you want to fix errors, please leave a short comment here before starting to block the issue. Thanks!

Referring to the explanation of the attention mechanism in Neural Networks for NLP slide 41

The phrase "the attention mechanism is defined as" suggests that this is the one and only definition of attention, however there are many attention mechanisms. The effect from some is evaluated here.
I'd suggesting rephrasing it to "additive attention is defined as" as that's the commonly used name for the type of attention on that slide, or to describe the mechanism more general by declaring
and noting that one example is