openseced / infotheory Goto Github PK

• https://www.youtube.com/watch?v=x-2uVNze56s
• https://xkcd.com/1132/

From PR #13.

Currently the basics lecture is in Swedish, it should be translated.

A concave function suffices.

Some parts, e.g. about passwords, perhaps should be moved to other modules:

• passwords to passwd module?

A graph of a concave function would greatly improve the explanation of the definition.

This material should have the notes+slides format as given in the templates.

Now (2018) it took 45 + 60 min.

Both probabilities and entropy are nicely visualised using Venn diagrams.

Currently basics is a traditional lecture, rework it to use active learning.

• When introducing the definition of concavity, show the graph of a concave function first. Then the students might better understand the definition.
• Explain the weight 0 <= t <= 1 (and 1-t): fix x and y, thus also f(x) and f(y). Now t is the variable. t f(x) + (1-t) f(y) forms the line under the graph. f(tx + (1-t)y) will follow the graph of f and will always stay above. Hence t f(x) + (1-t) f(y) <= f(tx + (1-t)y).

We must sort out the prerequisites. For now it's:

• elementary probability theory (add details).

Must specify that $t \leq 1$ in the definition of concavity.

Break out the probability section to its own session.