document input data about lichess-ordo HOT 2 OPEN

Sure, it is undocumented because it will be changing in the future. So I'll just comment here for now.

This is the Blitz data for Lichess November 2023.

First we have a uint32 specifying how many players there will be: n_players. Then we have an n_players long array of uint16's, which specifies how many distinct opponents player_i has faced. Then we have an n_players long array of uint16's specifying how many games they played in total. Then an n_players long array of uint16's for how much they scored, multiplied by two so that the values are whole numbers. Now the big chunk of data. We calculate how many total pairings there are, n_pairings, that is the sum of n_opponents, so the sum of how many distinct players every player faced. Now what follows is a n_pairings long array of who player_i played, these are uint32 indexes of their opponents. So if player_0 faced player_123, player_321 then n_opponents[0] is 2 and the first two values in will be 123 and 321. The indices variable specifies the offsets for each player. So if player_0 played two people, player_1 played 5, the indices will be [0, 2, 7]. And then the last array is n_pairings long uint16's for how many games were played in each pairing.

Sorry for rambling, hope this helps! This format will change when we count games as white and black separately. I'll keep this issue open so I don't forget to document the finalized format.

from lichess-ordo.

pzstd: data/blitz.packed.zst: Unknown frame descriptor.

https://github.com/ddugovic/Lichess-Ordo/actions/runs/7611274965/job/20726405629

from lichess-ordo.