data set is too big (which is too big to be held in one machine's mem), and I should break it to small daily set about node2vec-c HOT 2 OPEN

You will need to deal with multiprocessing slightly better than I do in the training loop. One option would be to just run the random walk generation and write to the file in the single thread. As for the place, it is correct.

from node2vec-c.

Thanks very much.
Is there any other repo that is available to generate random walk sequence for big data set?
I found when I use data set bigger than 10 million edge, the memory required would be bigger than my memory capacity(200G)

from node2vec-c.