Create evaluation server about minigo HOT 4 CLOSED

@brilee we can probably play these games faster not on CGOS, right? I'd love to see us hash out (maybe on this issue?) some more concrete requirements here are viz latency, quantity, params/readouts, etc.

from minigo.

I would expect that we could play games faster, maybe because we wouldn't have to wait for slower games to complete. But then again, I think the CGOS behavior is the correct behavior, because otherwise you get into dynamics where "players that tend to finish their games fast" keep on getting rematched with each other. So it's important to let all games complete and then do a completely random repairing. CGOS is correct in this regard.

I don't really have a sense for how much stronger our players get with #readouts; unclear to me what the right tournament settings are. My first guess would just be identical to self play conditions (constant # of readouts per move for each side).

from minigo.

@brilee so are you leaning towards running our own CGOS internally, or towards automatically putting checkpoints on CGOS for N games?

from minigo.

Closed, we've got our eval jobs on a cluster -- no external bots right now but it's still pretty good.

from minigo.