main.evaluate needs updating for vlosses, currently does not run. about minigo HOT 9 CLOSED

Hmm, it looks like our evaluation.py code didn't get updated when we made our change to use virtual losses. Instead of doing multi-game parallelization, we should rewrite this to just play one game at a time for N games.

Thanks for the bug report!

from minigo.

I'll take a look. thanks @weedwind

from minigo.

Hi, amj,

Thank you very much for your reply. I want to take another way to let my 2 models to play against each other. My script is:

#!/bin/bash

BLACK="python3 main.py gtp -l models/000000-bootstrap"
WHITE="python3 main.py gtp -l models/000001-model"
TWOGTP="gogui-twogtp -black "$BLACK" -white "$WHITE" -games 10
-size 9 -alternate -sgffile gnugo"
gogui -size 9 -program "$TWOGTP" -computer-both -auto

However, it says "The command genmove b sent to the Go program failed." Does that mean I can not use 2 of my own models in gogui?

Thank you so much.

from minigo.

@weedwind it looks like gogui is suppressing the failure message from the gtp program playing black, and i'm not sure what you have to do to get it to display them. If i had to guess, i'd say you'd need to look in gogui for the console output, which might provide additional information about what happened.

from minigo.

It looks like it's a GPU issue. When I ran the script above, the two models made GPU out of memory

from minigo.

interesting! have you tried it with the change from this commit?

from minigo.

@amj I just tried, it worked. Thank you very much.

from minigo.

I believe this is fixed with #111

from minigo.

Yes, fixed in #111 ! @weedwind if you'd like to try the evaluation program directly, something like
python main.py evaluate /path/to/model1 path/to/model2 --readouts 100 --games 8 should work

from minigo.