Comments (11)
from katago.
You can create some sort of metric by which to measure the time/accuracy tradeoff. In engineering, this is called constructing a "figure of merit." After constructing this value, you may then optimize according to that and arrive at an "empirically optimal" value for this parameter. However, because this is an inherently 2 dimensional concept, depending on how you weight these values you'll get different results for your optimization. Your value will only necessarily be the best value for that particular figure of merit, not for any possible figure of merit you could construct.
from katago.
Thank you, I will look into the “figure of merit” you mentioned. I appreciate you providing this line of thinking - I will try to find a good solution, especially some kind of benchmark to validate the winrates.
from katago.
I would also recommend using a newer neural net. "g170-b30c320x2-s4824661760-d1229536699.bin.gz " is very old and likely much worse than the current 18b net at https://katagotraining.org/networks/ so if you want better analysis, you can probably get an improvement for free just by upgrading.
from katago.
Thanks. I've just downloaded the highest Elo Rating Network File in the page.
from katago.
Wonderful. It seems that the results would be acceptable when maxVisits==1000. I'll try it in my code.
from katago.
I have another problem now. Which is more important for the accuracy of the win rate, maxVariationsForEachMove or maxVisits, and how to balance them to achieve higher efficiency?
from katago.
Google bard answer me as follows:
If you are playing in a tournament or other competitive setting, you should prioritize accuracy over efficiency. In this case, you should set maxVariationsForEachMove to a high value, such as 1000.
If you are playing for fun or practicing, you can prioritize efficiency over accuracy. In this case, you can reduce maxVariationsForEachMove to a lower value, such as 100 or 10.
If you are playing on a computer with limited resources, you will need to reduce both maxVariationsForEachMove and maxVisits to improve efficiency.
from katago.
"maxVariationsForEachMove" is not a parameter in KataGo, and I don't think the values given to you by bard are likely to have any meaningful use (bard is probably hallucinating and making up fake recommendations about something it doesn't understand, as LLMs tend to do). You should set maxVisits as high as you can tolerate given your compute or time budget, and as far as I know there isn't any other parameter that it should be balanced against.
from katago.
@lightvector You're right. I misunderstood the option in analyze-sgf. In that js module maxVariationsForEachMove have no effect on the accuracy. KataGo generates so many variations for a move, and the maximun variations count for a move of a SGF with the option.
from katago.
Based on my recent experiments, I've found that the optimal solution is likely to be found when the number of visits reaches around 2000.
from katago.
Related Issues (20)
- Compiled error at humansl branch on win10 VS2019 HOT 1
- Train a weight‘s weight, to predict the value of the next Katago weight HOT 3
- How to use Katago 1.14.1 with time cache? HOT 1
- Issue in training: low visit counts and strange initial conditions(board dimensions, komi settings, piece position) HOT 2
- kata-genmove_analyze with KEYVALUEPAIR not working HOT 1
- A problem building for CUDA HOT 2
- Why does lc0 ship cuda dlls with engine but katago doesn't?
- Minor document questions
- Error checks for kata-raw-human-nn HOT 1
- How to set rules to "twisted cross and eating" for beginner HOT 2
- Throwback HOT 3
- Lack of ability HOT 3
- Katago cannot give a definitive answer for the best move. HOT 2
- Report an error HOT 3
- allowResignation affects humanSL strength?? HOT 4
- Loose ladder
- katago 1.15.1 build failure HOT 1
- Do you have a plan to create a GUI? HOT 4
- kata-analyze reports a non-human-like move for the preaz_20k human profile HOT 1
- Evaluate the value of moves HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from katago.