Comments (2)
So, npopulations=nothing
will trigger npopulations=nworkers()
as expected. Note that -t 5
creates 5 threads, whereas -p 5
creates 5 processes. The latter is what will produce the correct number of populations.
However, if you are manually creating processes like that, you will need to declare everything with Distributed.@everywhere
, since SymbolicRegression.jl won't set it up automatically then.
So this may be a mistake on my part, because when getting SR to set up the processes with numprocs
, it is not correcting the number of populations. This is also problematic since you can pass multithreading=True
to EquationSearch, in which case the number of populations should match the threads rather than the workers... will see what I can do. I note that Options
is immutable, so it would probably need to be re-created after calling EquationSearch, which might introduce other issues...
Maybe the easiest solution is to just fix the number of populations to 20 or 40, as done in PySR, since that makes pipelines more reproducible!
from symbolicregression.jl.
Oh right, thank you for the answer.
Yeah I found a bit confusing the distributed-options logic, but that could definitely be just me since I'm clearly not very familiar yet with how parallel things can be handled on Julia. Glad to at least have nudged you to think about that loophole.
Thanks again!
from symbolicregression.jl.
Related Issues (20)
- [Feature]: Faster optimization of constants HOT 1
- SymbolicRegression.jl paper is out!
- [Feature]: can I design a custom operator for sequence data? HOT 1
- [Bug]: Threading always seems slower than multiprocessing
- [BUG]: method error when used in the debugger HOT 20
- Should use `errormonitor` on tasks for distributed mode
- [Feature]: MLJ integration HOT 3
- [Feature]: ternary operators HOT 3
- Should use scale of data when mutating or creating constants
- [BUG]: `Options` not updated in `MLJ.fit`
- Garbage collection too passive on worker processes HOT 3
- [Feature]: Including Units Evaluating Model Performance and Controlling Iterative Models Example :MLJ HOT 10
- Whether SR.jl can Implement this ARZ algorithm ? HOT 1
- Silence warnings for Optim.jl HOT 1
- Multidimensional equations HOT 4
- How do I set up a basis function consisting of three different inputs x, y, z? HOT 2
- Unique solution of Regression HOT 1
- How can I set the maximum number of nests? HOT 4
- [Feature]: Proper caching
- [Feature]: Training on high dimensions X HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from symbolicregression.jl.