Git Product home page Git Product logo

Comments (2)

MilesCranmer avatar MilesCranmer commented on May 18, 2024

So, npopulations=nothing will trigger npopulations=nworkers() as expected. Note that -t 5 creates 5 threads, whereas -p 5 creates 5 processes. The latter is what will produce the correct number of populations.

However, if you are manually creating processes like that, you will need to declare everything with Distributed.@everywhere, since SymbolicRegression.jl won't set it up automatically then.

So this may be a mistake on my part, because when getting SR to set up the processes with numprocs, it is not correcting the number of populations. This is also problematic since you can pass multithreading=True to EquationSearch, in which case the number of populations should match the threads rather than the workers... will see what I can do. I note that Options is immutable, so it would probably need to be re-created after calling EquationSearch, which might introduce other issues...

Maybe the easiest solution is to just fix the number of populations to 20 or 40, as done in PySR, since that makes pipelines more reproducible!

from symbolicregression.jl.

cobac avatar cobac commented on May 18, 2024

Oh right, thank you for the answer.

Yeah I found a bit confusing the distributed-options logic, but that could definitely be just me since I'm clearly not very familiar yet with how parallel things can be handled on Julia. Glad to at least have nudged you to think about that loophole.

Thanks again!

from symbolicregression.jl.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.