Git Product home page Git Product logo

Comments (5)

dachengx avatar dachengx commented on July 18, 2024 1

This is important if one did not save the toydata, and see sth. weird a specific toy. So it should be implemented as:

  1. Save the seed of each toydata(actually of each randomization), when we do or do not specify the seed
  2. Give StatisticalModel a way to specify a seed when we debug for a toydataset

Usually, we do not specify a see. This is OK and recommended, because one is likely to forget the seed is set and generate the same toydatasets. So it is helpful to save the seed of toydata.

Even without a discussion of the details, we can not admit that we are not able to reproduce the toydata of alea. I think this is crucial, the reproducibility.

from alea.

kdund avatar kdund commented on July 18, 2024 1

That said, this can be very useful for debugging, it is a nice thing to want, but I do not think it is a requirement for valid inference or alea1.0

from alea.

hammannr avatar hammannr commented on July 18, 2024

Hmm.. Is this required? It's not so much relevant to reproduce one single toy experiment but more the collective result of a bunch of toyMC runs, which should be given anyways or not? I guess if something weird happens it is nice though and also for examples. Does it make sense to define it in the statistical_model config?

from alea.

dachengx avatar dachengx commented on July 18, 2024

Technical details as reference: https://stackoverflow.com/questions/32172054/how-can-i-retrieve-the-current-seed-of-numpys-random-number-generator

from alea.

kdund avatar kdund commented on July 18, 2024

We do not rely on individual toyMCs for the correctness of our results-- we generate enough that we have some confidence that the statistical fluctuation of the toyMC method are smaller than the precision we need. Our results are reproducible even if individual toyMCs are not.

(similarly, our nT results are reproducible even if we will never get the exact data both times!)

from alea.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.