Try passing into scipy.optimize.differential_evolution about metadsl HOT 2 CLOSED

I took a look at this function to see what we would need to "mock" to be able to turn this function into an expression graph.

One question is how we get the data into a graph, instead of a literal. The data comes from a RNG. We can pass in a custom RNG that we fake it into thinking is a numpy RNG subclass.

So that can work. But then the core flow of the algorithm is a loop with checking each iteration if we are done or not.

We cannot override this control flow and turn it into a graph. jax has the same issue, that it cannot process things like if statements if they are based on dynamic data.

So it seems like to make this library useful in passing into SciPy, we would need a way to process control flow.

Numba does this already.

If we take a step back, what we are doing is having to translate between statement blocks and an expression graph. This seems to be explored in the compiler community as translating between control flow graphs and value state dependence graphs:

cc @rgommers who brought up this original question.

from metadsl.

So it seems like to make this library useful in passing into SciPy, we would need a way to process control flow.

I think this particular problem is mostly specific to scipy.optimize. Pretty much all optimizers and root finders have this kind of tolerance-based termination of iteration. Most of the rest of SciPy does not.

The issue you'll encounter more is probably functions implemented in compiled code or calling compiled code expecting real numpy arrays under the hood.

from metadsl.