Create a dataset structure where optimzer and optimzee can connect to about l2l HOT 1 OPEN

This issue is mainly related to supervised learning where a dataset is needed. Because the optimizee is stateless an easy access to certain data in the dataset is not possible from within the optimizee. Right now, the data has to be supplied by the stateful optimizer. But this is a problem for the optimzer as well since it isn't general anymore. That is where an independent structure is useful. It would allow to be accessible both to the optimizer and optimizee. The optimizer could takeover the handling of the dataset without really knowing it's contents. E.g. it would index the dataset in a standardized manner and send the index to the optimizee as well. In general this is similar to a model view controller design.

from l2l.