Difference between cache and persist about steppy HOT 2 CLOSED

Hi @tankz0r you in this case it is the same.

In larger pipelines we use it is this way:

pipeline = PIPELINES[pipeline_name](config=cfg.SOLUTION_CONFIG, train_mode=True)
pipeline.clean_cache()
logger.info('Start pipeline fit and transform')
pipeline.fit_transform(train_data)
pipeline.clean_cache()

So we make sure that we have clean cache directory before we run experiment :)

Also, we are going to change it in such a way, that cache will be in memory. For example interface like: Step.cache that will contain output from transformer.

from steppy.

seems like question is covered. Closing this :)

from steppy.