Remove unnecessary loading of validation data to memory about importance-sampling HOT 2 OPEN

I agree it is problematic and it needs to be changed. The simplest solution I can think of is to do an external for loop and evaluate the unwrapped model. Something like the following:

model = .....
wrapped = ImportanceTraining(model)
for i in range(epochs):
    wrapped.fit(...)
    model.evaluate(...)

from importance-sampling.

This is problematic - it makes validation completely impossible in some cases, eg when using generators that load heavy images! Is there any way to get around this?

from importance-sampling.