Potential confusion about where start timesteps are collected in HL interfaces about tianshou HOT 4 CLOSED

I will close it, we can discuss later, when the refactoring of experiment is closer to being merged.

Just didn't want to close without an explanation, since you likely got an email before I did the edit

from tianshou.

How can there be any confusion? The agent factory's create method is not a method a user is likely to ever call, as the high-level API performs all object creation tasks behind the scenes. And the prefilling of the collector is clearly logged, after all, so I don't really see how it could create any confusion.

The reasoning is that the creation method is supposed to provide collectors that can directly be used for training. So if the collectors shall be prefilled before the training begins, then the method takes care of that.

from tianshou.

Let's discuss in a call, this arose in an experimental refactoring of the experiment where the pre-filling behavior on creation gets in the way

from tianshou.

So what is this issue really about? Specifying the number of episodes instead of steps?
Please update the description and delete the superfluous/outdated stuff.

from tianshou.