leoleojie / cloudimg Goto Github PK

Sorry, I don't know Dataloader Dataset means. Maybe what I said above is not clear.
In the example above, after we get the dataset from create_dataset(config), we use data_preparation(config, dataset) to get train_data, valid data, test_data(they are all dataloader ).
During data_preparation, the interaction features in dataset will be splitted like:

built_datasets = dataset.build()
train_dataset, valid_dataset, test_dataset = built_datasets
# they are all class:`~Dataset`

And when init dataloader, it set train_data.dataset = train_dataset, valid_data.dataset =valid_dataset...
So in the example above, model = NewModel(config, train_data.dataset) . train_data.dataset is just class:~Dataset, whose interaction features has been split.