Files download from the given <a href="https://ai.google.com/research/ConceptualCaptio

Besides, to correspond the file names, I change the code as: <div class="snippet-c

CC3M data error about frozen-in-time HOT 3 CLOSED

m-bain commented on August 15, 2024

CC3M data error

from frozen-in-time.

Comments (3)

akira-l commented on August 15, 2024

Besides, to correspond the file names, I change the code as:

        # download specific
        split_files = {
            #'train': 'Train_GCC-training-success-020321-VALIDIMG.csv',
            #'train': 'Train_GCC-training.tsv',
            'train': 'Image_Labels_Subset_Train_GCC-Labels-training.tsv',
            #'val': 'Validation_GCC-1.1.0-Validation-success-020321-VALIDIMG.csv',
            'val': 'Validation_GCC-1.1.0-Validation.tsv',
            # there is no test
            #'test': 'Validation_GCC-1.1.0-Validation-success-020321-VALIDIMG.csv'
            'val': 'Validation_GCC-1.1.0-Validation.tsv',
        }

from frozen-in-time.

m-bain commented on August 15, 2024

These files are specific to my server, I changed them and removed broken links.
CC3M is using .tsv format (tab separated).
So change L24 in https://github.com/m-bain/frozen-in-time/blob/main/data_loader/ConceptualCaptions_dataset.py
metadata = pd.read_csv(os.path.join(self.metadata_dir, target_split_fp))
to
metadata = pd.read_csv(os.path.join(self.metadata_dir, target_split_fp), sep='\t')

from frozen-in-time.

akira-l commented on August 15, 2024

Thanks for your reply. I change the code as your suggestions, but still get a keyerror as:

  File "/opt/conda/lib/python3.8/site-packages/pandas/core/indexes/base.py", line 3623, in get_loc
  raise KeyError(key) from err
KeyError: 'thumbnailUrl'

Can you share the tsv files in your experiments ?

from frozen-in-time.

Recommend Projects