Git Product home page Git Product logo

Comments (4)

greeshmasmenon avatar greeshmasmenon commented on July 26, 2024

This used to work before. Now, I am also getting a similar error when i try to read a .gz file.

For example:

import DALI as dali_code
dali_code.get_info("data/DALI_v1.0/info/DALI_DATA_INFO.gz")

The above results in the following error :

Traceback (most recent call last):
  File "..../venv/lib/python3.10/site-packages/DALI/utilities.py", line 110, in read_gzip
    output = pickle.load(f)
_pickle.UnpicklingError: invalid load key, ','.

Can someone help with the above?

from dali.

gabolsgabs avatar gabolsgabs commented on July 26, 2024

Hello,
Sorry for the late reply. I cannot reproduce the error:

import DALI as dali_code
dali_code.get_info(os.path.abspath("my_path_to_dali/DALI_v1.0/info/DALI_DATA_INFO.gz"))

array([['DALI_ID', 'NAME', 'YOUTUBE', 'WORKING'],
       ['e186227bb7474fa5a7738c9108f11972', 'Staind-Tangled_Up_In_You',
        'NXG-ayocugI', 'True'],
       ['520f583def024997adcab0567fb25a5d',
        'Boyzone-Baby_Can_I_Hold_You', 'ZjSLNZ9MsMI', 'True'],

have you downloaded the dataset at zenodo?

from dali.

greeshmasmenon avatar greeshmasmenon commented on July 26, 2024

Yes, I downloaded the data from Zenodo. I tried the same thing again and getting the error -

/tmp/ipykernel_156/2346031491.py in get_information(self)
     92         logging.info(f"Getting the info related to the data from the data_path = {self._info_path}")
     93         if self._info_path is not None:
---> 94             dali_info = dali_code.get_info(self._info_path)
     95             dali_df = pd.DataFrame(dali_info)[1:]
     96             dali_df.columns = dali_info[0]

~/.conda/envs/default/lib/python3.9/site-packages/DALI/main.py in get_info(dali_info_file)
     87     """Read the DALI INFO file with ['DALI_ID', 'YOUTUBE_ID', 'WORKING']
     88     """
---> 89     return ut.read_gzip(dali_info_file, print_error=True)
     90 
     91 

~/.conda/envs/default/lib/python3.9/site-packages/DALI/utilities.py in read_gzip(fl, print_error)
    111         except Exception as e:
    112             with gzip.open(fl, 'r') as f:
--> 113                 output = pickle.load(f)
    114     return output
    115 

UnpicklingError: invalid load key, ','.

Can you give me access once again through zenodo so that i can download a new copy of v1.0 ?

from dali.

Related Issues (9)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.