The cornell-birdcall-identification from satyaborg

cornell-birdcall-identification's Introduction

Greetings, wanderer

I am deeply passionate about programming, building things and always up for exchanging ideas and indulging in a few thought bubbles.

Artificial intelligence fascinates me: the unexplored recesses of human ingenuity, the augmentation of our collective intelligence, a universal problem solver in some sense and its implications (ethical or otherwise). The road is long and winding, but I hope it will provide a window into understanding our own cognition along the way.

If you would like to chat or collaborate please feel free to shoot me an email. Where there are synergies, creativity often follows.

📫 You can connect with me on:

cornell-birdcall-identification's People

Contributors

Stargazers

Watchers

cornell-birdcall-identification's Issues

Fix preprocessor

Need to finish the code for preprocessing (resampling audio files).
Note: File have been already preprocessed but needed as a module for future.

Dataset imbalance

In addition to stratified sampling decide on N max samples per class (some classes have > 1k samples).

TypeError: zip argument #2 must support iteration

Running python train.py throws up the above type error.

`
[Errno 2] No such file or directory: 'data/resampled_audio/comrav/XC487895.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/comter/XC501183.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/comrav/XC479722.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/pinsis/XC196470.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/plsvir/XC575604.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/blujay/XC70942.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/spotow/XC287515.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/amerob/XC16935.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/houwre/XC343091.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/carwre/XC396437.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/whtspa/XC199438.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/norcar/XC313079.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/brwhaw/XC530588.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/easblu/XC545796.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/blujay/XC149338.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/woothr/XC572252.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/amerob/XC187308.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/purfin/XC227791.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/sonspa/XC256777.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/barswa/XC472363.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/canwre/XC218667.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/ovenbi1/XC317995.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/indbun/XC278111.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/herthr/XC283200.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/grycat/XC327612.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/redcro/XC391896.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/marwre/XC156741.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/hoowar/XC237267.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/sonspa/XC31272.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/purfin/XC294789.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/grcfly/XC496491.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/eursta/XC358011.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/warvir/XC455397.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/comter/XC182899.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/amecro/XC156835.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/grtgra/XC539394.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/whtspa/XC429253.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/wesmea/XC355388.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/redcro/XC424157.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/amewig/XC519789.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/lesgol/XC560212.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/ruckin/XC153885.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/redcro/XC400080.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/spotow/XC135313.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/redcro/XC347709.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/wesmea/XC357087.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/y00475/XC546225.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/comter/XC431294.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/pingro/XC505873.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/herthr/XC446628.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/houwre/XC132928.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/amerob/XC423450.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/rewbla/XC331425.npy'
[Errno 2] No such file or directory: 'data/resampled_audio/houwre/XC419091.npy'

Traceback (most recent call last):
File "train.py", line 11, in
trainer.run()
File "/home/hari/Desktop/Hari/Ongoing Projects/Kaggle/kaggle/cornell-birdcall-identification/src/trainer.py", line 261, in run
self.train(dataset)
File "/home/hari/Desktop/Hari/Ongoing Projects/Kaggle/kaggle/cornell-birdcall-identification/src/trainer.py", line 150, in train
for step, (images, labels) in enumerate(trainloader):
File "/home/hari/anaconda3/envs/kaggle/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 637, in next
return self._process_next_batch(batch)
File "/home/hari/anaconda3/envs/kaggle/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 658, in _process_next_batch
raise batch.exc_type(batch.exc_msg)
TypeError: Traceback (most recent call last):
File "/home/hari/anaconda3/envs/kaggle/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 138, in _worker_loop
samples = collate_fn([dataset[i] for i in batch_indices])
File "/home/hari/anaconda3/envs/kaggle/lib/python3.7/site-packages/torch/utils/data/dataloader.py", line 231, in default_collate
transposed = zip(*batch)
`

I think the reason for the error is that non-iterable None is returned by the DataLoader for the above missing files. Downloading the extended dataset should probably work. Trying that out.