Official Pytorch Implementation
For all the methods described in the paper, is it required to have:
- Anaconda
- CLIP
Specific requirements for each method are described in its section. To install CLIP please run the following commands:
conda install --yes -c pytorch pytorch=1.7.1 torchvision cudatoolkit=<CUDA_VERSION>
pip install ftfy regex tqdm gdown
pip install git+https://github.com/openai/CLIP.git
Dataset Curation.
We create an MSCOCO and WiT Korean-Image-English Pair dataset.
Training.
python3 train.py
- Cifar10
Model | Acc. |
---|---|
KoCLIP(kor) | 15% |
Ours(kor) | 80% |
CLIP(eng) | 95% |
Demo.