Git Product home page Git Product logo

clip-iqa's Introduction

Exploring CLIP for Assessing the Look and Feel of Images (AAAI 2023)

Paper

visitors

Jianyi Wang, Kelvin C.K. Chan, Chen Change Loy

S-Lab, Nanyang Technological University

TODO

  • Colab demo
  • MMEditing update
  • Code release

Dependencies and Installation

The same as MMEditing, support the latest version 0.16.1.

# Create a conda environment and activate it
conda create -n clipiqa python=3.8 -y
conda activate clipiqa
# Install PyTorch following official instructions, e.g.
conda install pytorch=1.10 torchvision cudatoolkit=11.3 -c pytorch
# Install pre-built MMCV using MIM.
pip3 install openmim
mim install mmcv-full==1.5.0
# Install CLIP-IQA from the source code.
git clone [email protected]:IceClear/CLIP-IQA.git
cd CLIP-IQA
pip install -r requirements.txt
pip install -e .

Running Examples

Test CLIP-IQA on KonIQ-10k

python demo/clipiqa_koniq_demo.py

Test CLIP-IQA on Live-iWT

python demo/clipiqa_liveiwt_demo.py

Train CLIP-IQA+ on KonIQ-10k

# Support dist training as MMEditing
python tools/train.py configs/clipiqa/clipiqa_coop_koniq.py

Test CLIP-IQA+ on KonIQ-10k (Checkpoint)

python demo/clipiqa_koniq_demo.py --config configs/clipiqa/clipiqa_coop_koniq.py --checkpoint ./iter_80000.pth

[Note] You may change prompts for different datasets, please refer to config files for details.

[Note] For testing on a single image, please refer to here for details.

Demo

✨ Versatile Quality Assessment

✨ Demo for IQA on SPAQ

✨ Demo for Abstract Perception on AVA

For more evaluation, please refer to our paper for details.

Citation

If our work is useful for your research, please consider citing:

@inproceedings{wang2022exploring,
    author = {Wang, Jianyi and Chan, Kelvin CK and Loy, Chen Change},
    title = {Exploring CLIP for Assessing the Look and Feel of Images},
    booktitle = {AAAI},
    year = {2023}
}

License

This project is licensed under NTU S-Lab License 1.0. Redistribution and use should follow this license.

Acknowledgement

This project is based on MMEditing and CLIP. Thanks for their awesome works.

Contact

If you have any question, please feel free to reach me out at [email protected].

clip-iqa's People

Contributors

vicdxxx avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.