Git Product home page Git Product logo

jtr-cvpr-2024's Introduction

[CVPR 2024] Joint-Task Regularization for Partially Labeled Multi-Task Learning

Updates

  • June 2024: Code released for Cityscapes onelabel.
  • May 2024: Code released for NYUv2 onelabel and randomlabels.
  • May 2024: Website updated with the CVPR poster and video.
  • April 2024: Paper website published at kentonishi.com/JTR-CVPR-2024.

Usage

Setup

First, download the dataset following the instructions in the MTPSL repository.

Training JTR

Code for training JTR is stored in the ./code directory. Some example commands are provided below:

cd code

# NYUv2 onelabel
python train_nyuv2.py \
  --data-dir [/some/data/dir] \
  --out-dir [/some/output/dir/nyuv2_onelabel] \
  --ssl-type onelabel \
  --label-dir ./data/nyuv2_settings \
  --seg-baseline 25.75 --depth-baseline 0.6511 --norm-baseline 33.73

# NYUv2 randomlabels
python train_nyuv2.py \
  --data-dir [/some/data/dir] \
  --out-dir [/some/output/dir/nyuv2_randomlabels] \
  --ssl-type randomlabels \
  --label-dir ./data/nyuv2_settings \
  --seg-baseline 27.05 --depth-baseline 0.6626 --norm-baseline 33.58

# Cityscapes onelabel
python train_cityscapes.py \
  --data-dir [/some/data/dir] \
  --out-dir [/some/output/dir/cityscapes_onelabel] \
  --label-dir ./data/cityscapes_settings \
  --seg-baseline 69.50 --depth-baseline 0.0186

Patching MTPSL

For convenience, we provide a git patch (./code/patches/mtpsl.patch) to modify the MTPSL training code with our dataloader parameters. You can apply the patch as follows:

git clone [email protected]:VICO-UoE/MTPSL.git
cd MTPSL
git apply /path/to/mtpsl.patch

After applying the patch, you can simply run the commands in the MTPSL repository's README.

Contact

If you have any questions, please contact Kento Nishi and Junsik Kim at [email protected] and [email protected].

Citation

If you find this code useful, please consider citing our paper:

@misc{nishi2024jointtask,
    title={Joint-Task Regularization for Partially Labeled Multi-Task Learning}, 
    author={Kento Nishi and Junsik Kim and Wanhua Li and Hanspeter Pfister},
    year={2024},
    eprint={2404.01976},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}

jtr-cvpr-2024's People

Contributors

kentonishi avatar

Stargazers

xyz avatar Youngtaek Oh avatar Andy Jeong avatar Junsik Kim avatar Ronak Badhe avatar  avatar  avatar Zedong Wang avatar Doğuş Can Korkmaz avatar Wanhua Li avatar

Watchers

Kostas Georgiou avatar  avatar

jtr-cvpr-2024's Issues

Question about how to select the best result

Thank you for your great work.
I am running this code, but I have a question. How can I get the best results? Since there are only train and test sets, what we need to do is to find the best delta from these 400 epochs? If you could answer my question, I would greatly appreciate it.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.