Adding CLIPSeg to HuggingFace Transformers 🤗 about clipseg HOT 6 CLOSED

CLIPSeg is now available here: https://huggingface.co/docs/transformers/main/en/model_doc/clipseg.

Would be highly appreciated if you add a mention to it in the README 🙏

from clipseg.

Hi Niels,

I'm glad you like our method and thanks for integrating it into HF Transformers! I guess, providing the weights under your user is fine for now.

from clipseg.

I've created a CIDAS organization on the hub, feel free to join :)

https://huggingface.co/CIDAS

from clipseg.

@NielsRogge Hey, could you clarify one minor thing to me? This repo in the Quickstart.ipynb uses normalization with Imagenet mean/std, while the HF version used the normalization to [-1, 1] according to this. Which normalization is correct for the images?

I've seen that you've ported the weights somehow, but didn't you do something with the fact that different nomalization was used?

Also it's confusing that here you use Imagenet mean/std for tests.

upd. after few test it seem that this is really a bug and default processors params at HF are incorrect

from clipseg.

Hi,

Thanks for flagging. I'll update the mean and std of the checkpoints on the hub. Visually I don't see any differences though.

from clipseg.

The difference is minor, because the models in general a very robust to such things as slightly scaled inputs, but still it's better to use correct norm :) thanks for a quick fix

from clipseg.