Tensorflow version about moco-v3 HOT 7 CLOSED

@MukundVarmaT it's in https://github.com/ronghanghu/simclr_vit_profiling/tree/mocov3_vit_release

from moco-v3.

We have not released and there is no plan to release the code. This implementation is supposed to be a faithful re-implementation of the TPU code, with details such as initialization (though still subject to framework differences).

from moco-v3.

The mmf team (https://github.com/facebookresearch/mmf), specifically @ronghanghu have a good implementation of MoCo v3 using PyTorch XLA, which could be a good starting point on TPUs. Maybe good to check about their plan for releasing it.

from moco-v3.

Thanks!

from moco-v3.

@wildphoton I can share with you a copy of our TPU implementation w/ PyTorch XLA if you are interested.

from moco-v3.

@wildphoton I can share with you a copy of our TPU implementation w/ PyTorch XLA if you are interested.

Sure. It would be great to have access to it!

from moco-v3.

hi @ronghanghu @wildphoton,
Can you please share the TPU implementation w/ torch xla? If it's already hosted on a different repo, could you please point me to the same?

Thanks in advance.

from moco-v3.