DocOwl1.5 training code? about mplug-docowl HOT 12 OPEN

@HAWLYQ can you test for deepspeed stage 3 integrations, specifically for deadlock issues while training/fine-tuning?

Hi, @AR-javis , I'm debugging with deepspeed zero3~ I will try my best to release it within a week~

from mplug-docowl.

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

from mplug-docowl.

Hi, @coder4nlp @whalefa1I @AR-javis We have released training codes for finetuning docowl1.5 in https://github.com/X-PLUG/mPLUG-DocOwl/tree/main/DocOwl1.5. It's temporarily supported by DeepSpeed zero2. We meet deadlock issues with zero3, if you have any suggestions to share with us, we will appreciate very much~

from mplug-docowl.

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

almost there！

from mplug-docowl.

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

almost there！

training codes with DeepSpeed is under debugging and testing ｡ﾟ･ (>﹏<) ･ﾟ｡

from mplug-docowl.

Hi, @coder4nlp , the training code is scheduled for release at the end of this month. If you are urgent to finetune our model, you can refer to the training code of mPLUG-Owl2 and make some revisions to adjust to our model. Some hyper-parameters can refer to our paper.

almost there！

training codes with DeepSpeed is under debugging and testing ｡ﾟ･ (>﹏<) ･ﾟ｡

@HAWLYQ So sad......｡ﾟ･ (>﹏<) ･ﾟ｡

from mplug-docowl.

@HAWLYQ can you test for deepspeed stage 3 integrations, specifically for deadlock issues while training/fine-tuning?

from mplug-docowl.

where are the schedules?

from mplug-docowl.

where are the schedules?

Within this week~

from mplug-docowl.

@HAWLYQ Thank you very much!

from mplug-docowl.

hello, how about the venv requirements? I've not seen the requirements.txt.

from mplug-docowl.

hello, how about the venv requirements? I've not seen the requirements.txt.

Hi, @Coobiw , our environment is the same as mPLUG-Owl2, you can follow instructions at https://github.com/X-PLUG/mPLUG-Owl/tree/main/mPLUG-Owl2 to prepare environments.

from mplug-docowl.