Comments (5)
use which torchrun
to make sure whether torchrun is installed and can be found.
PS, could you tell us the purpose of using this script, pretraining or finetune? thanks
from flagai.
It depends on the script itself. My thought is to follow the readme step-by-step first, getting everything working, before considering any branching
from flagai.
Update:
I've just realized
dist_trigger_docker.sh # 多机多卡运行的脚本文件,单机可选用local_trigger_docker.sh
run:
bash local_trigger_docker.sh hostfile Aquila-chat.yaml aquila-7b aquila_experiment
Other errors were produced, so for now I'm assuming the torchrun error was skipped over.. torchrun command not found It's not a concern of mine anymore.
For users with multiple GPUs, manually setting slots=1 and running bash dist_trigger_docker.sh hostfile Aquila-chat.yaml aquila-7b aquila_experiment
specifically will trigger a "torchrun command not found" error?
from flagai.
The problem that just came up:
File "/Micla/Project/FlagAI/examples/Aquila/Aquila-chat/aquila_chat.py", line 15, in <module>
from flagai.env_trainer_v1 import EnvTrainer
ModuleNotFoundError: No module named 'flagai.env_trainer_v1'
~/examples/Aquila/Aquila-chat/aquila_chat.py
from flagai.auto_model.auto_loader import AutoLoader #run ok
from flagai.data.tokenizer import Tokenizer #run ok
from flagai.env_args import EnvArgs
from flagai.env_trainer_v1 import EnvTrainer ##run error No module named 'flagai.env_trainer_v1'
import jsonlines
import numpy as np
import cyg_conversation as conversation_lib
from flagai.model.tools.peft.prepare_lora import lora_transfer ##No module named 'flagai.model.tools'
~/_init_.py is None, edit: from . import env_trainer_v1 be ineffective
edit: aquila_chat.py : import sys / sys.path.append("..") be ineffective
What more can be done?
from flagai.
Because https://github.com/FlagAI-Open/Aquila2 .issues close
from flagai.
Related Issues (20)
- [Question]: modehub中的altclip与huggingface上的altclip参数不一致 HOT 4
- [Question]: UnboundLocalError: local variable 'model_id' referenced before assignment
- [Question]: Model hub is not reachable! HOT 4
- [Question]: altclip直接运行example的inference.py报错KeyError: 'text_config' HOT 2
- [Question]: How to train the altclip model
- AquilaChat2 34B推理问题 HOT 1
- [Question]: 使用flagai AutoLoader加载AquilaChat2-7B-16K,输入英文 输出乱码 HOT 2
- 运行对话脚本aquilachat2-34b-16k 报错误 HOT 1
- Collecting PyYAML==5.4.1 (from flagai)报错 HOT 4
- [Question]: No module named 'packaging' This question is after install NVIDIA's apex HOT 1
- [Question]: 想问下AquilaDecoderLayer里的传参为什么是float的?这样是用的float类型的attention HOT 2
- Can't run examples/vit_cifar100/train_deepspeed.py HOT 1
- TypeError: AquilaPreTrainedModel._set_gradient_checkpointing() got an unexpected keyword argument 'enable' HOT 2
- How does one obtain training data suitable for fine-tuning Aquila models? HOT 2
- [Question]: 请问AltCLIP有没有提供使用Flickr30k微调及评估的脚本
- Do you have this dataset?[Question]:
- AltCLIP has no effect on CIFAR10 after finetune HOT 1
- [Question]: alm的阿拉伯语有没有文本分类的例子?
- Windows bug ModuleNotFoundError: No module named 'torch._six'
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from flagai.