Comments (4)
Hello, I'm unable to reproduce this error with PEFT v0.1.0. Can you provide a minimal reproducible example for this?
- I did
pip install peft
- ran
from peft import LoraConfig, TaskType, get_peft_model
and it works as expected without any import errors.
from peft.
Hi @pacman100 , I was resolve this by installing peft from source(git). But I am currently facing an error due to deepspeed.
Traceback (most recent call last):
File "/home/vghorpad/LLM/peft/examples/conditional_generation/peft_lora_seq2seq_accelerate_ds_zero3_offload.py", line 375, in <module>
main()
File "/home/vghorpad/LLM/peft/examples/conditional_generation/peft_lora_seq2seq_accelerate_ds_zero3_offload.py", line 253, in main
model, train_dataloader, eval_dataloader, test_dataloader, optimizer, lr_scheduler = accelerator.prepare(
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/accelerate/accelerator.py", line 943, in prepare
result = self._prepare_deepspeed(*args)
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/accelerate/accelerator.py", line 1173, in _prepare_deepspeed
engine, optimizer, _, lr_scheduler = deepspeed.initialize(**kwargs)
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/_init_.py", line 125, in initialize
engine = DeepSpeedEngine(args=args,
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 340, in _init_
self._configure_optimizer(optimizer, model_parameters)
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1291, in _configure_optimizer
self.optimizer = self._configure_zero_optimizer(basic_optimizer)
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1594, in _configure_zero_optimizer
optimizer = DeepSpeedZeroOptimizer_Stage3(
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/runtime/zero/stage3.py", line 131, in _init_
util_ops = UtilsBuilder().load()
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/ops/op_builder/builder.py", line 462, in load
return self.jit_load(verbose)
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/ops/op_builder/builder.py", line 497, in jit_load
op_module = load(
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1284, in load
return _jit_compile(
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1508, in _jit_compile
_write_ninja_file_and_build_library(
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1623, in _write_ninja_file_and_build_library
_run_ninja_build(
File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1916, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error building extension 'utils'
Which is mentioned here - microsoft/DeepSpeed#2187
For the dataset i'm trying to use wikisql instead of twitter_complaints from ought
Is it possible to run this without deepspeed?
from peft.
Hello @ghorvish, yes, you can use it without DeepSpeed, just change the accelerate config file to not use it
from peft.
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
from peft.
Related Issues (20)
- Incorrect target modules does not error HOT 1
- Inference with different LoRA adapters in the same batch does not use the correct module_to_save classifier HOT 4
- Deprecation: Transformers will no longer support `past_key_values` to be tuples HOT 6
- Training with Multiple LoRAs HOT 4
- Changing lora_alpha during inference HOT 5
- Documentation and optimization of X-LoRA HOT 3
- MobileViT does not work with Inference with different LoRA adapters in the same batch HOT 3
- hyper-paramter `r` in adalora_confg and lora_config HOT 1
- PEFT QLoRA with DeepSpeed ZeRO3 on multiple GPUs not working as in documentation HOT 6
- AttributeError: 'NoneType' object has no attribute 'shape' HOT 14
- Merging adapters for BF16 model on CPU is very slow HOT 1
- LoraConfig.__init__() got an unexpected keyword argument 'layer_replication' when using custom model handler HOT 2
- RuntimeError: element 0 of tensors does not require grad and does not have a grad_fn HOT 1
- LoftQ init without scaling HOT 1
- Gumbel-sigmoid (poly) HOT 2
- DoRA with fsdp model cannot work HOT 14
- TypeError: WhisperForConditionalGeneration.forward() got an unexpected keyword argument 'input_ids' HOT 4
- Linear4bit not supported error when running QDoRA_finetuning.ipynb cookbook HOT 1
- Support optimum-quanto
- Lora initialisation with olora and pissa not working with quantisation. HOT 7
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from peft.