Git Product home page Git Product logo

Comments (4)

pacman100 avatar pacman100 commented on August 27, 2024

Hello, I'm unable to reproduce this error with PEFT v0.1.0. Can you provide a minimal reproducible example for this?

  1. I did pip install peft
  2. ran from peft import LoraConfig, TaskType, get_peft_model and it works as expected without any import errors.

from peft.

ghorvish avatar ghorvish commented on August 27, 2024

Hi @pacman100 , I was resolve this by installing peft from source(git). But I am currently facing an error due to deepspeed.

Traceback (most recent call last):
  File "/home/vghorpad/LLM/peft/examples/conditional_generation/peft_lora_seq2seq_accelerate_ds_zero3_offload.py", line 375, in <module>
    main()
  File "/home/vghorpad/LLM/peft/examples/conditional_generation/peft_lora_seq2seq_accelerate_ds_zero3_offload.py", line 253, in main
    model, train_dataloader, eval_dataloader, test_dataloader, optimizer, lr_scheduler = accelerator.prepare(
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/accelerate/accelerator.py", line 943, in prepare
    result = self._prepare_deepspeed(*args)
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/accelerate/accelerator.py", line 1173, in _prepare_deepspeed
    engine, optimizer, _, lr_scheduler = deepspeed.initialize(**kwargs)
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/_init_.py", line 125, in initialize
    engine = DeepSpeedEngine(args=args,
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 340, in _init_
    self._configure_optimizer(optimizer, model_parameters)
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1291, in _configure_optimizer
    self.optimizer = self._configure_zero_optimizer(basic_optimizer)
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/runtime/engine.py", line 1594, in _configure_zero_optimizer
    optimizer = DeepSpeedZeroOptimizer_Stage3(
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/runtime/zero/stage3.py", line 131, in _init_
    util_ops = UtilsBuilder().load()
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/ops/op_builder/builder.py", line 462, in load
    return self.jit_load(verbose)
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/deepspeed/ops/op_builder/builder.py", line 497, in jit_load
    op_module = load(
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1284, in load
    return _jit_compile(
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1508, in _jit_compile
    _write_ninja_file_and_build_library(
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1623, in _write_ninja_file_and_build_library
    _run_ninja_build(
  File "/home/vghorpad/LLM/venv_llm/lib/python3.10/site-packages/torch/utils/cpp_extension.py", line 1916, in _run_ninja_build
    raise RuntimeError(message) from e
RuntimeError: Error building extension 'utils'

Which is mentioned here - microsoft/DeepSpeed#2187
For the dataset i'm trying to use wikisql instead of twitter_complaints from ought
Is it possible to run this without deepspeed?

from peft.

pacman100 avatar pacman100 commented on August 27, 2024

Hello @ghorvish, yes, you can use it without DeepSpeed, just change the accelerate config file to not use it

from peft.

github-actions avatar github-actions commented on August 27, 2024

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

from peft.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.