Git Product home page Git Product logo

Comments (8)

SpongebBob avatar SpongebBob commented on July 21, 2024 3

默认的配置我用了8个40GB的A100。

from finetune-chatglm2-6b.

wac81 avatar wac81 commented on July 21, 2024

2个40g就可以

from finetune-chatglm2-6b.

Alwin4Zhang avatar Alwin4Zhang commented on July 21, 2024

2个40g就可以

有开源吗？

from finetune-chatglm2-6b.

ustbliubo2014 avatar ustbliubo2014 commented on July 21, 2024

2个40g就可以

这个是用的原始的配置吗？我用 4 个 A00 仍然 GPU 不够， out of memory

from finetune-chatglm2-6b.

resehist avatar resehist commented on July 21, 2024

训练了多久呢？

from finetune-chatglm2-6b.

wac81 avatar wac81 commented on July 21, 2024

用dp zero 2， 长度拉小点一般256-512就够了，我用2个40g，4个3090 都测试过，可以跑，如果跑一半不可以，就可能是长度问题。

from finetune-chatglm2-6b.

wac81 avatar wac81 commented on July 21, 2024

2个40g就可以

这个是用的原始的配置吗？我用 4 个 A00 仍然 GPU 不够， out of memory

检查cpu的内存，不一定是显存不够

from finetune-chatglm2-6b.

dlxj avatar dlxj commented on July 21, 2024

用dp zero 2， 长度拉小点一般256-512就够了，我用2个40g，4个3090 都测试过，可以跑，如果跑一半不可以，就可能是长度问题。

麻烦能贴一下详细的参数配置吗，我用 4 卡 24G 的 A5000 一直爆显存, CPU 内存是 80G

from finetune-chatglm2-6b.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.