conceptofmind / lamda-rlhf-pytorch Goto Github PK
View Code? Open in Web Editor NEWOpen-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
License: MIT License
Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
License: MIT License
i try to find "pip install"
Hi, is there any plan to add a requirement.txt that allows us to install needed packages with pip? Thanks.
Could you upload a pre trained model for those with less powerful GPUs, You could upload to Hugging face. Thanks. I just want a ChatGPT Alternative that can run locally and have a chat with the model (like in the image) Thanks
Traceback (most recent call last):
File "C:\Users\HoxtonR\Desktop\LaMDA\LaMDA-pytorch-main\test.py", line 1, in
from lamda_pytorch.lamda_pytorch import LaMDA
File "C:\Users\HoxtonR\Desktop\LaMDA\LaMDA-pytorch-main\lamda_pytorch_init_.py", line 1, in
from lamda_pytorch.lamda_pytorch import LaMDA
File "C:\Users\HoxtonR\Desktop\LaMDA\LaMDA-pytorch-main\lamda_pytorch\lamda_pytorch.py", line 9, in
from config.config import CFG
ModuleNotFoundError: No module named 'config'
Hi, this is a great project. Can you provide some sample data for local development testing? I want to test it out. thank you very much!
Hi so i tell you the problem:
i clone the repo
i cd into it
i run python3 train.py
i get dependencies errors
i go to repo isssue tab
i see the requirement.txt issue
i go there
i see the list of required package to run this by a random guy
i pip install those
i rerun
i get this:
Traceback (most recent call last):
File "/home/vscode/lamda/LaMDA-rlhf-pytorch/train.py", line 4, in
from colossalai.core import global_context as gpc
ModuleNotFoundError: No module named 'colossalai.core'
Im on debian using the latest version of python, i use system wide installed packages with pip. i tried with venv it didnt work better.
pip list returns:
Package Version
aiohttp 3.9.3
aiosignal 1.3.1
annotated-types 0.6.0
appdirs 1.4.4
attrs 23.2.0
bcrypt 4.1.2
beautifulsoup4 4.12.3
certifi 2022.9.24
cffi 1.16.0
cfgv 3.4.0
chardet 5.1.0
charset-normalizer 3.0.1
click 8.1.7
colossalai 0.3.5
contexttimer 0.3.3
cryptography 38.0.4
cupshelpers 1.0
datasets 2.17.0
dbus-python 1.3.2
debtcollector 2.5.0
decorator 5.1.1
Deprecated 1.2.13
dill 0.3.8
distlib 0.3.8
distro 1.8.0
docker-pycreds 0.4.0
docutils 0.19
einops 0.7.0
fabric 3.2.2
filelock 3.13.1
frozenlist 1.4.1
fsspec 2023.10.0
gitdb 4.0.11
GitPython 3.1.41
google 3.0.0
greenlet 2.0.2
huggingface-hub 0.20.3
identify 2.5.34
idna 3.3
importlib-metadata 4.12.0
invoke 2.2.0
iso8601 1.0.2
Jinja2 3.1.3
jsonschema 4.21.1
jsonschema-specifications 2023.12.1
jwcrypto 1.1
markdown-it-py 3.0.0
MarkupSafe 2.1.5
mdurl 0.1.2
more-itertools 8.10.0
mpmath 1.3.0
msgpack 1.0.3
multidict 6.0.5
multiprocess 0.70.16
netaddr 0.8.0
netifaces 0.11.0
networkx 3.2.1
ninja 1.11.1.1
nodeenv 1.8.0
numpy 1.24.2
olefile 0.46
oslo.config 9.0.0
oslo.context 5.0.0
oslo.i18n 5.1.0
oslo.log 5.0.1
oslo.serialization 5.0.0
oslo.utils 6.0.1
packaging 23.0
pandas 2.2.0
paramiko 3.4.0
pbr 5.10.0
Pillow 9.4.0
pip 23.0.1
platformdirs 4.2.0
pre-commit 3.6.1
protobuf 4.25.2
psutil 5.9.4
pyarrow 15.0.0
pyarrow-hotfix 0.6
pycairo 1.20.1
pycparser 2.21
pycups 2.0.1
pydantic 2.6.1
pydantic_core 2.16.2
Pygments 2.14.0
PyGObject 3.42.2
pyinotify 0.9.6
PyNaCl 1.5.0
pynvim 0.4.2
pyparsing 3.0.9
pysmbc 1.0.23
python-dateutil 2.8.2
python-novnc 1.0.0
pytz 2022.7.1
PyYAML 6.0
ray 2.9.2
referencing 0.33.0
regex 2023.12.25
requests 2.28.1
rfc3986 1.5.0
rich 13.7.0
roman 3.3
rpds-py 0.17.1
safetensors 0.4.2
sentencepiece 0.1.99
sentry-sdk 1.40.3
setproctitle 1.3.3
setuptools 66.1.1
six 1.16.0
smmap 5.0.1
soupsieve 2.5
stevedore 4.0.2
sympy 1.12
tokenizers 0.15.1
torch 2.2.0
tqdm 4.66.2
transformers 4.37.2
typing_extensions 4.9.0
tzdata 2023.4
urllib3 1.26.12
virtualenv 20.25.0
wandb 0.16.3
websockify 0.10.0
wheel 0.38.4
wrapt 1.14.1
xxhash 3.4.1
yarl 1.9.4
zipp 1.0.0
Great work. It was mentioned in the paper that it will search for relevant knowledge and use knowledge to answer. Is there a part about knowledge search in this source code?
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.