Git Product home page Git Product logo

private-chatbot-mpt30b-langchain's People

Contributors

mayooear avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

private-chatbot-mpt30b-langchain's Issues

Error trying ingest.py

When I try to run "python3 ingest.py" I get this error:

Traceback (most recent call last):
  File "/home/ubuntu/private-chatbot-mpt30b-langchain/ingest.py", line 7, in <module>
    from langchain.docstore.document import Document
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/__init__.py", line 6, in <module>
    from langchain.agents import MRKLChain, ReActChain, SelfAskWithSearchChain
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/agents/__init__.py", line 2, in <module>
    from langchain.agents.agent import (
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/agents/agent.py", line 16, in <module>
    from langchain.agents.tools import InvalidTool
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/agents/tools.py", line 8, in <module>
    from langchain.tools.base import BaseTool, Tool, tool
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/tools/__init__.py", line 3, in <module>
    from langchain.tools.arxiv.tool import ArxivQueryRun
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/tools/arxiv/tool.py", line 12, in <module>
    from langchain.utilities.arxiv import ArxivAPIWrapper
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/utilities/__init__.py", line 3, in <module>
    from langchain.utilities.apify import ApifyWrapper
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/utilities/apify.py", line 5, in <module>
    from langchain.document_loaders import ApifyDatasetLoader
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/document_loaders/__init__.py", line 44, in <module>
    from langchain.document_loaders.embaas import EmbaasBlobLoader, EmbaasLoader
  File "/home/ubuntu/.local/lib/python3.10/site-packages/langchain/document_loaders/embaas.py", line 54, in <module>
    class BaseEmbaasLoader(BaseModel):
  File "pydantic/main.py", line 204, in pydantic.main.ModelMetaclass.__new__
  File "pydantic/fields.py", line 488, in pydantic.fields.ModelField.infer
  File "pydantic/fields.py", line 419, in pydantic.fields.ModelField.__init__
  File "pydantic/fields.py", line 539, in pydantic.fields.ModelField.prepare
  File "pydantic/fields.py", line 801, in pydantic.fields.ModelField.populate_validators
  File "pydantic/validators.py", line 696, in find_validators
  File "pydantic/validators.py", line 585, in pydantic.validators.make_typeddict_validator
  File "pydantic/annotated_types.py", line 35, in pydantic.annotated_types.create_model_from_typeddict
  File "pydantic/main.py", line 972, in pydantic.main.create_model
  File "pydantic/main.py", line 204, in pydantic.main.ModelMetaclass.__new__
  File "pydantic/fields.py", line 488, in pydantic.fields.ModelField.infer
  File "pydantic/fields.py", line 419, in pydantic.fields.ModelField.__init__
  File "pydantic/fields.py", line 534, in pydantic.fields.ModelField.prepare
  File "pydantic/fields.py", line 638, in pydantic.fields.ModelField._type_analysis
  File "/usr/lib/python3.10/typing.py", line 1158, in __subclasscheck__
    return issubclass(cls, self.__origin__)
TypeError: issubclass() arg 1 must be a class

I have everything correctly installed, using python 3.10.6 and I have enough RAM, Storage and CPU.

I'm running it on an AWS machine, on ubuntu, but there shouldn't be any problem, right?

Thanks for the work you do, I hope you can help me.

poetry install error m1

poetry install


Installing dependencies from lock file

Package operations: 54 installs, 0 updates, 0 removals

  • Installing scipy (1.9.3): Failed

  ChefBuildError

  Backend subprocess exited when trying to invoke build_wheel
  
  + meson setup /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3 /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3/.mesonpy-1p55ixp1/build -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3/.mesonpy-1p55ixp1/build/meson-python-native-file.ini
  The Meson build system
  Version: 1.2.0
  Source dir: /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3
  Build dir: /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3/.mesonpy-1p55ixp1/build
  Build type: native build
  Project name: SciPy
  Project version: 1.9.3
  C compiler for the host machine: cc (clang 12.0.5 "Apple clang version 12.0.5 (clang-1205.0.22.9)")
  C linker for the host machine: cc ld64 650.9
  C++ compiler for the host machine: c++ (clang 12.0.5 "Apple clang version 12.0.5 (clang-1205.0.22.9)")
  C++ linker for the host machine: c++ ld64 650.9
  Host machine cpu family: aarch64
  Host machine cpu: aarch64
  Compiler for C supports arguments -Wno-unused-but-set-variable: NO 
  Compiler for C supports arguments -Wno-unused-but-set-variable: NO (cached)
  Compiler for C supports arguments -Wno-unused-function: YES 
  Compiler for C supports arguments -Wno-conversion: YES 
  Compiler for C supports arguments -Wno-misleading-indentation: YES 
  Compiler for C supports arguments -Wno-incompatible-pointer-types: YES 
  Library m found: YES
  
  ../../meson.build:57:0: ERROR: Unknown compiler(s): [['gfortran'], ['flang'], ['nvfortran'], ['pgfortran'], ['ifort'], ['ifx'], ['g95']]
  The following exception(s) were encountered:
  Running `gfortran --version` gave "[Errno 2] No such file or directory: 'gfortran'"
  Running `gfortran -V` gave "[Errno 2] No such file or directory: 'gfortran'"
  Running `flang --version` gave "[Errno 2] No such file or directory: 'flang'"
  Running `flang -V` gave "[Errno 2] No such file or directory: 'flang'"
  Running `nvfortran --version` gave "[Errno 2] No such file or directory: 'nvfortran'"
  Running `nvfortran -V` gave "[Errno 2] No such file or directory: 'nvfortran'"
  Running `pgfortran --version` gave "[Errno 2] No such file or directory: 'pgfortran'"
  Running `pgfortran -V` gave "[Errno 2] No such file or directory: 'pgfortran'"
  Running `ifort --version` gave "[Errno 2] No such file or directory: 'ifort'"
  Running `ifort -V` gave "[Errno 2] No such file or directory: 'ifort'"
  Running `ifx --version` gave "[Errno 2] No such file or directory: 'ifx'"
  Running `ifx -V` gave "[Errno 2] No such file or directory: 'ifx'"
  Running `g95 --version` gave "[Errno 2] No such file or directory: 'g95'"
  Running `g95 -V` gave "[Errno 2] No such file or directory: 'g95'"
  
  A full log can be found at /private/var/folders/1l/2jbdtw9n0qj2wyxkr1cz2lhh0000gn/T/tmp5x2_aw23/scipy-1.9.3/.mesonpy-1p55ixp1/build/meson-logs/meson-log.txt
  

  at /opt/homebrew/Cellar/poetry/1.5.1_1/libexec/lib/python3.11/site-packages/poetry/installation/chef.py:147 in _prepare
      143│ 
      144│                 error = ChefBuildError("\n\n".join(message_parts))
      145│ 
      146│             if error is not None:
    → 147│                 raise error from None
      148│ 
      149│             return path
      150│ 
      151│     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:

Note: This error originates from the build backend, and is likely not a problem with poetry but with scipy (1.9.3) not supporting PEP 517 builds. You can verify this by running 'pip wheel --use-pep517 "scipy (==1.9.3)"'.

trouble during setup

hi
Great project, wanted to try it, but having these problems during setup:

private-chatbot-mpt30b-langchain$ python ingest.py
Traceback (most recent call last):
File "/home/im/Downloads/private-chatbot-mpt30b-langchain/ingest.py", line 6, in
from dotenv import load_dotenv
ModuleNotFoundError: No module named 'dotenv'

and:

private-chatbot-mpt30b-langchain$ poetry run python chat.py
Traceback (most recent call last):
File "/home/im/Downloads/private-chatbot-mpt30b-langchain/chat.py", line 5, in
from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandler
ModuleNotFoundError: No module named 'langchain'

Am I missing some dependencies or smth else? Seems like I might be missing smth related to LangChain (but already did: pip install langchain)?. rgds, IM

Thanks and questions...

@mayooear thanks for this nice project. Very helpful. Have a couple of items:

  1. The current setup is missing a required package: sentence_transformers
  2. Any thoughts on how to run this in GPU?

Testing in a macbook pro

Thanks for sharing the model, I have been able to test it on my macbook pro, i9 with 32 GB of ram. I notice that the cpu goes to 400% when inferring the answer, and the gpu goes to 0%. Is it possible to make the model use the gpu? Radeon Pro Vega 20 4GB

NVIDIA CUDA Toolkit libraries error

I am following all the instructions but I am getting the following error when I run python ingest.py.

Traceback (most recent call last):
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/torch/init.py", line 168, in _load_global_deps
ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/ctypes/init.py", line 376, in init
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: libcufft.so.10: cannot open shared object file: No such file or directory

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/skhani/Documents/Recent/LLM/private-chatbot-mpt30b-langchain-main/ingest.py", line 162, in
main()
File "/home/skhani/Documents/Recent/LLM/private-chatbot-mpt30b-langchain-main/ingest.py", line 126, in main
embeddings = HuggingFaceEmbeddings(model_name=embeddings_model_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/langchain/embeddings/huggingface.py", line 51, in init
import sentence_transformers
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/sentence_transformers/init.py", line 3, in
from .datasets import SentencesDataset, ParallelSentencesDataset
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/sentence_transformers/datasets/init.py", line 1, in
from .DenoisingAutoEncoderDataset import DenoisingAutoEncoderDataset
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/sentence_transformers/datasets/DenoisingAutoEncoderDataset.py", line 1, in
from torch.utils.data import Dataset
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/torch/init.py", line 228, in
_load_global_deps()
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/torch/init.py", line 189, in _load_global_deps
_preload_cuda_deps(lib_folder, lib_name)
File "/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages/torch/init.py", line 154, in _preload_cuda_deps
raise ValueError(f"{lib_name} not found in the system path {sys.path}")
ValueError: libcublas.so.*[0-9] not found in the system path ['/home/skhani/Documents/Recent/LLM/private-chatbot-mpt30b-langchain-main', '/home/skhani/anaconda3/envs/llm/lib/python311.zip', '/home/skhani/anaconda3/envs/llm/lib/python3.11', '/home/skhani/anaconda3/envs/llm/lib/python3.11/lib-dynload', '/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages']
(llm) skhani@skhani-Precision-7760 ~/Documents/Recent/LLM/private-chatbot-mpt30b-langchain-main$ poetry install
Installing dependencies from lock file

No dependencies to install or update
(llm) skhani@skhani-Precision-7760 ~/Documents/Recent/LLM/priv
ate-chatbot-mpt30b-langchain-main$ on311.zip', '/home/skhani/anaconda3/envs/llm/lib/python3.11', '/home/skhani/anaconda3/envs/llm/lib/python3.11/lib-dynload', '/home/skhani/anaconda3/envs/llm/lib/python3.11/site-packages']khani/anaconda3/envs/llm/lib/python3.11/site-packages']

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.