jinghaozhao / gpt-code-learner Goto Github PK

Trying to run this through WSL been having issue with getting it running due to libcudart.so.12 being empty (OSError: /home/duarte/.local/lib/python3.8/site-packages/nvidia/cuda_runtime/lib/libcudart.so.12: file too short). Tried uninstalling and reinstalling cuda, version 12.

while running for large codebase im geting this error :- 'Rate limit reached for default-text-embedding-ada-002 ' right after Embedding documents..

after I click analyze code, with copied url in place, I click RUN after I input my question.
It gives error:
:ERROR - Task exception was never retrieved
future: <Task finished name='7qu7472fmz8_0' coro=<Queue.process_events() done, defined at C:\xxx.conda\envs\gpt_code_learner\lib\site-packages\gradio\queueing.py:343> exception=1 validation error for PredictBody
event_id
Field required [type=missing, input_value={'fn_index': 0, 'data': [...on_hash': '7qu7472fmz8'}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.6/v/missing>
Traceback (most recent call last):
File "C:\xxx.conda\envs\gpt_code_learner\lib\site-packages\gradio\queueing.py", line 347, in process_events
client_awake = await self.gather_event_data(event)
File "C:\xxx.conda\envs\gpt_code_learner\lib\site-packages\gradio\queueing.py", line 220, in gather_event_data
data, client_awake = await self.get_message(event, timeout=receive_timeout)
File "C:\xxx.conda\envs\gpt_code_learner\lib\site-packages\gradio\queueing.py", line 456, in get_message
return PredictBody(**data), True
File "C:\xxx.conda\envs\gpt_code_learner\lib\site-packages\pydantic\main.py", line 171, in init
self.pydantic_validator.validate_python(data, self_instance=self)
pydantic_core._pydantic_core.ValidationError: 1 validation error for PredictBody
event_id
Field required [type=missing, input_value={'fn_index': 0, 'data': [...on_hash': '7qu7472fmz8'}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.6/v/missing

Latest gradio version causes AttributeError: 'Button' object has no attribute 'style'

File "xxx\GPT-Code-Learner\code_learner.py", line 194, in main
repo_link_btn = gr.Button("Analyze Code Repo").style(full_width=True)
AttributeError: 'Button' object has no attribute 'style'

This happens even after I install langchain-community as suggested by warnings

Hey, that's a cool project. We are currently building a similar tool: https://github.com/geprog/codecaptain
I am currently looking for enhanced ways to create embeddings from the source-code files allowing us to provide source code links in the UI. Looks like you are currently simply using the TextLoader as well. Would be happy to exchange on your experience.

(/opt/GPT-Code-Learner/.venv) user@host GPT-Code-Learner % pip install -r requirements.txt
Collecting python-dotenv (from -r requirements.txt (line 1))
Using cached python_dotenv-1.0.0-py3-none-any.whl (19 kB)
Collecting hupper (from -r requirements.txt (line 2))
Using cached hupper-1.12-py3-none-any.whl (22 kB)
Collecting gradio (from -r requirements.txt (line 3))
Using cached gradio-4.10.0-py3-none-any.whl.metadata (17 kB)
Collecting termcolor (from -r requirements.txt (line 4))
Using cached termcolor-2.4.0-py3-none-any.whl.metadata (6.1 kB)
Collecting openai (from -r requirements.txt (line 5))
Using cached openai-1.5.0-py3-none-any.whl.metadata (17 kB)
Collecting tenacity (from -r requirements.txt (line 6))
Using cached tenacity-8.2.3-py3-none-any.whl.metadata (1.0 kB)
Collecting supabase (from -r requirements.txt (line 7))
Using cached supabase-2.3.0-py3-none-any.whl.metadata (11 kB)
Collecting langchain (from -r requirements.txt (line 8))
Using cached langchain-0.0.350-py3-none-any.whl.metadata (13 kB)
Collecting tiktoken (from -r requirements.txt (line 9))
Using cached tiktoken-0.5.2-cp312-cp312-macosx_10_9_x86_64.whl.metadata (6.6 kB)
Collecting beautifulsoup4 (from -r requirements.txt (line 10))
Using cached beautifulsoup4-4.12.2-py3-none-any.whl (142 kB)
Collecting faiss-cpu (from -r requirements.txt (line 11))
Using cached faiss-cpu-1.7.4.tar.gz (57 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting pypdf (from -r requirements.txt (line 12))
Using cached pypdf-3.17.3-py3-none-any.whl.metadata (7.5 kB)
Collecting chardet (from -r requirements.txt (line 13))
Using cached chardet-5.2.0-py3-none-any.whl.metadata (3.4 kB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-2.2.2.tar.gz (85 kB)
Preparing metadata (setup.py) ... done
Collecting aiofiles<24.0,>=22.0 (from gradio->-r requirements.txt (line 3))
Using cached aiofiles-23.2.1-py3-none-any.whl.metadata (9.7 kB)
Collecting altair<6.0,>=4.2.0 (from gradio->-r requirements.txt (line 3))
Using cached altair-5.2.0-py3-none-any.whl.metadata (8.7 kB)
Collecting fastapi (from gradio->-r requirements.txt (line 3))
Using cached fastapi-0.105.0-py3-none-any.whl.metadata (24 kB)
Collecting ffmpy (from gradio->-r requirements.txt (line 3))
Using cached ffmpy-0.3.1.tar.gz (5.5 kB)
Preparing metadata (setup.py) ... done
Collecting gradio-client==0.7.3 (from gradio->-r requirements.txt (line 3))
Using cached gradio_client-0.7.3-py3-none-any.whl.metadata (7.0 kB)
Collecting httpx (from gradio->-r requirements.txt (line 3))
Using cached httpx-0.25.2-py3-none-any.whl.metadata (6.9 kB)
Collecting huggingface-hub>=0.19.3 (from gradio->-r requirements.txt (line 3))
Using cached huggingface_hub-0.19.4-py3-none-any.whl.metadata (14 kB)
Collecting importlib-resources<7.0,>=1.3 (from gradio->-r requirements.txt (line 3))
Using cached importlib_resources-6.1.1-py3-none-any.whl.metadata (4.1 kB)
Collecting jinja2<4.0 (from gradio->-r requirements.txt (line 3))
Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Collecting markupsafe~=2.0 (from gradio->-r requirements.txt (line 3))
Using cached MarkupSafe-2.1.3-cp312-cp312-macosx_10_9_x86_64.whl.metadata (2.9 kB)
Collecting matplotlib~=3.0 (from gradio->-r requirements.txt (line 3))
Using cached matplotlib-3.8.2-cp312-cp312-macosx_10_12_x86_64.whl.metadata (5.8 kB)
Collecting numpy~=1.0 (from gradio->-r requirements.txt (line 3))
Using cached numpy-1.26.2-cp312-cp312-macosx_10_9_x86_64.whl.metadata (61 kB)
Collecting orjson~=3.0 (from gradio->-r requirements.txt (line 3))
Using cached orjson-3.9.10-cp312-cp312-macosx_10_15_x86_64.macosx_11_0_arm64.macosx_10_15_universal2.whl.metadata (49 kB)
Collecting packaging (from gradio->-r requirements.txt (line 3))
Using cached packaging-23.2-py3-none-any.whl.metadata (3.2 kB)
Collecting pandas<3.0,>=1.0 (from gradio->-r requirements.txt (line 3))
Using cached pandas-2.1.4-cp312-cp312-macosx_10_9_x86_64.whl.metadata (18 kB)
Collecting pillow<11.0,>=8.0 (from gradio->-r requirements.txt (line 3))
Using cached Pillow-10.1.0-cp312-cp312-macosx_10_10_x86_64.whl.metadata (9.5 kB)
Collecting pydantic>=2.0 (from gradio->-r requirements.txt (line 3))
Using cached pydantic-2.5.2-py3-none-any.whl.metadata (65 kB)
Collecting pydub (from gradio->-r requirements.txt (line 3))
Using cached pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Collecting python-multipart (from gradio->-r requirements.txt (line 3))
Using cached python_multipart-0.0.6-py3-none-any.whl (45 kB)
Collecting pyyaml<7.0,>=5.0 (from gradio->-r requirements.txt (line 3))
Using cached PyYAML-6.0.1-cp312-cp312-macosx_10_9_x86_64.whl.metadata (2.1 kB)
Collecting semantic-version~=2.0 (from gradio->-r requirements.txt (line 3))
Using cached semantic_version-2.10.0-py2.py3-none-any.whl (15 kB)
Collecting tomlkit==0.12.0 (from gradio->-r requirements.txt (line 3))
Using cached tomlkit-0.12.0-py3-none-any.whl.metadata (2.7 kB)
Collecting typer<1.0,>=0.9 (from typer[all]<1.0,>=0.9->gradio->-r requirements.txt (line 3))
Using cached typer-0.9.0-py3-none-any.whl (45 kB)
Collecting typing-extensions~=4.0 (from gradio->-r requirements.txt (line 3))
Using cached typing_extensions-4.9.0-py3-none-any.whl.metadata (3.0 kB)
Collecting uvicorn>=0.14.0 (from gradio->-r requirements.txt (line 3))
Using cached uvicorn-0.24.0.post1-py3-none-any.whl.metadata (6.4 kB)
Collecting fsspec (from gradio-client==0.7.3->gradio->-r requirements.txt (line 3))
Using cached fsspec-2023.12.2-py3-none-any.whl.metadata (6.8 kB)
Collecting websockets<12.0,>=10.0 (from gradio-client==0.7.3->gradio->-r requirements.txt (line 3))
Using cached websockets-11.0.3-py3-none-any.whl (118 kB)
Collecting anyio<5,>=3.5.0 (from openai->-r requirements.txt (line 5))
Using cached anyio-4.2.0-py3-none-any.whl.metadata (4.6 kB)
Collecting distro<2,>=1.7.0 (from openai->-r requirements.txt (line 5))
Using cached distro-1.8.0-py3-none-any.whl (20 kB)
Collecting sniffio (from openai->-r requirements.txt (line 5))
Using cached sniffio-1.3.0-py3-none-any.whl (10 kB)
Collecting tqdm>4 (from openai->-r requirements.txt (line 5))
Using cached tqdm-4.66.1-py3-none-any.whl.metadata (57 kB)
Collecting gotrue<3.0,>=1.3 (from supabase->-r requirements.txt (line 7))
Using cached gotrue-2.1.0-py3-none-any.whl.metadata (5.9 kB)
Collecting httpx (from gradio->-r requirements.txt (line 3))
Using cached httpx-0.24.1-py3-none-any.whl.metadata (7.4 kB)
Collecting postgrest<0.14.0,>=0.10.8 (from supabase->-r requirements.txt (line 7))
Using cached postgrest-0.13.0-py3-none-any.whl.metadata (5.1 kB)
Collecting realtime<2.0.0,>=1.0.0 (from supabase->-r requirements.txt (line 7))
Using cached realtime-1.0.2-py3-none-any.whl.metadata (2.6 kB)
Collecting storage3<0.8.0,>=0.5.3 (from supabase->-r requirements.txt (line 7))
Using cached storage3-0.7.0-py3-none-any.whl.metadata (1.9 kB)
Collecting supafunc<0.4.0,>=0.3.1 (from supabase->-r requirements.txt (line 7))
Using cached supafunc-0.3.1-py3-none-any.whl.metadata (1.1 kB)
Collecting SQLAlchemy<3,>=1.4 (from langchain->-r requirements.txt (line 8))
Using cached SQLAlchemy-2.0.23-cp312-cp312-macosx_10_9_x86_64.whl.metadata (9.6 kB)
Collecting aiohttp<4.0.0,>=3.8.3 (from langchain->-r requirements.txt (line 8))
Using cached aiohttp-3.9.1-cp312-cp312-macosx_10_9_x86_64.whl.metadata (7.4 kB)
Collecting dataclasses-json<0.7,>=0.5.7 (from langchain->-r requirements.txt (line 8))
Using cached dataclasses_json-0.6.3-py3-none-any.whl.metadata (25 kB)
Collecting jsonpatch<2.0,>=1.33 (from langchain->-r requirements.txt (line 8))
Using cached jsonpatch-1.33-py2.py3-none-any.whl.metadata (3.0 kB)
Collecting langchain-community<0.1,>=0.0.2 (from langchain->-r requirements.txt (line 8))
Using cached langchain_community-0.0.3-py3-none-any.whl.metadata (7.0 kB)
Collecting langchain-core<0.2,>=0.1 (from langchain->-r requirements.txt (line 8))
Using cached langchain_core-0.1.1-py3-none-any.whl.metadata (4.0 kB)
Collecting langsmith<0.1.0,>=0.0.63 (from langchain->-r requirements.txt (line 8))
Using cached langsmith-0.0.71-py3-none-any.whl.metadata (10 kB)
Collecting requests<3,>=2 (from langchain->-r requirements.txt (line 8))
Using cached requests-2.31.0-py3-none-any.whl.metadata (4.6 kB)
Collecting regex>=2022.1.18 (from tiktoken->-r requirements.txt (line 9))
Using cached regex-2023.10.3-cp312-cp312-macosx_10_9_x86_64.whl.metadata (40 kB)
Collecting soupsieve>1.2 (from beautifulsoup4->-r requirements.txt (line 10))
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Collecting transformers<5.0.0,>=4.6.0 (from sentence-transformers->-r requirements.txt (line 14))
Using cached transformers-4.36.1-py3-none-any.whl.metadata (126 kB)
INFO: pip is looking at multiple versions of sentence-transformers to determine which version is compatible with other requirements. This could take a while.
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-2.2.1.tar.gz (84 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-2.2.0.tar.gz (79 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-2.1.0.tar.gz (78 kB)
Preparing metadata (setup.py) ... done
Collecting tokenizers>=0.10.3 (from sentence-transformers->-r requirements.txt (line 14))
Using cached tokenizers-0.15.0-cp312-cp312-macosx_10_7_x86_64.whl.metadata (6.7 kB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-2.0.0.tar.gz (85 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-1.2.1.tar.gz (80 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-1.2.0.tar.gz (81 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-1.1.1.tar.gz (81 kB)
Preparing metadata (setup.py) ... done
INFO: pip is still looking at multiple versions of sentence-transformers to determine which version is compatible with other requirements. This could take a while.
Using cached sentence-transformers-1.1.0.tar.gz (78 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-1.0.4.tar.gz (74 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-1.0.3.tar.gz (74 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-1.0.2.tar.gz (74 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-1.0.1.tar.gz (74 kB)
Preparing metadata (setup.py) ... done
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
Using cached sentence-transformers-1.0.0.tar.gz (74 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.4.1.2.tar.gz (64 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.4.1.1.tar.gz (64 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.4.1.tar.gz (64 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.4.0.tar.gz (65 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.3.9.tar.gz (64 kB)
Preparing metadata (setup.py) ... done
Collecting transformers<3.6.0,>=3.1.0 (from sentence-transformers->-r requirements.txt (line 14))
Using cached transformers-3.5.1-py3-none-any.whl (1.3 MB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-0.3.8.tar.gz (66 kB)
Preparing metadata (setup.py) ... done
Collecting transformers<3.4.0,>=3.1.0 (from sentence-transformers->-r requirements.txt (line 14))
Using cached transformers-3.3.1-py3-none-any.whl (1.1 MB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-0.3.7.2.tar.gz (59 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.3.7.1.tar.gz (59 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.3.7.tar.gz (59 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.3.6.tar.gz (62 kB)
Preparing metadata (setup.py) ... done
Collecting transformers<3.2.0,>=3.1.0 (from sentence-transformers->-r requirements.txt (line 14))
Using cached transformers-3.1.0-py3-none-any.whl (884 kB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-0.3.5.1.tar.gz (61 kB)
Preparing metadata (setup.py) ... done
Collecting transformers==3.0.2 (from sentence-transformers->-r requirements.txt (line 14))
Using cached transformers-3.0.2-py3-none-any.whl (769 kB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-0.3.5.tar.gz (61 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.3.4.tar.gz (61 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.3.3.tar.gz (65 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.3.2.tar.gz (65 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.3.1.tar.gz (64 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.3.0.tar.gz (61 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.2.6.2.tar.gz (60 kB)
Preparing metadata (setup.py) ... done
Collecting transformers==2.11.0 (from sentence-transformers->-r requirements.txt (line 14))
Using cached transformers-2.11.0-py3-none-any.whl (674 kB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-0.2.6.1.tar.gz (55 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.2.5.1.tar.gz (52 kB)
Preparing metadata (setup.py) ... done
Collecting transformers==2.3.0 (from sentence-transformers->-r requirements.txt (line 14))
Using cached transformers-2.3.0-py3-none-any.whl (447 kB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-0.2.5.tar.gz (49 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.2.4.1.tar.gz (49 kB)
Preparing metadata (setup.py) ... done
Collecting transformers==2.2.1 (from sentence-transformers->-r requirements.txt (line 14))
Using cached transformers-2.2.1-py3-none-any.whl (364 kB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-0.2.4.tar.gz (49 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.2.3.tar.gz (45 kB)
Preparing metadata (setup.py) ... done
Collecting pytorch-transformers==1.1.0 (from sentence-transformers->-r requirements.txt (line 14))
Using cached pytorch_transformers-1.1.0-py3-none-any.whl (158 kB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-0.2.2.tar.gz (44 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.2.1.tar.gz (42 kB)
Preparing metadata (setup.py) ... done
Collecting pytorch-transformers==1.0.0 (from sentence-transformers->-r requirements.txt (line 14))
Using cached pytorch_transformers-1.0.0-py3-none-any.whl (137 kB)
Collecting sentence-transformers (from -r requirements.txt (line 14))
Using cached sentence-transformers-0.2.0.tar.gz (28 kB)
Preparing metadata (setup.py) ... done
Using cached sentence-transformers-0.1.0.tar.gz (35 kB)
Preparing metadata (setup.py) ... done
ERROR: Cannot install -r requirements.txt (line 14) because these package versions have conflicting dependencies.

The conflict is caused by:
sentence-transformers 2.2.2 depends on torch>=1.6.0
sentence-transformers 2.2.1 depends on torch>=1.6.0
sentence-transformers 2.2.0 depends on torch>=1.6.0
sentence-transformers 2.1.0 depends on torch>=1.6.0
sentence-transformers 2.0.0 depends on torch>=1.6.0
sentence-transformers 1.2.1 depends on torch>=1.6.0
sentence-transformers 1.2.0 depends on torch>=1.6.0
sentence-transformers 1.1.1 depends on torch>=1.6.0
sentence-transformers 1.1.0 depends on torch>=1.6.0
sentence-transformers 1.0.4 depends on torch>=1.6.0
sentence-transformers 1.0.3 depends on torch>=1.6.0
sentence-transformers 1.0.2 depends on torch>=1.6.0
sentence-transformers 1.0.1 depends on torch>=1.6.0
sentence-transformers 1.0.0 depends on torch>=1.6.0
sentence-transformers 0.4.1.2 depends on torch>=1.6.0
sentence-transformers 0.4.1.1 depends on torch>=1.6.0
sentence-transformers 0.4.1 depends on torch>=1.6.0
sentence-transformers 0.4.0 depends on torch>=1.6.0
sentence-transformers 0.3.9 depends on torch>=1.6.0
sentence-transformers 0.3.8 depends on torch>=1.2.0
sentence-transformers 0.3.7.2 depends on torch>=1.2.0
sentence-transformers 0.3.7.1 depends on torch>=1.2.0
sentence-transformers 0.3.7 depends on torch>=1.2.0
sentence-transformers 0.3.6 depends on torch>=1.2.0
sentence-transformers 0.3.5.1 depends on torch>=1.2.0
sentence-transformers 0.3.5 depends on torch>=1.2.0
sentence-transformers 0.3.4 depends on torch>=1.2.0
sentence-transformers 0.3.3 depends on torch>=1.2.0
sentence-transformers 0.3.2 depends on torch>=1.2.0
sentence-transformers 0.3.1 depends on torch>=1.2.0
sentence-transformers 0.3.0 depends on torch>=1.0.1
sentence-transformers 0.2.6.2 depends on torch>=1.0.1
sentence-transformers 0.2.6.1 depends on torch>=1.0.1
sentence-transformers 0.2.5.1 depends on torch>=1.0.1
sentence-transformers 0.2.5 depends on torch>=1.0.1
sentence-transformers 0.2.4.1 depends on torch>=1.0.1
sentence-transformers 0.2.4 depends on torch>=1.0.1
sentence-transformers 0.2.3 depends on torch>=1.0.1
sentence-transformers 0.2.2 depends on torch>=1.0.1
sentence-transformers 0.2.1 depends on torch>=1.0.1
sentence-transformers 0.2.0 depends on torch>=1.0.1
sentence-transformers 0.1.0 depends on torch>=1.0.1

To fix this you could try to:

1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts

Hi, very good project.
I wonder how to open GUI for this tool.