Comments (2)
romain-rsr
commented on September 22, 2024
(Also can you indicate your python version in the process, many thanks)
from mm-cot.
romain-rsr
commented on September 22, 2024
Hi,
I guess the required version is actually the one indicated in the ScienceQA git requirements :
As we can see here, I made my torch and cuda frameworks exactly matching these requirements and yet still get somme shape errors :
File "x/lib/python3.8/site-packages/torch/nn/functional.py", line 5122, in multi_head_attention_forward
k = k.contiguous().view(k.shape[0], bsz * num_heads, head_dim).transpose(0, 1)
RuntimeError: shape '[4, 512, 768]' is invalid for input of size 307200
I will then create a new issue focusing on those shape errors.
from mm-cot.
Related Issues (20)
- How are the vision features generated here ? How to view detr.npy and clip.npy images HOT 1
- typo in utils.prompt line 104 and 106 HOT 1
- Implementation Mm-cot HOT 1
- Question: PC requirements
- How to train
- Question about two stages training? HOT 1
- I can't find main_central.py. HOT 1
- ImportError: cannot import name 'Conv2dSame' from 'timm.models.layers' (unknown location) HOT 5
- [17:28:39] [Model]: Loading declare-lab/flan-alpaca-large... HOT 3
- Where is Gold Rationale from? HOT 1
- "blip2_vicuna_instruct" can't find lead to nonetype HOT 1
- Request for Release of Multimodal-CoT Large 738M Model HOT 3
- While running ‵extract_caption.py`, raise many garbled text. So will you put the models in `https://huggingface.co/Salesforce/instructblip-vicuna-7b/tree/main` the `llm` folder? HOT 1
- ValueError: Unable to create tensor, you should probably activate truncation and/or padding with 'padding=True' 'truncation=True' to have batched tensors with the same length. Perhaps your features (`image_ids` in this case) have excessive nesting (inputs type `list` where type `int` is expected). HOT 1
- OverflowError: out of range integral type conversion attempted HOT 3
- Where is the main_central.py
- Can not train on GPU.
- Question on fine-tuning time HOT 1
- How to use the mm-cot frame as a utility library through local LLM? HOT 1
- OverflowError: can't convert negative int to unsigned HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mm-cot.