Comments (13)
Hi, can we generate multiple captions per video for one question using the offline demo?
Hi @Adeelyousaf,
Yes it is possible. We used Vicuna which is a generative language model and produce different responses in distinct iterations, each being contextually relevant to the asked question.
from video-chatgpt.
Hi @jhj7905,
Thank You for your interest in our work. Please note that you have drop/drag the video to the place holder first before pressing the upload video button. I hope it will help, otherwise please share the exact steps you are following and I may be able to identify the issue. Thank You.
from video-chatgpt.
Same issue.
Let be explain clearly @mmaaz60
The demo is working fine as in the GUI.
However when we upload the video, it takes forever to process
I have seen this waiting time for for 20 minutes plus.
from video-chatgpt.
Hi @ceyxasm,
Thank you for bringing this to our attention and our apologies for the inconvenience you're experiencing. Currently, the demo is hosted locally, and the delay you're facing with the video processing time is due to ongoing maintenance work, which has unfortunately resulted in bandwidth issues. This is causing some unexpected latency, especially for tasks like video upload and processing. We anticipate that the issue will be solved in a few days. We appreciate your understanding and patience during this time.
In the meantime, we recommend using the offline version of the demo if possible. The instructions for the offline demo can be found here. This should provide a more immediate solution. If you have any questions or need assistance with the offline demo, feel free to ask. We are here to help!
from video-chatgpt.
Hey @hanoonaR
The latency that I am facing is in the offline demo only. I have done the local setup just as it demanded. However, even when running locally; processing time is 10 minutes and more. In fact, the OC is also facing the same issue
from video-chatgpt.
Hi @ceyxasm,
Thank You for the clarification. I tried reproducing the issue following the instructions at Video-ChatGPT offline demo but couldn't reproduce it. For me the processing of a 1.5 minutes long video took a few seconds only. I am running it on NVIDIA A100-40GB GPU.
To further analyze the issue you are facing I request the following information,
- What hardware (GPU) you are running the demo on? Is something else is also running on the GPU?
- Have you followed the instructions at Installation to create the environment? Please share the versions of PyTorch, Transformers and Gradio in your environment.
- Please share the screenshot of the whole browser screen to better understand the problem. If you can share a small screen recording, that would be great.
Also from the screenshot you shared, it looks like the system has not yet started processing the video (its displaying queue). So, it could either be because it still uploading the video (in offline demo it just equivalent to copy it to a temp location) or the GPU does not have enough resources to process the video or may be the program is stuck. Providing the above requested information would definitely help in understanding the problem better.
Thank You and looking forward to your response.
from video-chatgpt.
Hi, can we generate multiple captions per video for one question using the offline demo?
from video-chatgpt.
Hi @mmaaz60,
Thank you for your excellent work.
I have some problems running the offline demo of Video ChatGPT.
It is a similar symptom to the first problem in this thread, but in my environment, the following error has been identified when uploading the video.
I am not very familiar withg and would appreciate your help.
Traceback (most recent call last):
File "/home/yanai-lab/nakamizo-y/.conda/envs/video_chatgpt2/lib/python3.10/site-packages/gradio/queueing.py", line 347, in process_events
client_awake = await self.gather_event_data(event)
File "/home/yanai-lab/nakamizo-y/.conda/envs/video_chatgpt2/lib/python3.10/site-packages/gradio/queueing.py", line 220, in gather_event_data
data, client_awake = await self.get_message(event, timeout=receive_timeout)
File "/home/yanai-lab/nakamizo-y/.conda/envs/video_chatgpt2/lib/python3.10/site-packages/gradio/queueing.py", line 456, in get_message
return PredictBody(**data), True
File "/home/yanai-lab/nakamizo-y/.conda/envs/video_chatgpt2/lib/python3.10/site-packages/pydantic/main.py", line 150, in init
pydantic_self.pydantic_validator.validate_python(data, self_instance=pydantic_self)
pydantic_core._pydantic_core.ValidationError: 1 validation error for PredictBody
event_id
Field required [type=missing, input_value={'fn_index': 12, 'data': ...on_hash': '7xau06wrutn'}, input_type=dict]
For further information visit https://errors.pydantic.dev/2.0.3/v/missing
from video-chatgpt.
Hi @yuu2704,
Thank you for your interest in our work. To better assist you, may I know the gradio version
you are using? Thanks
from video-chatgpt.
Hi @yuu2704,
Thank you for your interest in our work. To better assist you, may I know the
gradio version
you are using? Thanks
Thank you for your prompt reply.
I am using gradio version 3.23.0. I am also complying with the requirements.txt file for other libraries.
from video-chatgpt.
Hi @yuu2704,
Thank you for your interest in our work. To better assist you, may I know thegradio version
you are using? ThanksThank you for your prompt reply.
I am using gradio version 3.23.0. I am also complying with the requirements.txt file for other libraries.
Hi, i met the same problem when i run the offline demo on various machines. Have you solved it?
from video-chatgpt.
Hi @yuu2704 @ktr-hubrt,
Please try installing the below version of pydantic
and let me know if it solves the issue. Thanks.
pip install pydantic==1.10.7
from video-chatgpt.
Hi @yuu2704 @ktr-hubrt,
Please try installing the below version of
pydantic
and let me know if it solves the issue. Thanks.pip install pydantic==1.10.7
Thanks, it works.
from video-chatgpt.
Related Issues (20)
- Question about VideoInstruct_Dataset.json HOT 1
- Question of training utilizing A6000 HOT 6
- Inho jake park inho jake park where are you?
- ActivityNet few shot videos can't be downloaded HOT 7
- Issue running offline demo HOT 1
- Can you provide the original video caption generating the instruction qa? HOT 1
- The download of dataset HOT 1
- Is Zeroshot evaluation on validation or test datasets HOT 1
- Fail to run Video-ChatGPT Demo Offline HOT 2
- The dataset all generated from ChatGPT, it doesn't looked video actually, how to make sure the dataset is right? HOT 3
- Llava Weights not available for running demo offline HOT 2
- Can I deal with Chinese video? HOT 1
- Clarification Needed on the Role of **QA_GT_caption_based_noisy** in the Dataset HOT 1
- Why is OpenAI used for Activitynet-QA Evaluation? HOT 3
- About zero-shot test on TGIF-QA HOT 1
- Fail to execute Video-ChatGPT offline demo (when click "Upload Video") HOT 7
- Code for Dataset Generation HOT 1
- Train errors: some videos in train_video_ids.txt do not appear in activity_clip-14L_spatio_temporal_356 HOT 2
- What is the formal name of the benchmark? HOT 3
- GPT Judge does not work for the Prompt
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from video-chatgpt.