Comments (1)
同样想了解这个问题。我在转换中碰到了问题:
Loading model: Qwen-VL-Chat-Int4
gguf: This GGUF file is for Little Endian only
Set model parameters
Set model tokenizer
gguf: Adding 151387 merge(s).
gguf: Setting special token type bos to 151643
gguf: Setting special token type eos to 151643
gguf: Setting special token type unk to 151643
Exporting model to 'converted.bin'
gguf: loading model part 'model-00001-of-00005.safetensors'
gguf: loading model part 'model-00002-of-00005.safetensors'
gguf: loading model part 'model-00003-of-00005.safetensors'
gguf: loading model part 'model-00004-of-00005.safetensors'
gguf: loading model part 'model-00005-of-00005.safetensors'
blk.0.attn_qkv.bias, n_dims = 1, torch.float16 --> float32
Can not map tensor 'transformer.h.0.attn.c_attn.g_idx'
from qwen-vl.
Related Issues (20)
- 关于模型融合 HOT 18
- [BUG] <qwen-vl api 在阿里云ecs 上调用出现 网络连接错误>
- 关于 chat模型 和 base模型的微调
- 多卡推理错误[BUG] <title> HOT 1
- 如何使用langchain使用qwen-vl_max 模型
- 💡 [REQUEST] - 可以直接使用Qwen-VL-plus或者Qwen-VL-max吗?
- About Qwen2-vl model
- qwen2-VL 图文多模态模型有发布计划吗? HOT 1
- 是否有jetson的部署方案推荐
- 有Qwen2-VL-Instruct 图文多模态模型的发布计划吗? HOT 1
- 💡 [REQUEST] - <请问gptq量化相关的工程代码可否开源?>
- [BUG] <推理阶段,模型forward方法的visual分支并未进行视觉编码>
- AssertionError: Only Support Self-Attention Currently HOT 2
- [Help] Qwen-VL model.generate方法如何输出output_attention HOT 1
- How to get a better result with finetune(如何通过finetune得到一个较好的结果) HOT 9
- [BUG] <title>api 请求报错
- [BUG] <调用qwen_vl_max>接口,传入图片后报下载图片错误
- 训练数据中对一张图片如果存在100轮QA,应如何制作训练数据集
- [BUG] <title> Qwen-VL-Chat-Int4 load进入infer时提示有很多weights没有使用 HOT 1
- 拉了一个多模态大模型技术交流群,大家可以加入进来进行技术交流 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from qwen-vl.