Comments (3)
jianhai0527
commented on July 18, 2024
您好，不好意思，这个是我们SDK的bug，预计在2月中旬版本修复发布；
具体原因是：inference的时候，model没有设置eval模式，导致带有随机性，只影响get_sentence_embedding方法；
当前可使用如下代码获得句向量表示：
from modelscope.preprocessors import Preprocessor
from modelscope.models import Model
model = Model.from_pretrained('damo/nlp_structbert_faq-question-answering_chinese-base')
preprocessor = Preprocessor.from_pretrained(model.model_dir)
inputs = ['如何使用优惠券', '今天有免费的10元无门槛吗', '购物评级怎么看']
inputs_processed = preprocessor.batch_encode(inputs, max_length=30)
model.eval()
sentence_vecs = model.forward_sentence_embedding(inputs_processed)
from modelscope.
github-actions
commented on July 18, 2024
This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.
from modelscope.
github-actions
commented on July 18, 2024
This issue was closed because it has been stalled for 5 days with no activity.
from modelscope.
Related Issues (20)
- ModuleNotFoundError: No module named 'datasets.exceptions' HOT 1
- 官方文档环境安装能优化下吗？ HOT 3
- CLIP_CN_Tutorial 微调卡住了，也不报错 HOT 8
- 创建notebook失败，信息：当前用户已被列入黑名单 HOT 5
- 下载数据集失败了 HOT 2
- Permission denied HOT 1
- Image Person Reidentification Model Evaluation HOT 2
- RuntimeError: Failed to import modelscope.models.audio.tts.sambert_hifi because of the following error (look up to see its traceback): No module named 'kantts' HOT 3
- modelscope audio 安装错误 HOT 1
- ImportError: cannot import name '_datasets_server' from 'datasets.utils' HOT 2
- Qwen1.5自我认知微调 官方教程运行报错ValueError: malformed node HOT 4
- 离线部署问题 HOT 1
- 关于使用ModelScope离线启动已下载过的模型时遇到的问题 HOT 4
- docker环境中使用pip安装modelscope在某些服务器会出现cannot import name '_datasets_server' from 'datasets.utils' (/usr/local/lib/python3.8/dist-packages/datasets/utils/__init__.py)错误 HOT 4
- 能否增加数据集cerebras/SlimPajama-627B HOT 5
- 运行chatglm3-6b官方 finetune 命令 报错 kernel 需要update HOT 5
- ImportError: cannot import name 'VerificationMode' from 'datasets' HOT 4
- 缓存目录使用混乱，MODELSCOPE_CACHE环境变量在不同位置的作用不一致 HOT 1
- RexUniNLU模型多线程调用报错 HOT 2
- 在用pyinstaller打包代码报错，但是验证内置模型就没问题KeyError: 'speech_dfsmn_kws_char_farfield is not in the pipelines registry group keyword-spotting. Please make sure the correct version of ModelScope library is used.' HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from modelscope.