Comments (3)
tenlee2012
commented on June 20, 2024
首先很抱歉，本插件對於繁體字的支持不是太友好。
搜索的流程是這樣：
- 通過hanlp的簡繁轉換方法，把文本歸一化為簡體。
- 根據對應的簡體，去詞庫中匹配。
現象解釋：
- 詞庫存的是繁體，而匹配的時候用的是簡體，就導致匹配失敗。
- 詞庫存的是簡體，如果搜索的是繁體，會被上面的流程歸一化為簡體，再去詞庫匹配，而此時詞庫中存的也是簡體，就能匹配上了。
所以建議您在詞庫中放入簡體詞。
from elasticsearch-analysis-hao.
jarvisaoieong
commented on June 20, 2024
謝謝，了解了。
from elasticsearch-analysis-hao.
tenlee2012
commented on June 20, 2024
你好，已經更新了插件代碼，現在可以在自定義詞庫custom_dictionary.text中寫入繁體字了，可以下載相應的release zip包。
from elasticsearch-analysis-hao.
Related Issues (20)
- 安装完elasticsearch闪退，elasticsearch版本是7.14.1，分词器版本也是 HOT 1
- 请更新 log4j 版本 HOT 2
- 希望增加命名实体识别和新词发现功能 HOT 2
- 在对短文本分词时，建议将原文本作为分词结果之一返回 HOT 2
- 希望词典支持配置多个文件 HOT 2
- 建议钉钉 url 配置为空时，不走发送消息的逻辑 HOT 1
- hao 分词器支持热词、词频统计吗？ HOT 1
- 线程中的 Monitor的lastModified/eTags 没感知到初始化 HOT 1
- Token period exceeds length of provided text sized 3 HOT 1
- html_strip + hao_index_mode+multi_value 的情况下，数据插入错误 HOT 2
- Array类型在某些情况下启用fvh，会导致高亮片段错位的问题 HOT 1
- 的字被一起被search_analyzer分在一起了 HOT 2
- 远程停词词库怎么配置 HOT 1
- 停用词相关
- 希望增加 hao_max_word 模式 HOT 2
- 标点符号分词的时候都会被去掉吗 HOT 1
- 标点符号分词的时候都会被去掉吗 HOT 1
- 长文本分词卡住的问题 HOT 2
- `㑮` 导致切词异常
- 没有7.17.6版本的呀~
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from elasticsearch-analysis-hao.