Comments (3)
可以,改一下数据预处理模块 tcData.py 中的def load_tokenizer(self, config)的函数。把
tokenizer = PretrainedTokenizer.from_pretrained(config.pretrained_model_name_or_path)
改为
tokenizer = PRETRAINED_MODEL_CLASSES[config.model_type][1].from_pretrained(config.pretrained_model_name_or_path)
就好
from pytorch-nlu.
感谢大佬
from pytorch-nlu.
序列标注英文也是同样的改法吗?
from pytorch-nlu.
Related Issues (12)
- 请问当前代码中是否包含FLAT的相对位置矩阵处理? HOT 2
- 想问一下多标签是怎么处理的?跑多标签数据集的时候support值好像总和等于那些只有一个标签的 HOT 1
- 支持分类和实体识别联合训练吗?
- 请问怎么对复旦大学计算机信息与技术系国际数据库中心自然语言处理小组提供的新闻语料分类呢 HOT 1
- self.do_lower_case 和 self.vocab 没定义,执行报错?! HOT 2
- 大佬跪求MiningZhiDaoQACorpus这个数据集求的共享链接,原链接失效了
- 大佬能不能出个零基础的傻瓜式训练测试教程啊,看着有点蒙。 HOT 3
- 请问读取数据集内存占用过高的问题 HOT 3
- 大佬求帮忙,根据自己的数据添加added_tokens.json后,训练时没有去加载added_tokens.json的问题? HOT 5
- 选择albert模型tokenizer加载错误
- 求回复:用bert-tiny做多标签分类,训练没有问题,保存了tc.config和tc.model,推理的时候在加载模型的地方报错 HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from pytorch-nlu.