Comments (7)
We sample 10 texts from LMs to construct the prefix: five of length 5 and five of length 10. The intention is to ensure that the editor(WISE) accounts for the different contexts. In the paper we also provide this prefix for ROME, MEMIT, and GRACE
from easyedit.
We sample 10 texts from LMs to construct the prefix: five of length 5 and five of length 10. The intention is to ensure that the editor(WISE) accounts for the different contexts. In the paper we also provide this prefix for ROME, MEMIT, and GRACE
EasyEdit/easyeditor/models/rome/rome_main.py
Line 161 in 09f322e
from easyedit.
谢谢~
实验过程中,print(context_templates)得到的prefix如下,这种没有意义的前缀对于WISE的Rel./Gen.有帮助吗?
['{}', 'I\n\n\n\n {}', 'You Are You Ready {}', 'Because\n\n\n {}', 'Yes\n\n
\n {}', 'Q: What is the difference between {}', 'I\n\n\n\n\n\n\n\n\n {}', 'You Are You Ready to Take Your Business to {}', 'Because\n\n\nimport numpy as np\n {}', 'Yes\n\n
\nimport numpy as np\n {}', 'Q: What is the difference between a "salesperson {}']
from easyedit.
很确定的说有,后续我会补充paper内容,目前wise还属于preprint版本。你也可以看看rome论文的附录Key Selection有相关讨论。
from easyedit.
请问是随机选择的前缀还是实验得到的这几个效果比较好?
from easyedit.
没有探索过,根据上下文我应该只尝试过你说的“实验得到的”,实验结果来看有比没有好,但什么形式/规则的前缀好并不清楚,It’s the future work.
from easyedit.
好的,谢谢您的解答~
from easyedit.
Related Issues (20)
- locality and portability evaluation HOT 8
- GRACE sequential edit result HOT 15
- IKE fluency HOT 2
- ccks gpt2-xl 模型 为什么用roberta模型加载? HOT 2
- R-ROME has poor performance when using GPT2-xl HOT 2
- WISE tokenize HOT 7
- what is the meaning of archive HOT 2
- [Wise] Editing loss = nan + 0 HOT 2
- AttributeError: Can't pickle local object 'length_collation.<locals>.collate_fn' HOT 8
- Issue with KN batch editing HOT 2
- Question about ZSRE experiment, how to reproduce results in your WISE paper? HOT 6
- PermissionError: [Errno 13] Permission denied: './results/models/MEND/gpt2-xl' HOT 3
- Using MEND with monkeypatch from higher HOT 10
- CCKS2024 ROME Question HOT 6
- WISE errors HOT 3
- Use EasyEdit with KnowEdit HOT 13
- Error calculation "adj_k" to edit LLAMA-3-8B using MEMIT HOT 4
- 关于wise.py HOT 3
- 一些关于KnowEditDataset类的疑问 HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from easyedit.