Comments (4)
zhc7
commented on August 19, 2024
maybe py39 can fix your problem.
from agentbench.
cyente
commented on August 19, 2024
I try py39 but It seems does not work.
File "/mnt/workspace/xxx/pythonfile/download/AgentBench/src/task.py", line 94, in call_wrap
result = self.predict_single(session, data_item)
File "/mnt/workspace/xxx/pythonfile/download/AgentBench/src/tasks/webshop/__init__.py", line 115, in predict_single
self.processes[i][0].send((data_item, session, sender))
File "/opt/conda/envs/py39/lib/python3.9/site-packages/multiprocess/connection.py", line 209, in send
self._send_bytes(_ForkingPickler.dumps(obj))
File "/opt/conda/envs/py39/lib/python3.9/site-packages/multiprocess/reduction.py", line 54, in dumps
cls(buf, protocol, *args, **kwds).dump(obj)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 418, in dump
StockPickler.dump(self, obj)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 487, in dump
self.save(obj)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 560, in save
f(self, obj) # Call unbound method with explicit self
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 886, in save_tuple
save(element)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 603, in save
self.save_reduce(obj=obj, *rv)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 717, in save_reduce
save(state)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 560, in save
f(self, obj) # Call unbound method with explicit self
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 1212, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 971, in save_dict
self._batch_setitems(obj.items())
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 997, in _batch_setitems
save(v)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 560, in save
f(self, obj) # Call unbound method with explicit self
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 1965, in save_function
_save_with_postproc(pickler, (_create_function, (
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 1112, in _save_with_postproc
pickler.save_reduce(*reduction)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 692, in save_reduce
save(args)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 560, in save
f(self, obj) # Call unbound method with explicit self
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 886, in save_tuple
save(element)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 560, in save
f(self, obj) # Call unbound method with explicit self
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 1453, in save_instancemethod0
pickler.save_reduce(MethodType, (obj.__func__, obj.__self__), obj=obj)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 692, in save_reduce
save(args)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 560, in save
f(self, obj) # Call unbound method with explicit self
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 886, in save_tuple
save(element)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 603, in save
self.save_reduce(obj=obj, *rv)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 717, in save_reduce
save(state)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 560, in save
f(self, obj) # Call unbound method with explicit self
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 1212, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 971, in save_dict
self._batch_setitems(obj.items())
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 997, in _batch_setitems
save(v)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 603, in save
self.save_reduce(obj=obj, *rv)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 717, in save_reduce
save(state)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 560, in save
f(self, obj) # Call unbound method with explicit self
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 1212, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 971, in save_dict
self._batch_setitems(obj.items())
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 997, in _batch_setitems
save(v)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 603, in save
self.save_reduce(obj=obj, *rv)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 717, in save_reduce
save(state)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 560, in save
f(self, obj) # Call unbound method with explicit self
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 1212, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 971, in save_dict
self._batch_setitems(obj.items())
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 997, in _batch_setitems
save(v)
File "/opt/conda/envs/py39/lib/python3.9/site-packages/dill/_dill.py", line 412, in save
StockPickler.save(self, obj, save_persistent_id)
File "/opt/conda/envs/py39/lib/python3.9/pickle.py", line 578, in save
rv = reduce(self.proto)
TypeError: cannot pickle 'builtins.CoreBPE' object
from agentbench.
zhc7
commented on August 19, 2024
can you post your environment details? with conda list.
from agentbench.
Longin-Yu
commented on August 19, 2024
We have released v0.2, welcome to have a try!
And feel free to reopen this issue if any problem still exists.
from agentbench.
Related Issues (20)
- Card_Game这个任务跑不起来 HOT 4
- Benchmark for mistral models HOT 1
- Connection error HOT 3
- 增加对Cluade3的评测 HOT 2
- [Bug/Assistance] - Reproducing Results on Alfworld (HH) (vs. ReAct paper) HOT 4
- OS std 测试集结果 HOT 1
- [Bug/Assistance] mind2web的unknown是怎么回事？ HOT 1
- Excellent Job! Well, no offense, it seems LLM-Bench rather than AgentBench in essence. HOT 1
- 请问支持使用openai的tool_call接口进行测试吗？ HOT 1
- 请问如何使用本地的llama-2-hf模型进行测试呢，希望得到一些明确的指导！[Bug/Assistance] HOT 1
- [Feature] 请问每个任务的分是怎么计算的呢？比如OS任务中得到的只是一个准确率，但是在论文中Table3每个任务对应的都是分数，这中间的映射过程我在文中并没有找到，可以提示一下吗 HOT 1
- Would llama3 wizardlm2 and other latest models be tested and published in leaderboard? 请求添加llama3 wizardlm等24年4-5月大模型的测试结果 HOT 3
- [Feature] Add a LICENSE to the project HOT 2
- 请问trajectories有公开吗
- urgent - if there one of the problems throws an error , why does the overall.json not show up??
- DBbench-std task with error "Can't connect to MySQL server" HOT 2
- 通过fastchat部署本地模型遇到的问题 HOT 12
- [Bug/Assistance] card game 测评 开源大模型 运行报错 failed with error INTERACT_FAILED {"detail":"Error: Worker not responding\n"}
- [Feature] 请问你们kg的最终得分是哪个数据呀，我看你们的指标有三个F1，Exact Match和Executability，还是他们加权呀，我并没有看到加权公式 HOT 2
- [Bug/Assistance] how to use local model to replace gpt3.5? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from agentbench.