[Bug/Assistance] 测试os-std任务，提示Message: 0 samples remaining. about agentbench HOT 6 CLOSED

Hi, @13416157913 有可能是因为指定的输出文件夹里已经包含了全部的测试结果，框架不会重复测试。如果想要重新跑的话，可以尝试换一个输出路径。

from agentbench.

因为指定的输出文件夹里已经包含了

os-std输出文件目录已经删除了，再运行的代码的；

from agentbench.

可以看一下你的配置文件吗？

from agentbench.

可以看一下你的配置文件吗？

assignments:

• agent: pci-chatgpt
  task: os-std
  concurrency:
  agent:
  pci-chatgpt: 5
  task:
  os-std: 5
  definition:
  agent:
  pci-chatgpt:
  module: src.client.agents.FastChatAgent
  parameters:
  body:
  max_tokens: 4096
  model: pci-chatgpt
  repetition_penalty: 1.2
  temperature: 0.05
  top_k: 30
  top_p: 0.8
  controller_address: http://xxx.xxx.xxx.xxx:10001
  headers:
  Content-Type: application/json
  max_new_tokens: 4096
  model_name: pci-chatgpt
  name: FastChat
  prompter:
  args:
  agent_role: assistant
  name: role_content_dict
  repetition_penalty: 1.2
  return_format: '{response[choices][0][message][content]}'
  temperature: 0.05
  top_k: 30
  top_p: 0.8
  url: http://xxx.xxx.xxx.xxx:10001/api/gpt/chat/completions
  task:
  os-std:
  module: src.client.TaskClient
  parameters:
  concurrency: 24
  controller_address: http://localhost:5000/api
  data_config:
  bk: []
  files:
  - index_prefix: std-001-
  problem_file: ../data/os_interaction/data/1/.json
  script_dir: ../data/os_interaction/scripts/1/
  - index_prefix: std-002-
  problem_file: ../data/os_interaction/data/2/.json
  script_dir: ../data/os_interaction/scripts/2/
  - index_prefix: std-003-
  problem_file: ../data/os_interaction/data/3/.json
  script_dir: ../data/os_interaction/scripts/3/
  - index_prefix: std-004-
  problem_file: ../data/os_interaction/data/4/.json
  script_dir: ../data/os_interaction/scripts/4/
  - index_prefix: std-005-
  problem_file: ../data/os_interaction/data/5/.json
  script_dir: ../data/os_interaction/scripts/5/
  - index_prefix: std-006-
  problem_file: ../data/os_interaction/data/6/.json
  script_dir: ../data/os_interaction/scripts/6/
  - index_prefix: std-007-
  problem_file: ../data/os_interaction/data/7/*.json
  script_dir: ../data/os_interaction/scripts/7/
  ignore: []
  docker_config:
  directory: ../data/os_interaction/res/dockerfiles
  localhost: local-os
  name: os-std
  round_limit: 8
  scripts:
  directory: ../data/os_interaction/scripts
  output: outputs/2024-02-02-18-27-06

from agentbench.

可以看一下你的配置文件吗？

您好，请问是什么原因，os任务提示Message: 0 samples remaining. db任务能正常运行。

from agentbench.

可以看一下你的配置文件吗？

问题已解决，是配置问题。

from agentbench.