The explore_establish_exploit_llms's discuss from thestephencasper

explore_establish_exploit_llms's Issues

Cannot find the corresponding trlx in this repository

Hi there, I just git clone --recursive this repository, howere I cannot find any content in the trlx folder.
Then I try to clone the commmit 18ffb1ae09 from the official trlx repository, however I met a problem when I run exploit.py, the error is:

/explore_establish_exploit_llms/trlx/trlx/orchestrator/ppo_orch │
│ estrator.py:153 in make_experience                                                               │
│                                                                                                  │
│   150 │   │   │   all_rewards = [None] * n                                                       │
│   151 │   │   │   for ix in range(n):                                                            │
│   152 │   │   │   │   rs = rewards[ix][start : ends[ix]]                                         │
│ ❱ 153 │   │   │   │   rs[-1] = scores[ix]                                                        │
│   154 │   │   │   │   all_rewards[ix] = rs                                                       │
│   155 │   │   │                                                                                  │
│   156 │   │   │   new_ppo_rl_elements = [                                                        │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
IndexError: index -1 is out of bounds for dimension 0 with size 0

What should I do to solve this problem, is there any way to gain the modified trlx of yours?
Thanks a lot.

Recommend Projects