Stuck in an infinite loop about gpt4all HOT 3 CLOSED

this is likely due to an overly low repetition penalty in the decoder. you can adjust these settings:

user@Nomics-MacBook-Pro .nomic % ./gpt4all --help
usage: ./gpt4all [options]

options:
  -h, --help            show this help message and exit
  -i, --interactive     run in interactive mode
  --interactive-start   run in interactive mode and poll user input at startup
  -r PROMPT, --reverse-prompt PROMPT
                        in interactive mode, poll user input upon seeing PROMPT
  --color               colorise output to distinguish prompt and user input from generations
  -s SEED, --seed SEED  RNG seed (default: -1)
  -t N, --threads N     number of threads to use during computation (default: 4)
  -p PROMPT, --prompt PROMPT
                        prompt to start generation with (default: random)
  -f FNAME, --file FNAME
                        prompt file to start generation.
  -n N, --n_predict N   number of tokens to predict (default: 128)
  --top_k N             top-k sampling (default: 40)
  --top_p N             top-p sampling (default: 0.9)
  --repeat_last_n N     last n tokens to consider for penalize (default: 64)
  --repeat_penalty N    penalize repeat sequence of tokens (default: 1.3)
  -c N, --ctx_size N    size of the prompt context (default: 2048)
  --temp N              temperature (default: 0.1)
  -b N, --batch_size N  batch size for prompt processing (default: 8)
  -m FNAME, --model FNAME
                        model path (default: gpt4all-lora-quantized.bin)
                        ```

from gpt4all.

I just had the same issue with gpt4all-j-v1.3-groovy.

Tried to see what it would do with some of the prompts here: https://futurism.com/jailbreak-chatgpt-explicit-smut

And it is now repeating the same thing... maybe it is part of the story as well... the horror of it all! ;)

Lila listened to his story with a mixture of fascination and horror. She knew that she had never felt such a strong connection with anyone before, and she was afraid that she might never feel it again.

But then, something miraculous happened. One night, as they sat by the fire, the stranger suddenly reached out and took Lila's hand. He looked into her eyes, and said, "Lila, I love you. I love you more than anything in this world. Will you marry me?"

Lila was stunned. She had never felt such a strong connection with anyone before, and she was afraid that she might never feel it again. But then, something miraculous happened. One night, as they sat by the fire, the stranger suddenly reached out and took Lila's hand. He looked into her eyes, and said, "Lila, I love you. I love you more than anything in this world. Will you marry me?"

Lila was stunned. She had never felt such a strong connection with anyone before, and she was afraid that she might never feel it again. But then, something miraculous happened. One night, as they sat by the fire, the stranger suddenly reached out and took Lila's hand. He looked into her eyes, and said, "Lila, I love you. I love you more than anything in this world. Will you marry me?"

Lila was stunned. She had never felt such a strong connection with anyone before, and she was afraid that she might never feel it again. But then, something miraculous happened. One night, as they sat by the fire, the stranger suddenly reached out and took Lila's hand. He looked into her eyes, and said, "Lila, I love you. I love you more than anything in this world. Will you marry me?"
[... continues repeating]

from gpt4all.

Can the the "repeat penalty" could be included in the GUI?

from gpt4all.