wbrown / novelai-research-tool Goto Github PK

Hey,
thanks for your work and this awesome library. It's still really difficult to find something out there, which can deal useful with the NovelAI API.
I want to use your project to create a Discord Bot, therefore I only want one iteration and take that output, so it would be natural to dynamically create the prompt.txt and configure the json to create one response.

But since my bot need some knowledge, I want to use lorebook entries, which I assume is only possible in .scenario files.
Scenario files on the other hand doesn't have a memory (as far as I understood) and doesn't read from a context file (I would have to create the .scenario file dynamically). Also scenarios are always running infinitely.

So I currently don't know how to solve my usecase. I'm pretty sure, there are things missing in your documentation and it is somehow possible. But I think while developing this project you had other things in mind than »this will be only NovelAI binary for a while and everybody will use it to achieve literally anything« 😂

Can you give me a hint how to solve my approach?

When using a scenario (exported from the website without any modification), the test throws the error "Error loading scenario: Logit ID is not a string or an uint!". This error happens because the code expects settings.parameters.order to be of the format "array of (string or int)" : ["typical_p", "tfs", "top_a", "temperature", "top_p", "top_k"]
But the format actually exported by the website is a bit more complex :

[
  {
    "id": "typical_p",
    "enabled": true
  },
  {
    "id": "tfs",
    "enabled": true
  },
  {
    "id": "top_a",
    "enabled": true
  },
  {
    "id": "temperature",
    "enabled": true
  },
  {
    "id": "top_p",
    "enabled": false
  },
  {
    "id": "top_k",
    "enabled": false
  }
]

The function taking care of this is "func (ids *LogitProcessorIDs) UnmarshalJSON(buf []byte) error" in api.go

Saw your project and converted it to C# (my preferred language). Just thought I'd drop by and leave this reference link for future explorers, as it's not forked per git logic.

https://github.com/Draco18s/NovelAPI

I'm a bit behind and some of your latest commits are mighty fine. 👍

Hi, I'm having a little trouble understanding how logits work. I'm running this on linux, I have grab_logits.exe but no linux binary, and there's no grab_logits.go that I can see, so I don't know how to build a linux version. Am I missing something? (logit_client works fine, so I'm guessing I'm just missing some build command that I'm not familiar with)