An iOS Keyboard Extension that allows for interacting with LLMs directly from any text input field. The LLM response is placed into the text field. Includes options to send clipboard contents with the request to help instruct/guide the response.
There are new APIs available for the text-generation-webui. I'd like to implement the the non-blocking / streaming API so text streams into the text field directly as the LLM outputs, but the current API offered by the UI does not accept most parameters (max token length, temperature, etc.) and so, the control over responses can vary greatly.
Looking into providing a dedicated API for the text-gen-webui to work with this extension going forward.