Version 0.3b (Patreon)

• In the "OFFLINE AI" folder, there is a "GGML.exe" that works on port 5001 (based on LostRuins/koboldcpp).
• "Harlen", New example character in Pygmalion format, should also work with other models too.
• Words for substitution need to have a "$" in front (e.g., $NAME).
• You can delete error messages.
• Minor fixes.

To run an offline language model:

• Open the "OFFLINE AI" folder.
• Run "GGML.exe".
• Select the ".bin" model.
• Run "GPTits.exe".
• Change the "Operation Mode" to "External URL".
• Use the URL: "http://localhost:5001/api/v1/generate"

Tested models:

• ggml-vic13b-uncensored-q4_0.bin

Link: https://huggingface.co/vicuna/ggml-vicuna-13b-1.1/tree/main

• pygmalion-6b-v3-ggml-ggjt-q4_0.bin

Link: https://huggingface.co/concedo/pygmalion-6bv3-ggml-ggjt/tree/main

• If you have good results with any other model, please share it with us on Discord.

Download: