New dataset: "Erebus" (Patreon)
Content
I have finally done it: I am currently cleaning and compiling a new dataset called "Erebus".
Some specifications:
Size: 4Gb (200k stories) (before cleaning)
Contains:
- Dataset G (Pixiv)
- Literotica (4.5 or higher)
- Sexstories (90% or higher)
- Pike (selected on "Adult" stories)
- Doc's Lab (90% or higher)
- SoFurry (mixture of various tags)
The dataset needs to be pruned of all the short <10kb stories, will be cleaned up using the same settings I did for Nerys-v2, and most likely will have multiple variations made (2.7B, 6B, 13B, 30B). I am debating whether I should use Nerys-V2 as the base or just the base model.
The 30B version will most likely be privately hosted for those that would like to spread the word using the KoboldAI-cluster. Please note that since I am eating the cost of running the server, it will most likely be available for patrons and supporters, and I won't be running it 24/7.
On a related matter, currently having issues with Runpod being hoarded by GPU miners. Although I am partly responsible for this (sorry), I have to say that the income I get from it does pay most of the bills. I hope that shortly it will even be able to pay a KoboldAI instance fully. But to get to that point, I need to do some legwork.