Genjutsu tutorial and tips (Patreon)
Content
I know that some of you have mentioned on my YouTube that you'd like some tips and tricks on how to use the Genjutsu feature on Higgsfield optimally.
Implement your own set. If you're using a NHP gunging as your template, try to generate your own version of the set and use that as the base. Otherwise, what tends to happen is Genjutsu will create some random set which may not match correctly and could change halfway through. The car wash is one perfect example of this, because it more often than not cannot understand the mechanics of the machine, especially when there are multiple camera angles or cuts.
Use a clear character sheet for each person you want to replace and specify exactly who you want that person to replace. When using Genjutsu you can attach multiple references, so if @Image1 is the set, then @Image2 is likely your main replacement character. This also goes for any additional people in the scene and the host. Alternatively ask Genjutsu to 'Remove the character stood [describe the location]'
Use a fairly clear, obvious reference video. Whilst it's difficult to find any NHP clips that are quality, at least make sure the action is clear enough for the model to understand. I've found that certain gungings work much better than others due to clear obvious footage.
You can change pretty much anything from the original footage. The most obvious and easy change would be the colour of the gunge. I tend to refer to it as 'slime' as the model understands that better for me, given that 'gunge' is primarily a British term. You can also change expressions, some actions and, if you're really clever, add stuff in (though, it's not always successful!)
Finally, try again if you fail. Sometimes, the first time you do a Genjutsu it might not quite translate the way you thought, or maybe it brings over some original footage and leaks it into yours - if that happens just try again with a slightly more specific prompt. As with most AI models, it can sometimes go awry and ignore your prompts, so keep at it!
Below are a few stills illustrating things I've changed and what I wrote to do so:
A clip I used from Live & Kicking - I changed it into a Japanese entertainment show by stipulating, "Change the set to look like a Japanese show" and specified that the gunge be green - whilst it was already green, it's always good to reiterate it just in case.
For this one, I change the colour of the foam, gunge and all the characters, as well as stipulating the new set:
This is the one where I went all out. I changed the expressions so she would 'stick out her tongue while the slime fell' and also that she 'massaged it into her hair':
Then, I decided to add additional content, by stating firstly: "@Image2 walks in with a large cream pie and pushes it into @Image1's face" (Image 2 being Nora, and Image 1 being our victim - Minami in this case):
Then, as an alternative, I asked for Nora to 'pick up a plastic bucket of chocolate sauce and pour it over @Image1':
Then I asked Minami to get up and run over to the other side for another go!
So in conclusion, you can do quite a lot with Genjutsu provided you have the imagination and keep at it. Remember, if it fails first time around, just try again with a slightly different prompt. Always reference exactly which image relates to what and, if you don't want someone in a scene, just say "Remove the man stood in the corner" or, after replacing the people you want to keep, "Remove all other people in the clip".
Hope this has been of some help - happy generating!