Making of the cursejourney cat video (how-to) (Patreon)
Downloads
Missing 1 video, as this post has not yet been imported.
Content
The key to a great video is starting off with a great image. In this case, we have the very popular big kitty midjourney v5 image that I've created months ago. With the new Luma Dream Machine, we put this into the website at https://lumalabs.ai/dream-machine. You can enter a prompt or try animating it without a prompt. The prompt coherence is very low, which means most of the time anything you enter in Luma will be ignored or changed. For this video, the prompt was "big cat laying down" which it didn't follow the prompt at all. I have tried other prompts such as "girl looks up at the cat. walking" etc. with worse results. Once we finally get an acceptable result, which took about 6 attempts for this image, I look up free sound effects on google. For this one, we used https://pixabay.com/sound-effects/search/cat%20purr/ since the cat's mouth is not moving and there isn't much happening environmentally, it made the most sense to add a purring sound.
Optional step is to remove the Luma watermark (since I'm using it as a free user) by using https://beecut.com/online-watermark-remover which is free and does it in seconds.
Once we have a sound effect, or multiple sounds, we go into Adobe Premiere Pro (or any video editing software) and add it to the video. For this one, I've included the cursejourney logo at the bottom left since I've generated the image and video itself even though Luma did the heavy lifting.
There are other image>video apps and video generators that will generate from just a prompt, but the results are not going to be as good as a really solid image that you've created and multiple attempts at animating it. We will soon have even longer videos. Once we do, music could be used instead of sound effects, or even better, a combination of both. This will lead to full videos or movies created with just AI. We are very close.