>#aivideo #aianimation #stablediffusion #a1111 #controlnet #automatic1111 #video2video #img2img
This video is for beginners who are interested in seeing how AI Videos can be generated based on a Reference Video in stable diffusion and Automatic 1111.
we will see how (PNG sequence is created and converted back to video, how background can be removed, best video to choose, settings in img2img, controlnet usage, davinci resolve deflicker, production tool and several tips and tools)
We will be using the simplest and most effective method which is img2img and not rely on extensions such as Deforum, temporal kit, mov2mov or others, because it is effective, easy to use and gives us more control.
Now! No matter what you do in stable diffusion, you cannot completely stop flickering or inconsistency, but you can reduce it by understanding what to expect from Stable Diffusion and what can help produce better results.
We will see that there is no specific one setting that works for all, and that settings must be selected based on your video and understanding of this process.
If you want to create impressive real world videos, then Best results are achieved when you train your own checkpoint or LoRAs, using a set of characters/styles/clothes and use that to generate the images, but it is a time consuming process, so we will not be using it, and use existing check points and LoRAs
Img2Img can produce quality and smooth videos
Img2Img is simple to use and easy
Controlnet can help improve results but not always
Which control net to use? Experimental, Normalmaps, Openpose, Reference, Tile, Temporal…etc.
Low denosing strength can produce smoother videos.
Davinci resolve can generate intermediate frames and reduce flickering too.
all videos in this Tutorila are based on the following Free videos from pexels, to whom I thank the authors for creating them and making them available for free:
VIDEO by Tima Miroshnichenko found at https://www.pexels.com/video/a-smiling-applicant-shaking-hands-with-the-interviewer-5438937/
MART PRODUCTION video found at https://www.pexels.com/video/fashion-man-standing-pink-9558193/
Greensccreen dancing video Designed by Freepik https://www.freepik.com/free-video/studio-shot-young-woman-having-fun-dancing-against-green-screen-35_772040#term=Dancer+greenscreen&page=1&track=ais
Monstera Production in Pexels https://www.pexels.com/video/a-woman-dancing-in-the-gym-6980766/
headphone girl at freepik https://www.freepik.com/free-video/happy-woman-wear-wireless-headphones-listening-music-outdoors-empty-street_166689#term=woman+dancing+smiling&page=1&track=ais
thanks for the creators of photon check point
and aniverse v 1.3
as for well Ghibli style lora https://civitai.com/models/6526/studio-ghibli-style-lora