>#stablediffusion #A1111 #AI #Lora #koyass #sd #sdxl
#character #charactertraining

This video shows and presents the steps needed for a Perfect LoRA Model of a character that is flexible, able to adapt to new settings, and works for face and full body shots with high level of details for both SD 1.5 and SDXL.

bellow are the steps and key notes used and some of the resources used in the process.

LoRA Training Guide: Training Steps
After installation of Koyass from https://github.com/bmaltais/kohya_ss
Prepare your data set (Good Data is essential)
Caption it
Set up folders
Set up training parameters
Train for few epochs often 5 – 10 epochs could be enough (or more)
select best epoch after comparison.
Test for each epoch: new set of clothes, different colors

– SD 1.5 can produce hyper realistic images with 1024×1024 image same as SDXL
– after detailer is required in most full body shots when having lower quality full body image training data
– using lower number of images (around 20) can work well with high resolution data set
– SDXL 1.0 produces finer more detailed skin features and slighly more realistic subjects
– SDXL 1.0: it is recommended to use smaller network ranks, such as 16 or 8 to reduce file sizes
– SDXL file size = 6 times SD 1.5 for same network rank
– Regularization set: use High quality set with realistic images and of same dimensionj as training data
– SDXL: better use 768×1344 images to improve quality of full body shots
– SDXL: use Gradient checking for lower VRAM
– SDXL training parameters and methodoly is almost same as 1.5 except with minor difference (network rank, SDXL check point)
– Biggest obstacle for SDXL is: Higher VRAM requirements.

other useful info about how stable diffusion works in general and some tips can be seen at
Beginners guide to stable diffusion in Automatic1111 at:
cloth/object training
Koyass for lora training https://github.com/bmaltais/kohya_ss

Regularization set: it is recommended to have high quality reg set of the same class, same dimension.

you can download these models from

you can download a sample 460 regularization images with 1024×1024 from this link which are mostly generated from SD and resized using Topaz AI software and some from freepik free images

Support the Hairy Eyeball

Share this on