>I do a deep-dive over all of the LoRA training settings in Kohya, and test every setting.

⌚ Timestamps
0:00:00 – introduction
0:01:33 – about the chapters
0:02:09 – testing methodology
0:09:05 – 1. Captioning
0:12:00 – 2. Source Model
0:13:41 – 3. Number of Repeats for training data
0:17:31 – 4. Number of Repeats for Reg data
0:18:57 – 5. Batch size
0:21:39 – 6. Max Train Steps
0:25:08 – 7. Epochs
0:26:47 – 8. Mixed Precision
0:28:18 – 9. Save Precision
0:29:16 – 10. Learning Rate Scheduler
0:31:20 – 11. Learning Rate and Learning Rate Warmup
0:31:39 – 12. Optimizer
0:34:06 – support the channel
0:35:02 – 13. Network Rank and Network Alpha
0:37:42 – 14. Max Resolution
0:41:55 – 15. Gradient Accumulation Steps
0:43:29 – 16. Clip Skip
0:44:55 – Multiple LoRA training script
0:53:09 – Tensorboard while training
0:54:04 – Tensorboard after training
0:55:56 – How to use Tensorboard
0:59:36 – using LoRA inspector script

🔗 links:
LoRA training parameters by bmaltais on github

Tutorial: Dreambooth LoRA training using Kohya_SS by Desi_Cafe on civitai

Explanation of number of steps (EPOCHs):
https://rentry.org/59xed3#number-of-steps epochs

Network Rank and Network Dimension

Alpha and Dimensions: Two Wild Settings of Training LoRA in Stable Diffusion

My LoRA Training Batch Converter on github

LoRA inspector script on github:

LoRA inspector helper from my github:

🎶 soundtrack music is on my music channel:
https://www.youtube.com/watch?v=wYXout69WMY&list=PLY7R58WfueSrN58yXsmvBdGUP0psFl9XP<br />

😆💗 Social Links:
Twitter: twitter.com/PerRevolutions
Facebook: facebook.com/PerRevolutions
Instagram: instagram.com/PerRevolutions
TikTok: tiktok.com/@perrevolutions

Below is the gear I use.

PowerDeWise Lav Mic: https://amzn.to/35zB2Qt
HyperX QuadCast S – RGB USB Condenser Microphone: https://amzn.to/3cKPb0Z
iRay UW10 UHF Dual Wirless Mic https://www.amazon.com/gp/product/B0969W3F93
MOUNTDOG Photography Tripod Light Stand: https://amzn.to/2U8n5q4
Fugetek Selfie Stick & Tripod: https://amzn.to/3pUMNu7Y
MOZA Power Bank Tripod: https://amzn.to/2TpYhcJ

Logitech C920s (1080p): https://amzn.to/3vr5ExI
Logitech C270 (720p): https://amzn.to/3xm2XyV

MOZA Mini MI 3-Axis Gimbal Stabilizer: https://amzn.to/3gCKtDJ

Hot shoe swivel mount adapter: https://amzn.to/3wmbFNA
22 Pcs Tripod screw Adapters: https://amzn.to/3ztUDyY
Super Clamp with ball head adapter: https://amzn.to/3gypkuh
Fomito 11 inch Magic Arm + Super Clamp: https://amzn.to/2TxrDpL
Simple Deluxe 2-Pack Clamp Light: https://amzn.to/3ztYX1p
YOTTO Heavy Duty Microphone stand: https://amzn.to/3xBEd6b

LED Ring Light 6” With tripod and smartphone mount: https://amzn.to/3cJSHJ7
Neewer Dimmable 176 LED Video Light on Camera LED Panel: https://amzn.to/3wqKeSV
-Power adapter for Neewer 176 LED: https://amzn.to/3zqNiA9
Neewer Led Video Light Panel: https://amzn.to/3wq12Jv
VILTROX LED On Camera Video Light, Portable Mini: https://amzn.to/35jb3wk

weeylite S03 Pocket RGB video light

OHLUX Smart WiFi LED Bulbs, RGBCW: https://amzn.to/3wvlMQg
Neewer 12 SMD LED Bulb Mini Pocket-Size On-Camera LED Video Light: https://amzn.to/3wCHUrO

Full disclosure: As an Amazon Associate I earn from qualifying purchases.
This means that if you make a purchase, it doesn’t cost you any more money, but I will earn a commission.

Support the Hairy Eyeball

Share this on