might be this? https://github.com/ostris/ai-toolkit/
GitHub
Various AI scripts. Mostly Stable Diffusion stuff. - ostris/ai-toolkit
Fit already has installation?
F
Fto be able to use it you need to know command line arguments passing
Fdont worry i am recording kohya tutorial hopefully today
Fi am testing cu118 vs cu124 atm
F12 gb training became slower after last kohya update
Fanyone noticed?
Flike 2x slow
For maybe i am wrong testing
Frtx 3090 way powerful than 3060 for sure
F3.15 times exactly matching lol
DThis style lora is really good: extract - I'm gonna answer here if other people wants more details as well.
For the captioning, here are some examples : https://imgur.com/a/hxAm3fo (used Florence2 as the base caption then rewrote them)
I've used 29 images (all of different aspect ratio, I didnt crop anything). It was with Civitai Lora training tool and I barely changed anything from the default settings :
"engine": "kohya",
"unetLR": 0.0005,
"clipSkip": 1,
"loraType": "lora",
"keepTokens": 0,
"networkDim": 2,
"numRepeats": 15,
"resolution": 512,
"lrScheduler": "cosine_with_restarts",
"minSnrGamma": 5,
"noiseOffset": 0.1,
"targetSteps": 1088,
"enableBucket": true,
"networkAlpha": 16,
"optimizerType": "AdamW8Bit",
"textEncoderLR": 0,
"maxTrainEpochs": 10,
"shuffleCaption": false,
"trainBatchSize": 4,
"flipAugmentation": false,
"lrSchedulerNumCycles": 3
For the captioning, here are some examples : https://imgur.com/a/hxAm3fo (used Florence2 as the base caption then rewrote them)
I've used 29 images (all of different aspect ratio, I didnt crop anything). It was with Civitai Lora training tool and I barely changed anything from the default settings :
"engine": "kohya",
"unetLR": 0.0005,
"clipSkip": 1,
"loraType": "lora",
"keepTokens": 0,
"networkDim": 2,
"numRepeats": 15,
"resolution": 512,
"lrScheduler": "cosine_with_restarts",
"minSnrGamma": 5,
"noiseOffset": 0.1,
"targetSteps": 1088,
"enableBucket": true,
"networkAlpha": 16,
"optimizerType": "AdamW8Bit",
"textEncoderLR": 0,
"maxTrainEpochs": 10,
"shuffleCaption": false,
"trainBatchSize": 4,
"flipAugmentation": false,
"lrSchedulerNumCycles": 3
DReddit
Explore this post and more from the StableDiffusion community
Dfor me is running 2x slow but I'm training the text encoder, maybe is it?
Fyes text encoder would slow down
Fi am yet to test it
Ffirst i am gonna test new parameter
Fstarting text encoder trainings too 
Fye total 8 new trainings starting
Fnow need to record widnows tutorial
Ffor kohya training
Didk the learning rate, to start I'm using the same 0.0001 for unet and the TE
Fi am testing them :d
Ffirst tests
F5e05 unet and clip
Fsecond is
F5e05 unet and 1e05 text encoder
Fother 6 tests about flow shift
DI went more aggressive with 1e04
Fvram usage only increased 300 mb
Fimpressive
F16 bit training
Fspeed loss is also minimal
Fif works great
Fi will update all configs
Fneed to find best LR
DI hade a speed loss of 2x
Fwhat is your gpu?
D3090
Fit sounds inaccurate
Flet me test
Fwhat is your second / it?
Falso pay attention to shared vram
Dmay be is the update
Fi am testing right now my speed on rtx 3090
Fye i have no such speed loss when training text encoder
Frestart your pc and empty vram usage
Fcan we download the lora we've trained or do we have to stay on the Citivai platform to generate the images?
Fyou can download
Fi downloaded