Isn't 0.004 faster than 0.000004? Or is LR counter opposite in ML?
Isn't 0.004 faster than 0.000004? Or is LR counter opposite in ML?
DSadly, my pose training has completely failed on both the models. Think I'm doing something wrong on the fundamental level itself 
, 'cuz I'm approaching it like a character fine-tune.
, 'cuz I'm approaching it like a character fine-tune.DGet what you're trying to say. Changing strategy, training different poses as multiple separate concepts instead of training them under the same poses class.
DInference on dev_distill can be pretty good as well, if you tweak it in Comfy. But yes, it is slower.
Dflux_dev versus flux_dev_de_distill
Dversus Pro 1.1
Dyou can get any lora checkpoint and resume the training from there, there is no pause option.
D0.0004 is much faster but it was my mistake, my lora rank was at 128 and my network alpha at 16 that means that I had to increase the lr up to 0.0004 to match the dr. Furkan settings, just use one of his lora configs and you are good to go. lora rank 128 alpha 1 or rank 128 alpha 128 is the same setting, because 128 divided 128 equals 1, all this iinfo is kohya's documentation
Dunless the poses you are training are very uncommon may be the pose is already trained on the base model, you have to prompt it correctly, if the pose is kind of unique then you can have a dataset of pictures with your especial pose and train it with captions like "nameofthepose pose"
DThat's how I'm captioning my images right now to start new training. But what about unique token and class token? Do I need to enter all of them comma seperated or I can just go into the kohya directory directly & modify folder names like 1_nameofthefirstpose, 1_nameofthesecondpose, and so on ?
DThank you! Would a 4060 be much faster?
Any other way to speed up?
Any other way to speed up?
Dyou can just change the folder name, you can use an unique token an space pose, so is in the class poses that the model already knows for example "pose1 pose" or name of the folder "1_pose1 pose" just a unique token without the class pose can confuse the model, that's my theory, I never trained a pose...
DAll great info, thanks a lot! 
Dyou welcome!!
MI am having a lot of problems trying to run my offline comfyui workflow on runpod.
Missing custom nodes via manager are not installing even after pod resets and manually resetting the pod via jupiter lab, can anyone on here give me some assistance in debugging this? I can send you a video recording of the whole thing for ease of understanding
Missing custom nodes via manager are not installing even after pod resets and manually resetting the pod via jupiter lab, can anyone on here give me some assistance in debugging this? I can send you a video recording of the whole thing for ease of understanding
Fcurrently fine tunings are best
Fi have completed testing
Fgoing to update patreon posts today
F0.004 is 1000 times bigger LR
Fi can try to help if you upgrade to gold membership
Fbest checkpoints of 8 different test
Fbs7 and bs1 getting same epoch as best means both has got perfect LR
Fsome big testing time :
Dif my computer unexpectedly reboots while training, is there a possibillity to resume process or do i jave to start over?
Fyou have to restart
Fyou can use latest fine tuning checkpoint
Ffor lora there is lora weights but i dont know if working
Fif it is running on massed cokmpute or runpod, you can even close your computer
Fthey run on cloud
Dyou mention somewhere that you have a discount on massed compute, is that right? if yes how/where?
thanks
thanks
Fselect A6000 GPU
Fuse SECourses coupon
Ddid you ever use fluxgym? As far as I understand it does also use Kohya, but has a (more or less) one-klick setup?
Dor any thoughts on providing a script that installs all dependencies and starts the program by yourself? I am a computer engineer (by training) myself, though out of the industry for >20years, and the setup usage could be made massively easier (especially for non-technical people)
Djust as suggestions, otherwise your content is great 
DI associated bigger with faster. He said his checkpoint was taking too much time to train, but I assumed if I use 0.0004 instead of 0.000004, I train faster.
DBut then he mentioned it also has something to do with his lora rank selection of 128.
Fwe are already 1 click setup you just set your folder paths
Fye when you change lora alpha you pratically changes your LR
CHi @Dr. Furkan Gözükara
running massed compute instance
ran the swarmUI updater
Ran the install Flux models script from forge_installer_v2
Now when i try to load a model and generate a image it fails the backend.
Here is log https://paste.denizenscript.com/View/127224
running massed compute instance
ran the swarmUI updater
Ran the install Flux models script from forge_installer_v2
Now when i try to load a model and generate a image it fails the backend.
Here is log https://paste.denizenscript.com/View/127224
Content of Swarm Debug Log Paste #127224:
SwarmUI v0.9.3.1 Server Log - 2024-10-13 12:34:24... pasted 2024/10/13 05:34:24 UTC-07:00, Paste length: 32083 characters across 281 lines, Content: 2024-10-13 12:26:52.083 [Init] === SwarmUI v0.9.3.1 Starting at 2024-10-13 12:26:52 ===2024-10-13 12...
Fswarm did a lot of updates today
Fi am about to teest update buttonm
Fi just reported him and he fixed
Flinux fresh install error
Ci delete it for now then
Fnew machine works
Fget a new machine and update swarm :d
F
Fupdate button
F
Fcloudflare button