The FP16 model is no better, there is a problem with the generation. And with UniPC Normal I got onl
The FP16 model is no better, there is a problem with the generation. And with UniPC Normal I got only noise.
�In the data you sent I see you are using Euler sampler and simple schedule
MHere is UniPC result 
�Not sure what's happening, I use swarm UI and use these settings recommend by Dr. Furkan and it works for me
MI'm on the trail. I've generated a new config file for Forge, so I just need to compare the difference between the two to see which parameter is spoiling the image.
MWe have the cause of the problem! Setting the sigma churn to 1 caused the poor image quality. Previously with the other SD models this was not a problem, but the Flux doesn't seem to like it.
MTo conclude, here is the difference between the FP16 and NF4 models. I keep them both because of the difference, because sometimes I need a different generation, but for FP16 I prefer to use the GGUF version, I have more resources.
MDo you train T5-XXL by checking the Train T5-XXL box in Kohya?
MIs there anything else you need to do?
HI followed your runpod forge setup tutorial instead of using a1111, when I run the startup command I get this,
"Cannot locate TCMalloc. Do you have tcmalloc or google-perftool installed on your system? (improves CPU memory usage)",
does this effect anything? seems to work ok though. also runs out of gpu very fast on RTX 3090 but should be normal?
"Cannot locate TCMalloc. Do you have tcmalloc or google-perftool installed on your system? (improves CPU memory usage)",
does this effect anything? seems to work ok though. also runs out of gpu very fast on RTX 3090 but should be normal?
SI managed to get flux dev running on swarmui. But when I type: "portrait of maratwtf" it draws portraits of beautiful women instead of my ugly face lol
Sthe lora didn't connect to flux or something
DIs the 4 GPU training thing fixed?
DElse I shall use 1 GPU to avoid these issues.
GAnyone got a good ComfyUI workflow for trying out these new FLUX LoRA models? The X-Labs workflow is giving me an "list index out of range" error.
Nlatest update he posted mentioned he fixed it
DGuys, I didn't get 4 available GPUs, so I am using 2, it says in the vid:
New learning rate = (no. of GPUs * batch size / 2) * LR
= (2 * 1/2)* 0.00005
= 0.00005
For me, the formula just cancels out. Wth?
New learning rate = (no. of GPUs * batch size / 2) * LR
= (2 * 1/2)* 0.00005
= 0.00005
For me, the formula just cancels out. Wth?
Sguys where do I get epic prompts for my photos? Like the ones in ohmwx man videos
DCheck posts at civitai or ask chatgpt
DTbh, use swarmUI (even if you just use it for the grid generator feature; well explained by the Doc in the video). It just makes it soo much easier. But if you still want to use comfyUI, I think I saw a couple on civitai.
Fin which ui? iPNDM
Fah i see it is on swarmui
Fit is it new i had tested all
DYes, SwarmUI, it is good.
Fcurrently generating 1080 images
Ffor style testing
F
Fsamplers not working on forge
Flike unipc
Fworks on swarmui
Fthey added but i havent tested yet
Fnope doesnt impact
Fdid you enable lora
F4x gpu works. i trained straight 40 hours
Fbut he tries to train like 10000 images i dont know if that is broken
Fye dont change LR 
For maybe 0.00075
Dlol, I remember setting it back to 0.00005, but it defaulted to 0.0001 for some reason.
DI'm wondering whether that will break my training 
DBoth the GPUs are running fine though
Fnope should work fine
Fnice
XThis is my task manager before training
DEven close the task manager and google chrome windows. Just use nvitop to monitor.
XWow okay
Xthanks
Xwondering if Rank_12_7500MB_7_68_Second_IT.json will produce lower training givingit a shot now
DYou have like 7,592 MB available in this situation
XJust started training again, see how it goes
PI got this error when training lora on runpod, how do I fix it?
Traceback (most recent call last):
File "/workspace/kohya_ss/sd-scripts/flux_train_network.py", line 519, in <module>
trainer.train(args)
File "/workspace/kohya_ss/sd-scripts/train_network.py", line 441, in train
self.post_process_network(args, accelerator, network, text_encoders, unet)
File "/workspace/kohya_ss/sd-scripts/flux_train_network.py", line 170, in post_process_network
self.train_t5xxl = network.train_t5xxl
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1729, in getattr
raise AttributeError(f"'{type(self).name}' object has no attribute '{name}'")
AttributeError: 'LoRANetwork' object has no attribute 'train_t5xxl'
Traceback (most recent call last):
File "/workspace/kohya_ss/venv/bin/accelerate", line 8, in <module>
sys.exit(main())
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/accelerate_cli.py", line 48, in main
args.func(args)
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 1106, in launch_command
simple_launcher(args)
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 704, in simple_launcher
raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['/workspace/kohya_ss/venv/bin/python', '/workspace/kohya_ss/sd-scripts/flux_train_network.py', '--config_file', '/workspace/kq/model/config_lora-20240907-192115.toml']' returned non-zero exit status 1.
19:21:35-742791 INFO Training has ended.
Traceback (most recent call last):
File "/workspace/kohya_ss/sd-scripts/flux_train_network.py", line 519, in <module>
trainer.train(args)
File "/workspace/kohya_ss/sd-scripts/train_network.py", line 441, in train
self.post_process_network(args, accelerator, network, text_encoders, unet)
File "/workspace/kohya_ss/sd-scripts/flux_train_network.py", line 170, in post_process_network
self.train_t5xxl = network.train_t5xxl
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1729, in getattr
raise AttributeError(f"'{type(self).name}' object has no attribute '{name}'")
AttributeError: 'LoRANetwork' object has no attribute 'train_t5xxl'
Traceback (most recent call last):
File "/workspace/kohya_ss/venv/bin/accelerate", line 8, in <module>
sys.exit(main())
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/accelerate_cli.py", line 48, in main
args.func(args)
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 1106, in launch_command
simple_launcher(args)
File "/workspace/kohya_ss/venv/lib/python3.10/site-packages/accelerate/commands/launch.py", line 704, in simple_launcher
raise subprocess.CalledProcessError(returncode=process.returncode, cmd=cmd)
subprocess.CalledProcessError: Command '['/workspace/kohya_ss/venv/bin/python', '/workspace/kohya_ss/sd-scripts/flux_train_network.py', '--config_file', '/workspace/kq/model/config_lora-20240907-192115.toml']' returned non-zero exit status 1.
19:21:35-742791 INFO Training has ended.
