i can implement flash attention - may help. also teacache
i can implement flash attention - may help. also teacache
Fbut both may reduce quality
Fbut it is already that speed on my rtx 3090 ti
F
Sthank you i will try tomorrow
SI see movement in GPU and RAM usage
S
Fwhich config?
Fyour config wrong
F8-bit AdamW optimizer
Fplease follow tutorial dont skipo
FYouTubeSECourses
If you want to train FLUX with maximum possible quality, this is the tutorial looking for. In this comprehensive tutorial, you will learn how to install Kohya GUI and use it to fully Fine-Tune / DreamBooth FLUX model. After that how to use SwarmUI to compare generated checkpoints / models and find the very best one to generate most amazing image...
SOkay will ReDo
SHello @Furkan Gözükara SECourses , after all tries i have few questions:
- if i use 15 batch size on a100 i need use approximately reduce x2 epochs? I have 137 photo, i think need near 100 epochs with 7 batch size, if batch size 15 can try approx 60 epochs?
- if my photos from iphone them size approx 1 mb, yours photo are 5mb is it very important in this case, i dont see very big difference in learning (using 137 preprocessed photos) avr_loss near 0.4 always +-
Now i'm doing upscaling with SUPIR, and will try after it will finish. - tell please can i fix freezes with scrolling screen with ThinLink macos m4 max?
S
Fepoch doesnt change according to batch size
Fepoch is related to number of image you have usually
Fmb of photos doesnt matter what matter is resolution like 1024x1024 - best
Fif you dont downscale it will auto
FFawesome
CThere are many alternatives just not ones we can preinstall for our users.
The few free alternatives I tried myself felt worse.
There are some paid vnc clients that are pretty good but again none we can provide, users would have to signup and install those themselves.
I suspect all clients will be mediocre for users outside of the USA due to latency though.
The few free alternatives I tried myself felt worse.
There are some paid vnc clients that are pretty good but again none we can provide, users would have to signup and install those themselves.
I suspect all clients will be mediocre for users outside of the USA due to latency though.
CIf you just want better file syncing, I personally use winscp on windows, works pretty well and much faster.
FileZilla is also pretty good, faster than winscp, but I like the winscp ui better for simple folder syncs.
FileZilla is also pretty good, faster than winscp, but I like the winscp ui better for simple folder syncs.
Fi think people rather looking for more fluent working connection interface
CThinlinc is the best for that. All other solutions require more work for users to install and setup.
CHere is example of a product that would be more performant but users would need to install and setup themselves.
https://www.realvnc.com/
https://www.realvnc.com/
RealVNC®Jan Intia
Secure, cost-effective remote access and support for your computer, from your desktop or mobile device. VNC® Connect enables cloud or direct connectivity.
Fi see thanks
PI just wanted to share what I did, using the tips and feedback I received from the people here, can I ask if there is a proper method of evaluate models
https://www.linkedin.com/posts/italo-thiago-3b3158216_illustriousxl-deeplearning-gpucomputing-activity-7303857523596414976-fgrY?utm_source=social_share_send&utm_medium=android_app&rcm=ACoAADZ7uTcBFffVIJxesBcJt71j4tV36U6H7pk&utm_campaign=copy_link
https://www.linkedin.com/posts/italo-thiago-3b3158216_illustriousxl-deeplearning-gpucomputing-activity-7303857523596414976-fgrY?utm_source=social_share_send&utm_medium=android_app&rcm=ACoAADZ7uTcBFffVIJxesBcJt71j4tV36U6H7pk&utm_campaign=copy_link
Just finished a preliminary training run with Illustrious XL using localy 2xRTX 3090s. 36 hours, 2 epochs, and 1344 CC0 images, Here some exciting initial results. The speed and quality are impressive! More in-depth analysis to follow. #IllustriousXL #DeepLearning #GPUComputing #StableDiffusion #DomesticCluster #AIart #GrapichDesign #Genai
JGreat work!
JCan you share weights?
TI use Syncthing - it's free, multi-platform, don't have much issues with large files
TI include xml config with my server initialisation script, so it requires just 2 clicks per worker to set up
PYes Sooner
Ssorry for this question was tired from attempts 
Now done x2 upscale photos, much better results, thank you!
Try today 20-80 epochs, decided add 40 epochss to compare. Very good results
Now done x2 upscale photos, much better results, thank you!
Try today 20-80 epochs, decided add 40 epochss to compare. Very good results
Awhat upscaler did you use ? Supir?
T@Furkan Gözükara SECourses Would you please update the file of Koyha (https://www.patreon.com/posts/click-to-open-post-used-in-tutorial-112099700) (File name: Kohya_FLUX_DreamBooth_v17.zip)? I would like to try using 5090 to use Kohya (Windows) to train Flux Dreambooth
Thanks!
Thanks!
Patreon
Get more from SECourses: FLUX, Tutorials, Guides, Resources, Training, Scripts on Patreon
Fjust updated for you 
Fdownload v18 and read change logs
TFirst, LOVE YOU !
Second, I have been refreshing Massed Compute for GPU for another training
besides 5090 training that now I am going to use.
So many people using A6000 at the moment!
Second, I have been refreshing Massed Compute for GPU for another training
besides 5090 training that now I am going to use. So many people using A6000 at the moment!
FFby the way you can use 48 gb config on 32 gb
T@Furkan Gözükara SECourses U know, I am not really that knowledgeable in this area like most of you here. I normally just use the EXACT config and steps you showed in your YouTube.
Fsure it will work no worries
T1 thing about how good your tutorials are is that they are so clear that it is dumb-proof. To be honest, I got zero clue what is going on with all the names in the SWAMUI and Koyha. U have made it very clear.
Fthanks a lot. some people complains but someone has to make this way
Fi got to sleep hopefully see you tomorrow
FDon't forget to change xformers to SDPA. So easy look xformers on gradio interface
TEven though i got no idea what u talk about, I will definitely look into the parameters (?) section to change it. I don't 'forget'. I just don't know
T@Furkan Gözükara SECourses Please kindly or u tell me which parameter I need to change, it turns out to be 440,000 steps for me to use 48GB config. (I guess something wrong with the parameter)
Thanks
Thanks