Software Engineering Courses (SECourses)•15mo ago

Hmm, I have installed Visual Studio (2017 and 2022 CE) , but it seems that I get a problem with XFor

Hmm, I have installed Visual Studio (2017 and 2022 CE) , but it seems that I get a problem with XFormers (not installed) after installing Windows_Install_Torch_2_5_Dev_Huge_Speed_Up.bat... any clue?

ArmerAlterKaterOP•10/7/24, 2:51 PM

(2017 is needed for other projects

)

AArmerAlterKater Hmm, I have installed Visual Studio (2017 and 2022 CE) , but it seems that I get...

Furkan Gözükara SECourses•10/7/24, 2:56 PM

xformers not available yet

Furkan Gözükara SECourses•10/7/24, 2:56 PM

for torch 2.5

Furkan Gözükara SECourses•10/7/24, 2:56 PM

i am waiting

Furkan Gözükara SECourses•10/7/24, 2:56 PM

so on windows we use SDPA

Furkan Gözükara SECourses•10/7/24, 2:56 PM

on linux you can use torch 2.4.1 and xformers 0.0.28.post1

ArmerAlterKaterOP•10/7/24, 3:01 PM

Ah thanks

ArmerAlterKaterOP•10/7/24, 3:01 PM

It drove me crazy^^

ArmerAlterKaterOP•10/7/24, 3:02 PM

I have win 11 here and any linux on runpod...

ArmerAlterKaterOP•10/7/24, 3:04 PM

Do you already have a quick tut for Dreambooth? I used kohya some times ago however only for sd 1.5 lora tests...

ArmerAlterKaterOP•10/7/24, 3:05 PM

If not, it will happen through learning by doing, where “doing” is the sound that is made when I hit my face with my hand much too hard.

AArmerAlterKater Do you already have a quick tut for Dreambooth? I used kohya some times ago howe...

Furkan Gözükara SECourses•10/7/24, 3:09 PM

did you watch lora?

Furkan Gözükara SECourses•10/7/24, 3:09 PM

it is exactly same

Furkan Gözükara SECourses•10/7/24, 3:09 PM

just load config into dreaambooth tab

Furkan Gözükara SECourses•10/7/24, 3:10 PM

https://youtu.be/nySGu12Y05k

YouTubeSECourses

FLUX LoRA Training Simplified: From Zero to Hero with Kohya SS GUI ...

Ultimate Kohya GUI FLUX LoRA training tutorial. This tutorial is product of non-stop 9 days research and training. I have trained over 73 FLUX LoRA models and analyzed all to prepare this tutorial video. The research still going on and hopefully the results will be significantly improved and latest configs and findings will be shared. Please wat...

Furkan Gözükara SECourses•10/7/24, 3:10 PM

on runpod : https://youtu.be/-uhL2nW7Ddw

YouTubeSECourses

Blazing Fast & Ultra Cheap FLUX LoRA Training on Massed Compute & R...

Unlock the power of FLUX LoRA training, even if you're short on GPUs or looking to boost speed and scale! This comprehensive guide takes you from novice to expert, showing you how to use Kohya GUI for creating top-notch FLUX LoRAs in the cloud. We'll cover everything: maximizing quality, optimizing speed, and finding the best deals. With our exc...

ArmerAlterKaterOP•10/7/24, 3:11 PM

Ah!

ArmerAlterKaterOP•10/7/24, 4:30 PM

Now I see the beauty of kohya

ArmerAlterKaterOP•10/7/24, 4:31 PM

Your first vid above was an eye opener

ArmerAlterKaterOP•10/7/24, 4:35 PM

But what happens if the training images have different resolutions, let's say I can't crop them down to 1024x1024, but I can resize them to 1024x677? Should I fill the rest with a spare color, e-g. black?

AArmerAlterKater But what happens if the training images have different resolutions, let's say I ...

Furkan Gözükara SECourses•10/7/24, 8:26 PM

i would get all images 1024x1024

Furkan Gözükara SECourses•10/7/24, 8:26 PM

if you cant get you can enable bucketing

Furkan Gözükara SECourses•10/7/24, 8:26 PM

it will auto crop

FFurkan Gözükara SECourses i would get all images 1024x1024

ArmerAlterKaterOP•10/7/24, 9:23 PM

Thanks! Is there any whitepaper available about this theme?

AArmerAlterKater Thanks! Is there any whitepaper available about this theme?

Furkan Gözükara SECourses•10/7/24, 9:31 PM

not that i know

Furkan Gözükara SECourses•10/7/24, 9:31 PM

but flux works best with 1024x1024 i find that

Furkan Gözükara SECourses•10/7/24, 9:31 PM

best is comparing

Furkan Gözükara SECourses•10/7/24, 9:31 PM

1024 vs bucketing

Vigilence•10/7/24, 10:18 PM

@Furkan Gözükara SECourses I want to train a flux lora based on oil paintings. I just want the lora to capture the textures, brushstrokes and art style, not necessarily the colors. Would fully captioning the dataset be preferred over using an activation word?

theJindesan•10/7/24, 10:53 PM

@Furkan Gözükara SECourses I'm a bit confused, the youtube video says to load the configs into the lora tab, but with the latest best configv5 they load into the dreambooth tab. Which tab do you do the config in, and which tab do you hit start training? (UC Arcade on patreon)

CClone I attempted using the 24gig config file for finetune on my 4090 but it estimated...

Sorm•10/7/24, 11:06 PM

Same thing is happening on my GTX4090. You in Windows 10? I'm about to nuke the computer and throw Ubuntu on it because I think Windows is the problem

Vigilence•10/7/24, 11:20 PM

Check to see if its using shared memory, if so that might be the issue, which means the config needs tweaking for your machine.

Sorm•10/8/24, 12:58 AM

Yeah, I've tried everything everything google will tell me to kill the shared memory. Gonna try the 16gb config file and see how that goes before I blow up the OS

VVigilence <@205854764540362752> I want to train a flux lora based on oil paintings. I jus...

Furkan Gözükara SECourses•10/8/24, 6:38 AM

i think you can still train without captions

Furkan Gözükara SECourses•10/8/24, 6:39 AM

and define the colors during inference

TtheJindesan <@205854764540362752> I'm a bit confused, the youtube video says to load the con...

Furkan Gözükara SECourses•10/8/24, 6:39 AM

new configs are dreambooth

Furkan Gözükara SECourses•10/8/24, 6:39 AM

a video is not made yet

Furkan Gözükara SECourses•10/8/24, 6:39 AM

but exactly same

FFurkan Gözükara SECourses 1024 vs bucketing

ArmerAlterKaterOP•10/8/24, 1:05 PM

Bucketing means that the system caches them internally to the best fit?

ArmerAlterKaterOP•10/8/24, 1:05 PM

Like when using AI-Toolkit?

ArmerAlterKaterOP•10/8/24, 1:06 PM

Xcorpion•10/8/24, 1:52 PM

@Furkan Gözükara SECourses what is happening if we train transparent images? like lets say we got icons but background removed png, will it be alright?

AArmerAlterKater Click to see attachment

Furkan Gözükara SECourses•10/8/24, 9:40 PM

yes

Furkan Gözükara SECourses•10/8/24, 9:40 PM

it will put them into buckets

Furkan Gözükara SECourses•10/8/24, 9:40 PM

and auto crop and resize

XXcorpion <@205854764540362752> what is happening if we train transparent images? like let...

Furkan Gözükara SECourses•10/8/24, 9:40 PM

it will be black background

Furkan Gözükara SECourses•10/8/24, 9:40 PM

during training as far as i know

Furkan Gözükara SECourses•10/8/24, 9:40 PM

or maybe white

FFurkan Gözükara SECourses or maybe white 😄

ArmerAlterKaterOP•10/8/24, 10:51 PM

yep, depends on your settings, I write a little padding program atm, utilizing the graphics32 library for batch processing images to maintain the 1024x1024 ratio.

Wktra•10/9/24, 3:47 PM

In terms of Kohya FLUX Fine Tuning, is it possible to do it on any Flux D models? Or must we use the original regular Flux Dev checkpoint? @Furkan Gözükara SECourses

Hmm, I have installed Visual Studio (2017 and 2022 CE) , but it seems that I get a problem with XFor

Similar Threads