Software Engineering Courses (SECourses)•12mo ago

@Dr. Furkan Gözükara hello! In your Lora configs for flux I saw that you using float instead of fp16

@Dr. Furkan Gözükara hello! In your Lora configs for flux I saw that you using float instead of fp16. Is there any issues for fp16/bf16 now?

YYobin @Dr. Furkan Gözükara hello! In your Lora configs for flux I saw that you using f...

AiInfluence•1/23/25, 8:43 AM

I had slightly less quality results with fp16, fp32 is the best

YYobin @Dr. Furkan Gözükara hello! In your Lora configs for flux I saw that you using f...

Furkan Gözükara SECourses•1/23/25, 11:55 AM

hello

Furkan Gözükara SECourses•1/23/25, 11:55 AM

it is save precision

Furkan Gözükara SECourses•1/23/25, 11:56 AM

float is no quality loss

Furkan Gözükara SECourses•1/23/25, 11:56 AM

but fp16 is almost same as well

Furkan Gözükara SECourses•1/23/25, 11:56 AM

so it is not training but how you save the trained model

FFurkan Gözükara SECourses hello

YobinOP•1/23/25, 12:05 PM

fp16 has smaller file size right? I just thought they're issues with fp16 like instability and what not!

YobinOP•1/23/25, 12:05 PM

hence bf16 is there

pwndnoobcake•1/23/25, 2:29 PM

Hello, @Furkan Gözükara SECourses Can you please help me how to use masks in kohya? I only want to use it on a few images, is it even possible this way?

pwndnoobcake•1/23/25, 2:30 PM

i mean for training dreambooth/loras

roosterpolice•1/23/25, 2:30 PM

Hello - anyone know if there Is a reason why no choice of flux inside Run Koyha on massive compute?

Rroosterpolice Hello - anyone know if there Is a reason why no choice of flux inside Run Koyha ...

Timson•1/23/25, 2:32 PM

choice appears after you put a path to an existing flux checkpoint

roosterpolice•1/23/25, 2:33 PM

yeah I did that - no cigar - i used the autodownloader on desktop adn go 1dev into downloads

roosterpolice•1/23/25, 2:33 PM

and got 1dev

roosterpolice•1/23/25, 2:33 PM

Thanks for message Timson by the way

roosterpolice•1/23/25, 2:34 PM

that Kohya in the instance currently must be all flux compatable surely?

roosterpolice•1/23/25, 2:35 PM

its 24.1.7

Timson•1/23/25, 2:39 PM

If it's sd3-flux.1 branch - it should be flux compatible

roosterpolice•1/23/25, 2:39 PM

Timson•1/23/25, 2:39 PM

master branch is not compatible afaik

roosterpolice•1/23/25, 2:40 PM

I see...I was going to ask in Massed but i though best to ask here as is Furkan's build

roosterpolice•1/23/25, 2:40 PM

ah, so that master branch thing

roosterpolice•1/23/25, 2:41 PM

Thanks for your help Timson appreciate it

Timson•1/23/25, 2:41 PM

I'm not using Dr's images for initialisation speed up, so I'm not sure. I suppose you have to wait for Dr's answer if there is an issue, Massed Compute guys are not responsible for images contents

roosterpolice•1/23/25, 2:42 PM

That path is me whacking it into models folder in case it needed it

roosterpolice•1/23/25, 2:42 PM

yeah I thought so re massed

roosterpolice•1/23/25, 2:43 PM

my first run on massed

Rroosterpolice Click to see attachment

Timson•1/23/25, 2:46 PM

are you 100% positive the model exists on that path?

Timson•1/23/25, 2:46 PM

and it's not corrupted, 100% fully downloaded one

Timson•1/23/25, 2:47 PM

try running inference from it

roosterpolice•1/23/25, 2:49 PM

Its ok I am an idiot

roosterpolice•1/23/25, 2:50 PM

I should have watched video...of course he explains why...when doesn't he? Sorry

AiInfluence•1/23/25, 2:50 PM

@Timson can you reply on dm

roosterpolice•1/23/25, 2:50 PM

https://youtu.be/-uhL2nW7Ddw?t=599

YouTubeSECourses

Blazing Fast & Ultra Cheap FLUX LoRA Training on Massed Compute & R...

Unlock the power of FLUX LoRA training, even if you're short on GPUs or looking to boost speed and scale! This comprehensive guide takes you from novice to expert, showing you how to use Kohya GUI for creating top-notch FLUX LoRAs in the cloud. We'll cover everything: maximizing quality, optimizing speed, and finding the best deals. With our exc...