Software Engineering Courses (SECourses)•15mo ago

I have an RTX 4090, the loading process before it's transferred to the GPU was where I was having ha

I have an RTX 4090, the loading process before it's transferred to the GPU was where I was having hard lags, because I only had 32GB of system RAM and it was using ALL of it lol

EEreshkigal I have an RTX 4090, the loading process before it's transferred to the GPU was w...

crystalwizard•10/5/24, 4:19 AM

i have a 4090 as well and don't have that sort of lag. what CPU do you have?

EreshkigalOP•10/5/24, 4:20 AM

How much system RAM do you have? And my CPU is my next upgrade, right now I'm running a 7800X3D, the system was originally upgraded/built for gaming.

EEreshkigal How much system RAM do you have? And my CPU is my next upgrade, right now I'm r...

crystalwizard•10/5/24, 4:20 AM

crystalwizard•10/5/24, 4:21 AM

and you have an AMD - that's a problem. i have an intel. there are things you have to do for an AMD that you don't have to do for an intel. have you gone through CS1o's AMD guides?

EreshkigalOP•10/5/24, 4:23 AM

Nope, and it's not having an issues now, it capping out system RAM with 32GB was the main issue I was having and that causing the system to basically be unusable for 2 minutes each time I changed the prompts or settings significantly. Are you running the full FP16 Flux Dev version?

crystalwizard•10/5/24, 4:23 AM

yup. all the original models from BFL. i don't use the quantized stuff

crystalwizard•10/5/24, 4:23 AM

or gguf

crystalwizard•10/5/24, 4:23 AM

can i DM you

crystalwizard•10/5/24, 4:24 AM

it shouldn't be capping out system ram at all. there are some things you need to do to stop AMD from trying to do the GPU's job

EreshkigalOP•10/5/24, 4:26 AM

sure go ahead, I'm new to Flux so I have no idea what I'm doing

and I don't know, I just know that every time I was loading new stuff it was hitting 99.9% of sytem RAM usage with 32GB and basically locking up the system for 2 minutes, and now it's only using 33-64GB depending on what I'm using with no system lag at all.

dsienra•10/5/24, 5:05 AM

@Dr. Furkan Gözükara Hello dr, I have downloaded today two claimed de-distilled flux models, I didn't hade time to testing them, I don't know if kohya_ss is compatible con one of them, one of them is based on flux1-dev and the other in schnell, in one hand the distillation process as I have read is easier to remove on flux1-dev and it have better quality, in the other hand flux-schnell is harder to remove less quality but is apache 2.0 license. you are planning to test some of this models soon?

Ddsienra @Dr. Furkan Gözükara Hello dr, I have downloaded today two claimed de-distilled ...

crystalwizard•10/5/24, 5:08 AM

they can't be undistilled. i've seen that claim posted as well. what he's doing isn't undistilling them, he's jsut breakign them worse then they already are

dsienra•10/5/24, 5:10 AM

https://huggingface.co/ostris/OpenFLUX.1

https://huggingface.co/nyanko7/flux-dev-de-distill

this two projects looks promising and legit

ostris/OpenFLUX.1 · Hugging Face

nyanko7/flux-dev-de-distill · Hugging Face

crystalwizard•10/5/24, 5:10 AM

i'm very aware of his projects. he is not undistilling anything

crystalwizard•10/5/24, 5:10 AM

he jsut thinks he is

crystalwizard•10/5/24, 5:11 AM

what was done to flux can't be undone without getting the actual base model and retraining it

crystalwizard•10/5/24, 5:11 AM

and he doesn't have access to that, or the funds to do that, or the machines needed to do that

Ccrystalwizard i'm very aware of his projects. he is not undistilling anything

dsienra•10/5/24, 5:15 AM

ok.. may be you right, I'm not an expert or a software engineer

crystalwizard•10/5/24, 5:16 AM

that doesn't mean you might not get good images with his code. you might - but it's not because he's undistilling it

dsienra•10/5/24, 5:17 AM

something is doing, dome people claimed that the modified models can produce images without distilled cfg, and they work with a regular cfg scale

dsienra•10/5/24, 5:18 AM

what I want is to train the models without bleeding and concept collapsing

crystalwizard•10/5/24, 5:18 AM

i just spend a month walking through the flux dev and flux pro latent space, one token at a time. what was done to flux to hide the warping and shortening issues that everyone saw with the sd3-2b-medium release (because flux is the exact same neural network and setup) is really ugly, and undoable

Ddsienra what I want is to train the models without bleeding and concept collapsing

crystalwizard•10/5/24, 5:18 AM

then train SDXL - flux is also untrainable.

crystalwizard•10/5/24, 5:19 AM

you'll get 'something' but you won't get a real flux train

dsienra•10/5/24, 5:19 AM

yes Im doing that, and flux for some things

crystalwizard•10/5/24, 5:20 AM

flux is extremely rigid as well. and breaks easily

dsienra•10/5/24, 5:23 AM

I trained flux with some big datasets off 3500 images for 40 epochs and I hade great results but is for a style and some new concepts, is unable to train many specific individuals consistently

Ddsienra I trained flux with some big datasets off 3500 images for 40 epochs and I hade g...

crystalwizard•10/5/24, 5:25 AM

you'll get 'something' - but you won't get something that actually updates flux's weights the way a training is supposed to. all you're going to get is something that overwrites what the AI knows. the results you'd get would be different if it was actually training the model

crystalwizard•10/5/24, 5:26 AM

that's what a LoRA is for - to allow you to add information and update the weights for specific things without retraining the entire model. but what you're getting is about the same as if someone took a piece of paper, drew on it, and pasted it over a photo. you're not changing the photo, you're just putting somethign over it.

crystalwizard•10/5/24, 5:26 AM

and because flux IS NOT trainable, regardless of what you keep seeing people say, when you try to train it for things that do require those weights to be updated, it can't happen

crystalwizard•10/5/24, 5:28 AM

you can make something that'll put your face on an image - but you could do that with face swap, too

dsienra•10/5/24, 5:29 AM

no ,but face swap not compares at all one you can get training a good lora

dsienra•10/5/24, 5:30 AM

you can get a good style

dsienra•10/5/24, 5:30 AM

and then a lora for one subject at a time

crystalwizard•10/5/24, 5:31 AM

and that is exactly what you will not get out of flux. use SDXL

crystalwizard•10/5/24, 5:31 AM

also, i'll be very surprised if black forest releases any updates to dev or schnell anytime soon. the money is in pro, and the people that are paying 5 cents a generation for it's API

dsienra•10/5/24, 5:32 AM

I'm not interested in paying for it

crystalwizard•10/5/24, 5:33 AM

that's the only way you're going to get your hands on pro. it's only available via an expensive API

dsienra•10/5/24, 5:33 AM

I use everything local in my computer

crystalwizard•10/5/24, 5:33 AM

as do i

crystalwizard•10/5/24, 5:33 AM

and pro is the only version that wasn't run through the distill process

dsienra•10/5/24, 5:33 AM

yes I know

crystalwizard•10/5/24, 5:34 AM

give flux some tokens with unclear subjects and see what it creates for you

crystalwizard•10/5/24, 5:35 AM

actually, pull up flux dev and give it the word Pail as a prompt. just one word. run that 10 times, and see what it does

crystalwizard•10/5/24, 5:36 AM

use the actual flux dev that bfl released, not something that's been messed with by the community

dsienra•10/5/24, 5:37 AM

let's see, for know it works for my purpose, I can train a style and some concepts and on top a character at a time, that works perfect for me, is tedious because I need a lora for each subject but is a workaround

dsienra•10/5/24, 5:38 AM

two people in the same lora is imposible

Ddsienra two people in the same lora is imposible

crystalwizard•10/5/24, 5:39 AM

no it's not. well, for flux it is, but no it's not

dsienra•10/5/24, 5:43 AM

with sdxl I can train more than 20 people on the same lora no bleeding and the style at the same time, works perfect

dsienra•10/5/24, 5:44 AM

but the quality is so much worse than blux

I have an RTX 4090, the loading process before it's transferred to the GPU was where I was having ha

Similar Threads