Does anyone know why I'm getting tons of weird malformed limbs?
Does anyone know why I'm getting tons of weird malformed limbs?
AI'm using these negative prompts
bad anatomy, bad hands, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, worst face, three crus, extra crus, fused crus, worst feet, three feet, fused feet, fused thigh, three thigh, fused thigh, extra thigh, worst thigh, missing fingers, extra fingers, ugly fingers, long fingers, horn, extra eyes, huge eyes, 2girl, amputation, disconnected limbs, cartoon, cg, 3d, unreal, animate
bad anatomy, bad hands, three hands, three legs, bad arms, missing legs, missing arms, poorly drawn face, bad face, fused face, cloned face, worst face, three crus, extra crus, fused crus, worst feet, three feet, fused feet, fused thigh, three thigh, fused thigh, extra thigh, worst thigh, missing fingers, extra fingers, ugly fingers, long fingers, horn, extra eyes, huge eyes, 2girl, amputation, disconnected limbs, cartoon, cg, 3d, unreal, animate
Fsdxl 1024 x1024?
AYep
A
Fnope
Fyou are doing 2048x2048
Fmake it like 1.25 x max high res fix
Fthis is a known issue
Fmodels cant generate much higher resolution than they were trained
Fi got to sleep hopefully see you tomorrow
Aty for the help! sleep well talk tomorrow
Ehorrifying 
DIs animatediff the best option for animation or is there other options? Just wanted yo before I start
DAlso can we use sdxl trained Lora for animation which I think is using sd1. 5
MI have 2 body fix negative prompts.
First this:
"deformed body, bad hands, ugly hands, mutated hands, deformed hands, missing hands, too many hands, too long hands, bad legs, ugly legs, mutated legs, deformed legs, missing legs, too many legs, too long legs, bad fingers, mutated fingers, deformed fingers, missing fingers, ugly fingers, less than 5 fingers, too many fingers, too long fingers"
and a longer:
"more than 2 hand, more than 2 legs, less than 5 fingers, more than 2 breasts, more than 2 nipples, more than 2 knees, leg lock, bad anatomy, deformed body, ugly body, too long body, blurred body parts, smudged body, too long neck, cropped hands, cut hand, bad hands, ugly hands, mutated hands, deformed hands, smudged hands, missing hands, too many hands, missing hand head, cropped legs, bad legs, ugly legs, mutated legs, deformed legs, smudged legs, missing legs, too many legs, bad fingers, mutated fingers, deformed fingers, missing fingers, ugly fingers, too many fingers, bad thighs, faulty thighs, ugly thighs, mutated thighs, too wide thigh"
First this:
"deformed body, bad hands, ugly hands, mutated hands, deformed hands, missing hands, too many hands, too long hands, bad legs, ugly legs, mutated legs, deformed legs, missing legs, too many legs, too long legs, bad fingers, mutated fingers, deformed fingers, missing fingers, ugly fingers, less than 5 fingers, too many fingers, too long fingers"
and a longer:
"more than 2 hand, more than 2 legs, less than 5 fingers, more than 2 breasts, more than 2 nipples, more than 2 knees, leg lock, bad anatomy, deformed body, ugly body, too long body, blurred body parts, smudged body, too long neck, cropped hands, cut hand, bad hands, ugly hands, mutated hands, deformed hands, smudged hands, missing hands, too many hands, missing hand head, cropped legs, bad legs, ugly legs, mutated legs, deformed legs, smudged legs, missing legs, too many legs, bad fingers, mutated fingers, deformed fingers, missing fingers, ugly fingers, too many fingers, bad thighs, faulty thighs, ugly thighs, mutated thighs, too wide thigh"
MParts about the face are deliberately not included, because they may distort the Lora of the person
MYep, it's 512x512 model. 
SNo... I just want to further train inpainting model in UI
Ehas anyone tried this before/know how they are able to train so insanely fast?? https://dreamlook.ai/dreambooth
Ei did a sample test and its 75% faster than a 24gb machine on runpod
AGood morning, I have a question about training multiple characters in a single LORA.
A few weeks ago, you mentioned that when captions are added to images (and these include the concept, for example, ohwx), the class token from the name of the directory where the images are stored is no longer used. That is, the 'ohwx' part of '20_ohwx' is not used, only the '20' is used to determine repetitions.
Based on this, if I want to train multiple characters, which strategy is better?
a) One folder for each character, even if they all have captions.
b) A single folder that encompasses all characters.
On another note, let's assume that for character1 I have 50 images and for character2 I have 100 images. Should this be taken into account in some way? For example, adjusting the repetitions so that the multiplication of repetition and number of images is similar across all datasets, or would this be counterproductive, and could it cause the dataset with fewer images and more repetitions to be overfitted compared to the rest?
Best regards and sorry for the long message
A few weeks ago, you mentioned that when captions are added to images (and these include the concept, for example, ohwx), the class token from the name of the directory where the images are stored is no longer used. That is, the 'ohwx' part of '20_ohwx' is not used, only the '20' is used to determine repetitions.
Based on this, if I want to train multiple characters, which strategy is better?
a) One folder for each character, even if they all have captions.
b) A single folder that encompasses all characters.
On another note, let's assume that for character1 I have 50 images and for character2 I have 100 images. Should this be taken into account in some way? For example, adjusting the repetitions so that the multiplication of repetition and number of images is similar across all datasets, or would this be counterproductive, and could it cause the dataset with fewer images and more repetitions to be overfitted compared to the rest?
Best regards and sorry for the long message
VFurkan, here? /opt/conda/lib/python3.10/site-packages/scipy/init.py:146: UserWarning: A NumPy version >=1.16.5 and <1.23.0 is required for this version of SciPy (detected version 1.24.3
warnings.warn(f"A NumPy version >={np_minversion} and <{np_maxversion}"
/opt/conda/lib/python3.10/site-packages/scipy/init.py:146: UserWarning: A NumPy version >=1.16.5 and <1.23.0 is required for this version of SciPy (detected version 1.24.3
warnings.warn(f"A NumPy version >={np_minversion} and <{np_maxversion}"
usage: sdxl_train.py [-h] [--v2] [--v_parameterization]
warnings.warn(f"A NumPy version >={np_minversion} and <{np_maxversion}"
/opt/conda/lib/python3.10/site-packages/scipy/init.py:146: UserWarning: A NumPy version >=1.16.5 and <1.23.0 is required for this version of SciPy (detected version 1.24.3
warnings.warn(f"A NumPy version >={np_minversion} and <{np_maxversion}"
usage: sdxl_train.py [-h] [--v2] [--v_parameterization]
Valways failed in checkpoint training
MThis is what a strong but flexible Lora graph looks like on Tensorboard. If a spike jumps out into the 3's that's borderline, but no more than 3's. So the goal is not to get max_norm/keys_scaled above 2. Plus a max_norm/max_key_norm should reach 1 before half of the training session, so you have time to normalize the model. So you can tell by looking at these values during training if the Lora will be good or not.
MI trained this model with d_coef=0.85, because the first version (with 1.02) was strong, it went to 3 several times.
MAnd the first tests showed that even this version was a bit strong.
Fit is not faster
Fthey use bigger batch size and lesser steps
Factually when I tested before they did training on 512x512 haha
Fthe second question is the answer. you want each dataset to be trained total number of steps equally
Fthat is the logic of repeating
Fotherwise if that is a balanced dataset put all into a single folder
Fthis is not error
Fjust a warning
Fmake a video and send me
MHow much does the image set matter? 2 photos were duplicated, so my model may have been strong. After deleting these two and having only 23 photos left, I had to change the d_coef value, and 0.75 was too much. I went all the way down to 0.5, which seems to have been fine, although since it never reached the 1 limit of normalization, it was probably a bit under-trained. Based on the tests, not bad, but not reaching a score above 0.9, so really under-trained.
Fi never got any useful info from these statistics for stable diffusion :/
Vokay
MThese graphs are only displayed when normalization is enabled for Lora (it is not enabled for DB). Based on the developer's description, I watch these two values to see if the maximum normalization reaches 1 (it is supposed to be good then) or not over normalizing, so how much it deviates from the original model, how much Lora needs to be improved. And from my observations, for cosine type training, these two graphs give very useful results under Prodigy.
FWell I would prefer full DreamBooth and extract LoRA
MGitHub
This PR adds Dropout and Max Norm Regularization [Paper] to train_network.py
Dropout randomly removes some weights/neurons from calculation on both the forward and backward passes, effectively trai...
Dropout randomly removes some weights/neurons from calculation on both the forward and backward passes, effectively trai...
MThat's what I was looking for in DreamBooth training, because it helps a lot to make a good model, and since I use it with cosine under Prodigy, I get absolutely good results when I watch the graph. I can see at a glance how good or bad Lora will be (see above), and tests have confirmed this.
BHi everyone,
I'm having serious problem with dreambooth, I always get terrible results and for the good ones, the face is not the same per dataset. I'm training everything on epicPhotogasm.
Of course it's my fault, this is my setup (apart from the A100 80G):
20 pictures of the same person (always portrait shot, not fullbody) in 1024x1024
2000 train steps
100 class images
lr 1e-6 100 validation steps
(please let me know if you need more details on the settings, but everything else is set as default)
Do you suggest to use 100/200 pictures and increase both train steps and class images? Or if you have better suggestions I'm open to everything!
Thank you!
I'm having serious problem with dreambooth, I always get terrible results and for the good ones, the face is not the same per dataset. I'm training everything on epicPhotogasm.
Of course it's my fault, this is my setup (apart from the A100 80G):
20 pictures of the same person (always portrait shot, not fullbody) in 1024x1024
2000 train steps
100 class images
lr 1e-6 100 validation steps
(please let me know if you need more details on the settings, but everything else is set as default)
Do you suggest to use 100/200 pictures and increase both train steps and class images? Or if you have better suggestions I'm open to everything!
Thank you!
MAnd here's the graph of the winning Lora, with d_coef=0.6 and 23 images. While I like to train it a bit stronger, I also let the Hires Fix work, which I used to boost the initial face to 0.96 for the very first generation. You can see in the image that I achieved normalization 1 on the right graph (yellow color), so it made a good model and only adjusted the normalization a few times.
Fare you using my patreon config?
Bunfortunately no 
I sent you a dm btw, I'd appreciate if you can reply, thank you!
I sent you a dm btw, I'd appreciate if you can reply, thank you!Fchecking dms in a moment hopefully sorry for delay
TRuntimeError: Error(s) in loading state_dict for UNet2DConditionModel:
size mismatch for down_blocks.0.attentions.0.proj_in.weight: copying a param with shape
torch.Size([320, 320]) from checkpoint, the shape in current model is torch.Size([320, 320, 1, 1])
my model: stable-diffusion-2-1-768v
resolution = 768
can u help m? thanks
size mismatch for down_blocks.0.attentions.0.proj_in.weight: copying a param with shape
torch.Size([320, 320]) from checkpoint, the shape in current model is torch.Size([320, 320, 1, 1])
my model: stable-diffusion-2-1-768v
resolution = 768
can u help m? thanks
Dhow to make resoltion (1024x1024) stick after every restart ? for image creation
Fi really dont use sd 2.1 it is pretty useless