Software Engineering Courses (SECourses)•17mo ago

I'm currently running Best_v1_5e_5_max_grad_norm_0 from v3 of the config scripts - loras are coming

I'm currently running Best_v1_5e_5_max_grad_norm_0 from v3 of the config scripts - loras are coming out at about 2.3gb each, does that sound right?

Nnicearoni I'm currently running Best_v1_5e_5_max_grad_norm_0 from v3 of the config scripts...

Furkan Gözükara SECourses•8/22/24, 11:40 PM

yep sounds accurate

Furkan Gözükara SECourses•8/22/24, 11:40 PM

since we are saving as float

Furkan Gözükara SECourses•8/22/24, 11:41 PM

you can save as bfloat too - reduces size by half

Furkan Gözükara SECourses•8/23/24, 12:35 AM

on runpod initial loading for flux training takes forever

Furkan Gözükara SECourses•8/23/24, 12:36 AM

definitely go with massed compute guys

Furkan Gözükara SECourses•8/23/24, 12:41 AM

dmn rtx 3090 gets 5.75 second / it on linux and i get 7.78 second it on windows rtx 3090 ti

Furkan Gözükara SECourses•8/23/24, 12:44 AM

i think i found the reason why windows slow

Furkan Gözükara SECourses•8/23/24, 12:44 AM

testing

AIGambino•8/23/24, 12:46 AM

dr did you have an autocrop thing we can use?

AAIGambino dr did you have an autocrop thing we can use?

Furkan Gözükara SECourses•8/23/24, 12:46 AM

yep here : https://www.patreon.com/posts/sota-subject-and-88391247

Patreon

SOTA Subject Cropper and Face Focused Image Resizer Scripts Do Bett...

Get more from SECourses: Tutorials, Guides, Resources, Training, FLUX, MidJourney, Voice Clone, TTS, ChatGPT, GPT, LLM, Scripts by Furkan Gözü on Patreon

Furkan Gözükara SECourses•8/23/24, 12:46 AM

12_Jan_2024_auto_cropper

Furkan Gözükara SECourses•8/23/24, 12:46 AM

use 12_Jan_2024_auto_cropper then resizer to get exact size

dsienra•8/23/24, 12:49 AM

It makes sense to use a lora rank that high for a 12 billion parameter model? to train just a person? may be even rank 4 or 8 is mora than enough

Ddsienra It makes sense to use a lora rank that high for a 12 billion parameter model? t...

Furkan Gözükara SECourses•8/23/24, 12:50 AM

well full fine tuning yields best at sdxl

Furkan Gözükara SECourses•8/23/24, 12:50 AM

so more should be better imo :d

dsienra•8/23/24, 12:55 AM

you posted some tests a time ago and higher ranks degraded the backgrounds

Ddsienra you posted some tests a time ago and higher ranks degraded the backgrounds

Furkan Gözükara SECourses•8/23/24, 12:57 AM

i dont remember but i should retest with flux

Furkan Gözükara SECourses•8/23/24, 12:57 AM

after finalized config

AIGambino•8/23/24, 12:57 AM

weird I used the autocrop tool and its not on a person so its flipping the images randomly

AAIGambino weird I used the autocrop tool and its not on a person so its flipping the image...

Furkan Gözükara SECourses•8/23/24, 12:58 AM

you need to set class

Furkan Gözükara SECourses•8/23/24, 12:58 AM

or wont work

AIGambino•8/23/24, 12:58 AM

whats that

Furkan Gözükara SECourses•8/23/24, 12:58 AM

Yolo V7 supports different classes as well. So you can change person into different classes you wish.

names: ['person', 'bicycle', 'car', 'motorcycle', 'airplane', 'bus', 'train', 'truck', 'boat', 'traffic light',
'fire hydrant', 'stop sign', 'parking meter', 'bench', 'bird', 'cat', 'dog', 'horse', 'sheep', 'cow',
'elephant', 'bear', 'zebra', 'giraffe', 'backpack', 'umbrella', 'handbag', 'tie', 'suitcase', 'frisbee',
'skis', 'snowboard', 'sports ball', 'kite', 'baseball bat', 'baseball glove', 'skateboard', 'surfboard',
'tennis racket', 'bottle', 'wine glass', 'cup', 'fork', 'knife', 'spoon', 'bowl', 'banana', 'apple',
'sandwich', 'orange', 'broccoli', 'carrot', 'hot dog', 'pizza', 'donut', 'cake', 'chair', 'couch',
'potted plant', 'bed', 'dining table', 'toilet', 'tv', 'laptop', 'mouse', 'remote', 'keyboard', 'cell phone',
'microwave', 'oven', 'toaster', 'sink', 'refrigerator', 'book', 'clock', 'vase', 'scissors', 'teddy bear',
'hair drier', 'toothbrush']

Furkan Gözükara SECourses•8/23/24, 12:58 AM

maybe i can improve script in future with a bette rone

AIGambino•8/23/24, 1:00 AM

under what script is this?

AIGambino•8/23/24, 1:00 AM

I see in the post it says cropper but there is no cropper

Furkan Gözükara SECourses•8/23/24, 1:02 AM

the crop works but it doesnt crop subject

Furkan Gözükara SECourses•8/23/24, 1:02 AM

i explained in video

Furkan Gözükara SECourses•8/23/24, 1:02 AM

i mean body parts of subject

Furkan Gözükara SECourses•8/23/24, 1:03 AM

https://youtu.be/Fbuyu35TkE4

YouTubeSECourses

SOTA Image PreProcessing Scripts For Stable Diffusion Training - Au...

One of the most important aspect of Stable Diffusion training is the preparation of training images. In this tutorial video I will show you how to fully automatically preprocess training images with perfect zoom, crop and resize. These scripts will hugely improve your training success and accuracy.

Scripts Download Link

https://www.patreon...

SOTA Image PreProcessing Scripts For Stable Diffusion Training - Au...

AIGambino•8/23/24, 1:03 AM

I'm trying to create an arcitecture lora

AIGambino•8/23/24, 1:03 AM

of my hallway as a test

Furkan Gözükara SECourses•8/23/24, 1:03 AM

if you need background remove i have better app

Furkan Gözükara SECourses•8/23/24, 1:03 AM

https://www.patreon.com/posts/109913645

Multiversed•8/23/24, 1:11 AM

I just loaded the cfg on a 4070 12gb machine. My 3060 runs your FLUX script at around 30sec/it, but the 4070 is @ 200sec/it. the only difference I can see is python version is 3.10.9, and I know you've got 3.10.11 in the requirments. So, do you believe that's a starting point for troubleshooting? Just seemed like a minor version issue, but i don't really have a grasp on python