Software Engineering Courses (SECourses)•3y ago

Hi Dr.Furkan and everyone, is there any way to save checkpoint only after 80 epochs are completed?

Hi Dr.Furkan and everyone, is there any way to save checkpoint only after 80 epochs are completed? I want to save a checkpoint every 10 epochs like 80-90-100-110... but instead it saves 10-20-30-40... and takes too much spaces. Thank you very much.

KKhang Hi Dr.Furkan and everyone, is there any way to save checkpoint only after 80 ep...

DeadMan1999•4/27/23, 8:21 AM

I don't think so, atleast in A1111... maybe we would need to write a custom script for that, should be fairly easy.

DDeadMan1999 I don't think so, atleast in A1111... maybe we would need to write a custom scri...

KhangOP•4/27/23, 8:40 AM

Thank you. My current workaround is to train it until 80 epochs without saving >> get 1 checkpoint >> keep training that checkpoint until 150 epochs and save every 10 so I get 90-100-110...

KKhang Thank you. My current workaround is to train it until 80 epochs without saving >...

Major Epidemic•4/27/23, 8:53 AM

that’s the way to do it.

Hhopeyan You are a extremely wonderful engineer

Furkan Gözükara SECourses•4/27/23, 10:34 AM

thank you so much fıor compliments

KKhang Hi Dr.Furkan and everyone, is there any way to save checkpoint only after 80 ep...

Furkan Gözükara SECourses•4/27/23, 10:34 AM

yes you can do that

Furkan Gözükara SECourses•4/27/23, 10:34 AM

what are you using to do training google colab?

YVD•4/27/23, 10:34 AM

Here come some more. Fantastic work!

YVD•4/27/23, 10:37 AM

Im following your video "Best training setup parameters for Dreambooth using classificaiton images.

YVD•4/27/23, 10:38 AM

I have prepared a folder with handpicked classification images, but when I start training dreambooth ignores them and starts creating them. Have you had this problem? Thank you in advance for any help.

YYVD I have prepared a folder with handpicked classification images, but when I start...

Furkan Gözükara SECourses•4/27/23, 10:39 AM

must be a configuration error

Furkan Gözükara SECourses•4/27/23, 10:39 AM

after saving config click load

Furkan Gözükara SECourses•4/27/23, 10:39 AM

you tried that?

Furkan Gözükara SECourses•4/27/23, 10:39 AM

also show me settings please

YVD•4/27/23, 10:42 AM

Thank you, let me check

YVD•4/27/23, 10:47 AM

YVD•4/27/23, 10:47 AM

Ive tried saving and loading with same issue

Furkan Gözükara SECourses•4/27/23, 10:47 AM

show settings please

YVD•4/27/23, 10:47 AM

What is interesting is that it recognizes the classification images it generated on its own, but it wont recognize the ones I put in

Furkan Gözükara SECourses•4/27/23, 10:48 AM

ok use

Furkan Gözükara SECourses•4/27/23, 10:48 AM

pre processing tool

Furkan Gözükara SECourses•4/27/23, 10:48 AM

in train tab

Furkan Gözükara SECourses•4/27/23, 10:48 AM

it will fix

YVD•4/27/23, 10:52 AM

Great thanks! Do I have to use a specific ratio for this?

YVD•4/27/23, 10:53 AM

I intend to use a 960 x 512 when working. On the preprocess images it says 512x512

YYVD I intend to use a 960 x 512 when working. On the preprocess images it says 512x5...

Furkan Gözükara SECourses•4/27/23, 10:56 AM

your classification images probably should be same dimension

Furkan Gözükara SECourses•4/27/23, 10:56 AM

as your training images

Furkan Gözükara SECourses•4/27/23, 10:57 AM

if you dont change max resolution they will get downscaled

YVD•4/27/23, 10:57 AM

great, thanks a lot!

YVD•4/27/23, 11:00 AM

keep up the great work

YVD•4/27/23, 11:06 AM

It worked! im so happy!

rafraf•4/27/23, 11:10 AM

Hey @Furkan Gözükara SECourses are you aware of any GPT assistants who can already help with captioning datasets. I find myself constantly going back to make changes to a tag word or a string, and have to go back to all the dataset txt files, and it's quite time inefficient. Would imagine being able to leverage GPT + python would bring captioning from an hours to minutes. Any luck yet with applying these GPT agents to captioning?

Rrafraf Hey @Furkan Gözükara SECourses are you aware of any GPT assistants who can alrea...

Furkan Gözükara SECourses•4/27/23, 11:22 AM

there are already blip and other captions

Furkan Gözükara SECourses•4/27/23, 11:22 AM

with the caption thing what is important is not describing that image

Furkan Gözükara SECourses•4/27/23, 11:22 AM

the important thing is which words you want to improve

Furkan Gözükara SECourses•4/27/23, 11:22 AM

you want to do fine tuning right?

FFurkan Gözükara SECourses there are already blip and other captions

DeadMan1999•4/27/23, 11:28 AM

although BLIP makes the process much faster, in my opinion it is less accurate. Sometime it produces wrong descriptions for the images. This might affect the training right? I have not tried GPT-4's image description feature yet, but from what I heard, it is quite accurate. maybe a comparison between BLIP and GPT-4 is needed

FFurkan Gözükara SECourses there are already blip and other captions

rafraf•4/27/23, 11:31 AM

Yes precisely. I am doing Lora of recognisable fashion model person wearing recognisable fashion outfit. I need to be able to trigger the recognisable face and clothes, so it is rigid, and to do that I am using key tags in the caption to make the ai aware what is in the picture. I havent optimised yet for face, i am working on outfit to be faithfull to my studio original photo reference that I shot. But the point is, that BLIP captioning only creates the txt structure. The caption guess is pretty useless. But anyway, what i want is an Ai assistant to propagate the editing. So i decide, i need to change a term, say about the buttons, i need the button tags to change across all the txt files in the dataset. Do you know what I mean.

rafraf•4/27/23, 11:31 AM

I am just asking about an Ai assistant to go in to each txt file and change them. I am using 50 images per dataset concept, and i have about 10 concepts (outfits). So that's a lot of txt files to recursively edit.

rafraf•4/27/23, 11:32 AM

So I would imagine a python code would be involved to delegate text editing across all text files...

FFurkan Gözükara SECourses you want to do fine tuning right?

rafraf•4/27/23, 11:32 AM

I want to fine tune yes.

DeadMan1999•4/27/23, 11:32 AM

so you want to replace a tag with another tag and do the same for all the text files?

DDeadMan1999 so you want to replace a tag with another tag and do the same for all the text f...

rafraf•4/27/23, 11:33 AM

Yes. Say, "white button" to "4 white patterned button". There are 50 images with those buttons. Would be great for the Ai assistant, to propagate the change across all the txt files

rafraf•4/27/23, 11:34 AM

CLIP captioning only guesses what things are. I need something to help me edit details

rafraf•4/27/23, 11:34 AM

So yes, replace tags

rafraf•4/27/23, 11:34 AM

--across a group of txt files

DeadMan1999•4/27/23, 11:34 AM

you could download notepad++ and use "find and replace in files" feature, it will find and replace words in all the files you have mentioned

rafraf•4/27/23, 11:35 AM

oh i did not know that. It can do this already

rafraf•4/27/23, 11:35 AM

How silly of me

rafraf•4/27/23, 11:35 AM

Ok, will give it a try now

DeadMan1999•4/27/23, 11:36 AM

yes, I learned this 2-3 days ago as well, maybe from @Furkan Gözükara SECourses videos or from other dreambooth tutorials on YT

Hi Dr.Furkan and everyone, is there any way to save checkpoint only after 80 epochs are completed?

Similar Threads