Software Engineering Courses (SECourses)•3y ago

Hello all, Dr. o7 My name is Luke Williams. I'm a disabled hybrid traditional/AI artist learning SD

Hello all, Dr. o7
My name is Luke Williams. I'm a disabled hybrid traditional/AI artist learning SD video on my 4090. I entered a video in a contest and a ML research team liked it, so now I'm intending to get Rerender A Video running. It's nice to meet you all.

MMotoko_Shi Hello all, Dr. o7 My name is Luke Williams. I'm a disabled hybrid traditional/AI...

Furkan Gözükara SECourses•12/19/23, 11:24 AM

hiwelcome

Motoko_ShiOP•12/19/23, 11:24 AM

I meant to say, I was offered a little job involving Rerender A Video. heh

MMotoko_Shi I meant to say, I was offered a little job involving Rerender A Video. heh

Furkan Gözükara SECourses•12/19/23, 11:24 AM

my auto isntaller working

Furkan Gözükara SECourses•12/19/23, 11:24 AM

you can use

Furkan Gözükara SECourses•12/19/23, 11:26 AM

https://youtu.be/a8oeCFyM5gA

YouTubeSECourses

Turn Videos Into Animation With Just 1 Click - ReRender A Video Tut...

In this video I share automatic Windows installer for ReRender A Video github repository - open source AI project. The auto installer script is here : https://www.patreon.com/posts/1-click-auto-for-89457537

Auto script is here

https://www.patreon.com/posts/1-click-auto-for-89457537

Official repo is here

https://github.com/williamyang19...

Motoko_ShiOP•12/19/23, 11:29 AM

Ok great, I'm just getting started so that's good to know.

MMotoko_Shi Ok great, I'm just getting started so that's good to know.

Furkan Gözükara SECourses•12/19/23, 11:31 AM

great

FFurkan Gözükara SECourses hi Yarma. if you become a patreon subscriber i will message you course content f...

yar_kew•12/19/23, 11:58 AM

amazing. I will email Udemy about this as well. In meanwhile I am buying your subscription and messaging you from there

Yyar_kew amazing. I will email Udemy about this as well. In meanwhile I am buying your su...

Furkan Gözükara SECourses•12/19/23, 12:08 PM

awesome ty so much

FFurkan Gözükara SECourses awesome ty so much

yar_kew•12/19/23, 12:12 PM

signed up and already sent you the message

.. looking forward to watching videos today

Yyar_kew signed up and already sent you the message 🙂 .. looking forward to watching vid...

Furkan Gözükara SECourses•12/19/23, 12:14 PM

ok let me check

nannigath•12/19/23, 12:55 PM

I'm considering fine-tuning Stable Diffusion with 80k clothing images, featuring 5k unique products. I plan to assign a unique token for each apparel item. Is this approach suitable for training? I'm using the EveryDream2 trainer.

FFurkan Gözükara SECourses hello welcome. how much vram your gpu has

AMMAR |COTE|•12/19/23, 12:56 PM

My gpu have 8 gb vram

Motoko_ShiOP•12/19/23, 1:44 PM

I can't seem to clone this repo https://github.com/williamyang1991/Rerender_A_Video

GitHub

GitHub - williamyang1991/Rerender_A_Video: [SIGGRAPH Asia 2023] Rer...

[SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation - GitHub - williamyang1991/Rerender_A_Video: [SIGGRAPH Asia 2023] Rerender A Video: Zero-Shot Text-Guided Vid...

Nnannigath I'm considering fine-tuning Stable Diffusion with 80k clothing images, featuring...

Furkan Gözükara SECourses•12/19/23, 1:51 PM

not much

Furkan Gözükara SECourses•12/19/23, 1:52 PM

how many unique apparel item you have?

AAMMAR |COTE|My gpu have 8 gb vram

Furkan Gözükara SECourses•12/19/23, 1:52 PM

8 gb is not good to do training

Furkan Gözükara SECourses•12/19/23, 1:52 PM

your best option is kaggle SDXL dreambooth for free

MMotoko_Shi I can't seem to clone this repo https://github.com/williamyang1991/Rerender_A_Vi...

Furkan Gözükara SECourses•12/19/23, 1:52 PM

ye solving their repo isntall hard

Furkan Gözükara SECourses•12/19/23, 1:52 PM

use my auto installer

Furkan Gözükara SECourses•12/19/23, 1:52 PM

it works

FFurkan Gözükara SECourses how many unique apparel item you have?

nannigath•12/19/23, 1:53 PM

I have 5000 for now. I wanted to experiment on this first.

nannigath•12/19/23, 1:53 PM

Have an L40 GPU with 48gb vram

Nnannigath I have 5000 for now. I wanted to experiment on this first.

Furkan Gözükara SECourses•12/19/23, 1:54 PM

how are you planning to find 5000 uniqu captions haha :d

nannigath•12/19/23, 1:55 PM

Planning to add new tokens to the clip tokenizer, found an option to do that.

Nnannigath Planning to add new tokens to the clip tokenizer, found an option to do that.

Furkan Gözükara SECourses•12/19/23, 1:55 PM

interesting where did you find it?

Furkan Gözükara SECourses•12/19/23, 1:55 PM

it literally tokenize everything

nannigath•12/19/23, 1:57 PM

pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16).to("cuda")
pipe.tokenizer.add_tokens(list_of_tokens))
pipe.text_encoder.resize_token_embeddings(len(pipe.tokenizer))

nannigath•12/19/23, 1:57 PM

like this

Furkan Gözükara SECourses•12/19/23, 1:59 PM

wow you gonna train with diffusers good luck

nannigath•12/19/23, 1:59 PM

since everydream2 uses diffusers i can simply put these lines in the pipeline

Furkan Gözükara SECourses•12/19/23, 1:59 PM

it is a very hard job to get it right

FFurkan Gözükara SECourses wow you gonna train with diffusers good luck 🙂

nannigath•12/19/23, 1:59 PM

i am using everydream2

Nnannigath i am using everydream2

Furkan Gözükara SECourses•12/19/23, 1:59 PM

i heard it makes more sense

Furkan Gözükara SECourses•12/19/23, 2:00 PM

i can also give you private consultation for different approach. but it wont be able to bring you certain product

Furkan Gözükara SECourses•12/19/23, 2:01 PM

it would be more general one

Furkan Gözükara SECourses•12/19/23, 2:01 PM

like type of clothing etc

FFurkan Gözükara SECourses i can also give you private consultation for different approach. but it wont be ...

nannigath•12/19/23, 2:01 PM

that would be helpful

nannigath•12/19/23, 2:02 PM

but is it worth trying this approach?

Nnannigath but is it worth trying this approach?

Furkan Gözükara SECourses•12/19/23, 2:03 PM

i dont think so

Furkan Gözükara SECourses•12/19/23, 2:03 PM

first of all assigning 5000 unique tokens

Furkan Gözükara SECourses•12/19/23, 2:03 PM

would take huge time

Furkan Gözükara SECourses•12/19/23, 2:03 PM

and you dont know if will work or not

Furkan Gözükara SECourses•12/19/23, 2:04 PM

also 80k images you really should use multi gpu

Furkan Gözükara SECourses•12/19/23, 2:04 PM

you can run on runpod really cheap

Furkan Gözükara SECourses•12/19/23, 2:04 PM

or you can wait days :d

FFurkan Gözükara SECourses also 80k images you really should use multi gpu

nannigath•12/19/23, 2:09 PM

yeah planning to use multi gpus. I have unique ids for each product so planning to put some random alphabets that is not in the clip vocabulary. I have tried this with 500 products and I got decent results. my concern will the model remember all the tokens when I scale it to 5000

Nnannigath yeah planning to use multi gpus. I have unique ids for each product so planning ...

Furkan Gözükara SECourses•12/19/23, 4:20 PM

with sufficient number of epochs i think should

FFurkan Gözükara SECourses i tried only batch size 1 and getting over 70% speed up

pat._.fenis•12/19/23, 4:41 PM

Still not seeing anywhere near a 70% increase.

25% increase, yes.
70%, no.

How are you equating this percentage ratio?

Ppat._.fenis Still not seeing anywhere near a 70% increase. 25% increase, yes. 70%, no. How...

Furkan Gözükara SECourses•12/19/23, 5:20 PM

what is your gpu

Hello all, Dr. o7 My name is Luke Williams. I'm a disabled hybrid traditional/AI artist learning SD

Similar Threads

Similar Threads

Similar Threads