I noticed that for every 30 seconds of video, I got 900 frames.
I noticed that for every 30 seconds of video, I got 900 frames.
![Digital [Starburst]](https://cdn.discordapp.com/avatars/220961909447458817/8ecbbb3132fc6e44312f3d6d2ae3df69.webp?size=40)
DThen I took a look at the example video. It is only about 2 seconds long. If this works the way I think it does, a 5 second video is going to take about 1 hour per 1 second of video. Is there much you can do about the processing time?
DOkay a 10 second video creates 300 frames, so lets see how long it says that will take.
DI'm not even sure what to expect it to look like when it is done.
![Digital [Starburst]](https://cdn.discordapp.com/avatars/220961909447458817/8ecbbb3132fc6e44312f3d6d2ae3df69.webp?size=16)
Fit is about fps
DOkay. So what do I do with that to keep it from using too much VRAM?
DI download a video off a tube website that allows it using a downloader. I clip it to 10 seconds regardless of how long it is, but if I understand you correctly, I don't have to cut the video that short. Thing being that at 10 seconds it generates 300 frames and the ETA is around 9 hours to process it on a 4070ti.
DI have 12 GB of VRAM.
DI know you mentioned 16 is ideal, but I couldn't afford that, so I'm sort of making due with what I have.
Fonly way currently is making densepose video shorter
TWhy don’t I have a batch button?
TFbecause my auto installer uses my own gradio
Fnot llava gradio app
TWhat I installed is the automatic installation package released by your patreon.
Fcan you show me your install folder screenshot
T
T
T
F1 sec let me verify something
DOkay.
Fprobably download command didnt work
DFit must be due to a library missing
TI have reinstalled the computer system and installed the dependencies. I have two computers with the same problem
DI'm not getting the impression that SD is really built for video work. I've generated some mp4's I sent my family that made them motion sick. Other than that I haven't gotten it to do much.
Fi think it is because
Fyour folder has space character
DThe idea is cool, but I don't think the technology is there yet.
Fi will dm you now
Fi sent you gradio file put into this folder
Fye not very good
DI decided I didn't have the patience to wait nine hours to see what happens with a ten second video. When I checked the benchmark rank for graphics cards about the only thing better than what I have was a 4080. It had more VRAM, but cost nearly double the 4070ti.
DBefore video generation can really be used for anything useful they are going to have figure out a way to speed it up somehow with lighter hardware.
Fye it is slow
ADo the following work for both dreambooth, Lora, Textual inversion:
Basic Captioning
BLIP Captioning
GIT Captioning
WED14 Captioning
Manual Captioning
Or are the specific to each?
Basic Captioning
BLIP Captioning
GIT Captioning
WED14 Captioning
Manual Captioning
Or are the specific to each?
Fyes all works
Fit just different results
Aare there strength and weaknesses for them or do most just use BLIP?
Fyes each one fits
Fdifferent cases
Fi try them
JHello Dr. Furkan, i followed your tutorial to get a lora trained using a rtx 4090 gpu, but at my studio we are wanting to use multi-gpu training for sdxl, ive run into issues trying to configure kohya ss to do this properly (it ends up running into a memory issue after maxing out the memory of the first gpu), would you be willing to help me with this issue?
Fi am giving private consultation and i can help
Fbut gpus are on same machine right?
Jyea theyre on the same machine
Fthen i can help
JThank you! when can we talk about it?
Fi am available for several hours more from now on
J