gokuvonlange
RRunPod
•Created by atu on 4/23/2025 in #⚡｜serverless
Has anyone successfully deployed a serverless instance using wan2.1 to generate i2v?
The Docker builds take a lot of time. Like I said earlier, I'm preloading / baking the model in the Dockerfile moving it straight in the /models folder of comfyui. So each build it has to upload a 100 GB+ docker image and then Runpod has to download / extract the image
35 replies
RRunPod
•Created by atu on 4/23/2025 in #⚡｜serverless
Has anyone successfully deployed a serverless instance using wan2.1 to generate i2v?
Whats your average execution time on the highest quality (720P 14B model)
35 replies
RRunPod
•Created by atu on 4/23/2025 in #⚡｜serverless
Has anyone successfully deployed a serverless instance using wan2.1 to generate i2v?
I've already been able to push down the execution time quite well.
CausVid lora + SageAttention + Cublas + FP16 accum. + Torch Compile
Running Wan 2.1 14B 720 model in max res (1280 x 720) for a 5 sec clip takes around 3 minutes on a H100 (80GB Pro)
Also preloading the models in the Dockerfile instead of a network volume helps tremendously cutting down execution time. That was my biggest time winner from 8-9 minutes > 3 minutes
35 replies
RRunPod
•Created by blue whale on 5/28/2025 in #⚡｜serverless
Credit is deducted while worker is still starting
These type of bugs are unacceptable imo... especially for me since my use-case revolves around H100's and a mistake like this would drain my balance in no time.
I hope RunPod reimburses your lost credits
7 replies
RRunPod
•Created by atu on 4/23/2025 in #⚡｜serverless
Has anyone successfully deployed a serverless instance using wan2.1 to generate i2v?
I'm right now in the process of optimizing to see if I can push the cost down for a single i2v - 720p - 5sec generation
35 replies
RRunPod
•Created by atu on 4/23/2025 in #⚡｜serverless
Has anyone successfully deployed a serverless instance using wan2.1 to generate i2v?
Yes I succesfully ran Wan 2.1 image2video 720 on H100's behind a serverless endpoint.
It's quite tricky to setup and took me 2-3 days and lots of docker rebuilds
35 replies