Software Engineering Courses (SECourses)•10mo ago

@Dr. Furkan Gözükara can I do good inference with a 700$ gpu?

AiInfluenceOP•3/1/25, 11:36 AM

like a 4070

AAiInfluence @Dr. Furkan Gözükara can I do good inference with a 700$ gpu?

Furkan Gözükara SECourses•3/1/25, 11:41 AM

it is good as long as fits into vram

Furkan Gözükara SECourses•3/1/25, 11:41 AM

you can also get 2nd used rtx 3090

Furkan Gözükara SECourses•3/1/25, 11:41 AM

should be even cheaper

FFurkan Gözükara SECourses my unified downloader also downloads it

julius•3/1/25, 11:42 AM

ah okay awesome, thanks! Will check!

FFurkan Gözükara SECourses you can also get 2nd used rtx 3090

AiInfluenceOP•3/1/25, 11:43 AM

from Newegg?

AAiInfluence from Newegg?

Furkan Gözükara SECourses•3/1/25, 11:43 AM

depends on where you live

FFurkan Gözükara SECourses depends on where you live

AiInfluenceOP•3/1/25, 11:44 AM

Greece

JJ2_Nedo i know, but you know it also needs an update for the 5000er 😉

Furkan Gözükara SECourses•3/1/25, 11:44 AM

sadly this wont work yet

Furkan Gözükara SECourses•3/1/25, 11:44 AM

no torchaudio for windows for cuda128

Furkan Gözükara SECourses•3/1/25, 11:44 AM

but still testing

Furkan Gözükara SECourses•3/1/25, 11:45 AM

ye no windows. remind me tomorrow

Furkan Gözükara SECourses•3/1/25, 11:53 AM

wow this is really good compare

Furkan Gözükara SECourses•3/1/25, 11:54 AM

FFurkan Gözükara SECourses wow this is really good compare

AiInfluenceOP•3/1/25, 12:47 PM

fps boost ?

AAiInfluence fps boost ?

Furkan Gözükara SECourses•3/1/25, 1:06 PM

yes

Furkan Gözükara SECourses•3/1/25, 1:06 PM

working on implementation

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•3/1/25, 1:07 PM

@Dr. Furkan Gözükara Can the wan2.1 14b model run on 48 gb vram?

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 @Dr. Furkan Gözükara Can the wan2.1 14b model run on 48 gb vram?

AiInfluenceOP•3/1/25, 1:08 PM

yes

AiInfluenceOP•3/1/25, 1:08 PM

it uses 43.9gb

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 @Dr. Furkan Gözükara Can the wan2.1 14b model run on 48 gb vram?

Furkan Gözükara SECourses•3/1/25, 1:09 PM

yes it runs even at 24 gb

Furkan Gözükara SECourses•3/1/25, 1:09 PM

i didnt test 12gb yet but i expect work with sufficient RAM

Furkan Gözükara SECourses•3/1/25, 1:09 PM

16 gb runs too

FFurkan Gözükara SECourses yes it runs even at 24 gb

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•3/1/25, 1:11 PM

I am not asking about your gradio app. I am asking about installing it using their instructions on github and using the unquantized models.

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 I am not asking about your gradio app. I am asking about installing it using the...

Furkan Gözükara SECourses•3/1/25, 1:12 PM

nope

Furkan Gözükara SECourses•3/1/25, 1:12 PM

full model uses over 50gb

Furkan Gözükara SECourses•3/1/25, 1:12 PM

actually i am not sure how much full model uses

Furkan Gözükara SECourses•3/1/25, 1:12 PM

but with cpu offloading i think should work

Furkan Gözükara SECourses•3/1/25, 1:12 PM

fine on 48 gb

FFurkan Gözükara SECourses but with cpu offloading i think should work

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•3/1/25, 1:14 PM

I ran the installation according to their instructions on github and got cuda out of memory error. I will try the cpu offload now but not able to get their gradio running

Furkan Gözükara SECourses•3/1/25, 1:16 PM

ok it is getting ready

Furkan Gözükara SECourses•3/1/25, 1:16 PM

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 I ran the installation according to their instructions on github and got cuda ou...

Furkan Gözükara SECourses•3/1/25, 1:17 PM

you can ask on their github

FFurkan Gözükara SECourses you can ask on their github

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•3/1/25, 1:19 PM

they also have multi gpu inference

�𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮 they also have multi gpu inference

Furkan Gözükara SECourses•3/1/25, 1:19 PM

i think not working

julius•3/1/25, 7:05 PM

@Dr. Furkan Gözükara Do you know if I wanted to do a custom setup where I have the exact programs and files installed as soon as I initialize a machine on Massedcompute, could I do that with a Docker container or something like that?

Jjulius @Dr. Furkan Gözükara Do you know if I wanted to do a custom setup where I have t...

Furkan Gözükara SECourses•3/1/25, 8:02 PM

yes docker is choice

Furkan Gözükara SECourses•3/1/25, 8:02 PM

i think it already supports loading custom image

Furkan Gözükara SECourses•3/1/25, 8:03 PM

man family life taking so much time

i just came back to work

Furkan Gözükara SECourses•3/1/25, 9:28 PM

i am adding cfg and flow shift and rife to our wan app

Furkan Gözükara SECourses•3/1/25, 9:28 PM

almost done

FFurkan Gözükara SECourses fidelity is amazing image to video

masood•3/1/25, 9:31 PM

what model is this, DR?

Mmasood what model is this, DR?

Furkan Gözükara SECourses•3/1/25, 9:38 PM

wan 2.1 14b image to video

Furkan Gözükara SECourses•3/1/25, 9:38 PM

https://youtu.be/hnAhveNy-8s

YouTubeSECourses

Wan 2.1 AI Video Model: Ultimate Step-by-Step Tutorial for Windows ...

Alibaba’s new Wan 2.1 text-to-video, video-to-video and image-to-video Open Source AI is unbelievable. In this tutorial I will show how you can install Wan 2.1 all publicly published models into your Windows PC with 1-click installation and use them with the easiest possible way. With the Gradio APP I have developed, you will be able to use Wan ...