Software Engineering Courses (SECourses)•10mo ago

it is very low for very big models

Furkan Gözükara SECoursesOP•3/4/25, 11:15 PM

you can try to set 100 gb virtual RAM

Furkan Gözükara SECoursesOP•3/4/25, 11:15 PM

and try FP8

FFurkan Gözükara SECourses it is very low for very big models

JaviEM•3/4/25, 11:15 PM

It needs more than 32GB?

JaviEM•3/4/25, 11:32 PM

the ram memory does not fill up at any time

JJaviEM the ram memory does not fill up at any time

Furkan Gözükara SECoursesOP•3/4/25, 11:34 PM

yes needs more

Furkan Gözükara SECoursesOP•3/4/25, 11:34 PM

try again and monitor from beginning

Furkan Gözükara SECoursesOP•3/4/25, 11:34 PM

probably you opened after died

FFurkan Gözükara SECourses probably you opened after died

JaviEM•3/4/25, 11:35 PM

this is before and after the crash. The small peak is the model loading

JJaviEM this is before and after the crash. The small peak is the model loading

Furkan Gözükara SECoursesOP•3/4/25, 11:36 PM

so it dies immediately

Furkan Gözükara SECoursesOP•3/4/25, 11:36 PM

set virtual ram = 100 gb

Furkan Gözükara SECoursesOP•3/4/25, 11:36 PM

this is mine

Furkan Gözükara SECoursesOP•3/4/25, 11:36 PM

i have 96 GB

FFurkan Gözükara SECourses so it dies immediately

JaviEM•3/4/25, 11:37 PM

instant

Furkan Gözükara SECoursesOP•3/4/25, 11:37 PM

so 173 - 96 GB is my virtual ram

JJaviEM instant

Furkan Gözükara SECoursesOP•3/4/25, 11:37 PM

you have 0 virtual ram

FFurkan Gözükara SECourses set virtual ram = 100 gb

JaviEM•3/4/25, 11:37 PM

I'll try

JaviEM•3/4/25, 11:44 PM

with 100gb of virtual ram is trying to do something

JJaviEM with 100gb of virtual ram is trying to do something

Furkan Gözükara SECoursesOP•3/4/25, 11:47 PM

yep

Furkan Gözükara SECoursesOP•3/4/25, 11:47 PM

trying to load models :d

Furkan Gözükara SECoursesOP•3/4/25, 11:47 PM

this is a 14b model not a small thing

Furkan Gözükara SECoursesOP•3/4/25, 11:47 PM

it is like twice of FLUX DEV

JaviEM•3/4/25, 11:48 PM

It's processing now, but it's ultra slow. +1 hour to generate a video with 50 frames

JaviEM•3/4/25, 11:49 PM

JJaviEM It's processing now, but it's ultra slow. +1 hour to generate a video with 50 fr...

Furkan Gözükara SECoursesOP•3/4/25, 11:49 PM

expected

Furkan Gözükara SECoursesOP•3/4/25, 11:49 PM

models are slow

Furkan Gözükara SECoursesOP•3/4/25, 11:49 PM

but working

Furkan Gözükara SECoursesOP•3/4/25, 11:49 PM

hopefully i will bring teacache i expect 40% speed up

Furkan Gözükara SECoursesOP•3/4/25, 11:50 PM

you can also do lower resolution, or 20 steps or lower frames

JJaviEM It's processing now, but it's ultra slow. +1 hour to generate a video with 50 fr...

J2_Nedo•3/4/25, 11:58 PM

i use for testing 50steps, but a low res like 480x480 or 512x512, this is ready in aprox 9mins, only if i see a good result, i can then start a highres with the same seed. i do batch rendering the whole night, so i wake up and have tons of clips ready

JJ2_Nedo i use for testing 50steps, but a low res like 480x480 or 512x512, this is ready ...

Furkan Gözükara SECoursesOP•3/5/25, 12:00 AM

nice strategy

Furkan Gözükara SECoursesOP•3/5/25, 12:01 AM

i got to be afk now need to sleep see you tomorrow hopefully

Furkan Gözükara SECoursesOP•3/5/25, 12:19 AM

fixed RIFE related errors : https://www.patreon.com/posts/123105403

Patreon

Wan 2.1 Ultra Advanced Gradio APP for - Works as low as 4GB VRAM - ...

Get more from SECourses: FLUX, Tutorials, Guides, Resources, Training, Scripts on Patreon

Furkan Gözükara SECoursesOP•3/5/25, 12:19 AM

now afk

FFurkan Gözükara SECourses machine could be broken in that case

VAMP•3/5/25, 2:01 AM

what do you think about this doc..
nvidia refuses to give us more vram
modders increased 24gb vram to 96gb.. problem solved
xDD
you should have bought this..i think it will be better than 5090 ...

druhl•3/5/25, 2:27 AM

Which factory is this?

Ddruhl Which factory is this? 😄

VAMP•3/5/25, 3:35 AM

somewhere in shenzhen..they say 48gb model is stable..96gb version is in testing phase and has some stability issue..

VVAMP what do you think about this doc.. nvidia refuses to give us more vram modders i...

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•3/5/25, 6:53 AM

There are a few people on reit in the LocalLama subreddit who have bought these cards and share their experience. While you get more vram their is no warranty of these cards can die any time.

�

𝗡𝗶𝘁𝗶𝗻 𝗣𝗮𝗿𝗲𝘃𝗮•3/5/25, 8:19 AM

This is a great model and gives almost flux quality images at 6b and also comes with apache 2.0 - https://huggingface.co/THUDM/CogView4-6B

THUDM/CogView4-6B · Hugging Face