making the gradio app installer
making the gradio app installer
1
1I'd be interested in helping to test
Ftrying to make installer
Fdmn it uses flash attention forcedly
Fi installed weird testing again
Fok downloading models fingers crossed
Fgenerating video
F
1looks promising
Fafter prompt enhance it doesnt deload model lol
F
Fvae decoding taking forever
Fexcellent
F1ohh damn, that's only the 1.3B model
Fyes
Fdownloading 14b model for image to video
Fbut i dont know if will fit vram
Fprobably not
Fand i can use 5090 yet 
Fbut i am gonna make installer for runpod and massed compute too
1I think it's 50+Gb unquantised.
Fdmn probably wont fit
Fi dont see quant option on the repo
1but that is FP32. FP16 should be managable
Fdid you check their pipeline?
Fwhere it is cast :d
1No, haven't had a chance to take a look, stuck in work meetings atm
1I've just sold my 4090 too so will need to wait for torch to work with 5090
Fi kept 3090 just for this casue 
1I've still got a 3090 but no space in the case. 5090 is taking too many slots 
Fthis is how i use
Fimage to video failed 13b
1reminds me of my mining days
C1that 5090 performance
CAdded L40
CWe had one server causing this to happen frequently over the last week, I suspect you ran into it. We stopped new rentals on it, and refunded a ton of VM rental attempts that went to it.
CWe are working on some improvements around this. I know connecting to the VM before its fully ready can cause a problem, but if you continue to run into this and have error messages we can look at we'd appreciate if you send them them to us so we can be certain its something on our radar.
CI know sometimes its takes a really long time to start and we are still working on speeding it up and making it more consistent. If a VM truly just doesn't start and you let us know we are pretty good about refunding them.
Fi just found a way to reduce 1.3B model for 6GB and 14B model for 10GB GPUs. i think it will be very reasonable time for 5 second videos working on it
Fvery nice table
Cexpensive GPUs make a lot more sense at FP16
1can't wait to start playing around with
1please say you'll have the installer released soon. I'll hold off sending the 4090 for some testing.
F100%
Fworking on installer and a unique gradio app
Ffor windows, runpod and massed compute
Fwriting it from scratch
