Huski
RunPod + ComfyUI Setup Help (Torch 2.4)
does it have to download new stuff if I change GPU?
I'm sorry for the dumb questions but I'm very new to this🙂
I just want to understand if it can cause problems to sometimes change GPU while using the same network storage and 5090 template
44 replies
RunPod + ComfyUI Setup Help (Torch 2.4)
it takes like 10/12 minutes to load ComfyUI every time I open the pod.. I don't think that's quite normal, isn't it?
when I open the Report seems like it's downloading all sorts of stuff every time..
I'd love to keep using Runpod, but it'd need to receive assistance on this...is there I way I can get some help from your team?
44 replies
RunPod + ComfyUI Setup Help (Torch 2.4)
Hi @papaerai I'm having a lot of troubles in Installing Sageattention.. would it be possible to have this template with Sageattention properly installed?🙏
I'm currently using this template:
🖥️ Regular Template - For most GPUs (CUDA 12.4)
44 replies
RunPod + ComfyUI Setup Help (Torch 2.4)
hi @Madiator2011 I’m using your template, however I’m constantly running into Out of Memory issues. My template crashes completely when VRAM hits 100%. It seems like the VAE decoder hits OOM, but instead of handling it (like switching to tiled mode), it just crashes the whole instance. It looks like the template I’m using doesn’t have any mechanism to prevent or recover from OOM errors, could you help me?
44 replies
RunPod + ComfyUI Setup Help (Torch 2.4)
one last thing, I already have a network storage that I've used with another template previously, is it safe to just use that storage with this Regular Template? or is it better to just create one new?
first option would be better because I have a lot of checkpoints, Loras and workflows already installed there
44 replies
RunPod + ComfyUI Setup Help (Torch 2.4)
thank you
I'm experimenting on some workflows and I was thinking about using a less expensive GPU like the A4500, just to see if there are errors n stuff; after having the workflow ready, I would like to use a more powerful GPU to just run the workflow and do some batch renders of images and videos.. and I was thinking about using a more powerful GPU like the 5090.
(I'm a novice) So my questions are the following:
- Should I choose the 5090 optimized template for this use case? with that template will I be able to also run other gpus with less advanced CUDA versions?
- last thing, about the Pytorch version, having a Nightly version for the optimized template can mean having some issues on Checkpoints, Loras or other assets, because it's still an experimental version?
Maybe the best option could be to go with the Regular Template and for batch rendering use a GPU that's less powerful than the 5090..
What would you do in my position?
Thank you very much for your help
44 replies
RunPod + ComfyUI Setup Help (Torch 2.4)
Thanks Jason, this template is probably exactly what I need right now actually
I'm relatively new to this and I'd highly appreciate a little bit of help from the team or someone competent 🙂
Can I ask you a couple of questions regarding this template?
-First one is - I read Optimized for 5090 - since I often choose the 4090 for working, does that work as well? where does the optimization part comes in here?
-Also, I read Pytorch Nightly... excuse my noob question but which version is it? 2.7? I'm looking to use I2V optimizations such as Sageattention, TeaCache, bf16.. will these be supported?
-Last one, I can read "FileBrowser for easy file management" what is this option?
Thank you so much for your help🙏
44 replies