Runpod•2y ago

how to stop scripts from replacing my configuration

I have a version of ComfyUI together with a version of python and it's dependendencies in a direcotry named /workspace on a storage volume. Everytime this pre_start script runs it wipes out my lib and starts over. I tried modifying the script but it gets regenerated every time I restart the pod. How to stop this?

Madiator2011 (Work)•7/18/24, 11:13 AM

@flick401 just to verify your issues is that you install custom nodes and on stop it gets wiped

flick401OP•7/18/24, 11:16 AM

No, my issue is that the comfy UI docker container runs a script called pre_start and replaces my python lib because it's outside of the mounted storage volume. I placed the python venv inside the workspace but now need that script to change path to /workspace/venv/python

Madiator2011 (Work)•7/18/24, 11:17 AM

#Better ComfyUI - CUDA12 my image solves this issue

flick401OP•7/18/24, 11:18 AM

So I'd have to do a fresh install with Better comfy?

flick401OP•7/18/24, 11:21 AM

Could you explain what your image does and the name? I've been trying to install comfyui for a few days now using the available image SD comfyui @Madiator2011 (Work) . Is it loaded with all the custom nodes I need (ip adapter, was suite, idm vton)?

Madiator2011 (Work)•7/18/24, 11:24 AM

it does save venv to workspace

Madiator2011 (Work)•7/18/24, 11:25 AM

and also it has lot of tools preinstalled that might be usefull for comfy ui

flick401OP•7/18/24, 11:40 AM

got it. I am deploying now

Madiator2011 (Work)•7/18/24, 11:43 AM

Let me know how it goes anlways happy to get some feedback

flick401OP•7/18/24, 11:53 AM

@Madiator2011 (Work) so first thing I noticed was that comfyUi was not deployed.
Second thing is that the python main.py --listen doesn not work

flick401OP•7/18/24, 11:55 AM

Traceback (most recent call last):
File "/workspace/ComfyUI/main.py", line 73, in <module>
import comfy.utils
File "/workspace/ComfyUI/comfy/utils.py", line 1, in <module>
import torch
File "/workspace/venv/lib/python3.10/site-packages/torch/init.py", line 238, in <module>
_load_global_deps()
File "/workspace/venv/lib/python3.10/site-packages/torch/init.py", line 197, in _load_global_deps
raise err
File "/workspace/venv/lib/python3.10/site-packages/torch/init.py", line 178, in _load_global_deps
ctypes.CDLL(lib_path, mode=ctypes.RTLD_GLOBAL)
File "/usr/lib/python3.10/ctypes/init.py", line 374, in init
self._handle = _dlopen(self._name, mode)
OSError: /workspace/venv/lib/python3.10/site-packages/torch/lib/libtorch_global_deps.so: cannot open shared object file: No such file or directory

flick401OP•7/18/24, 11:57 AM

I am going to try wiping out ComfyUI and starting over since the only thing this installation has is ComfyUi manager

Madiator2011 (Work)•7/18/24, 12:20 PM

ye you would need reinstall custom nodes so it preinstall required packages

Jason•7/18/24, 12:54 PM

If you use comfyui manager, install the pip dependencies like you first install comfyui manager then fix all package from the cm-cli of comfyui manager

flick401OP•7/18/24, 12:56 PM

@nerdylive I am running1 x RTX A4000
6 vCPU 23 GB RAM Is it possible that I get an error torch.cuda.OutOfMemoryError if I am doing something like this?

Jason•7/18/24, 12:56 PM

I don't know never used that node

Jason•7/18/24, 12:57 PM

Use the 24gb gpu vram at least

flick401OP•7/18/24, 1:00 PM

is it possbile to switch gpu?

flick401OP•7/18/24, 1:00 PM

without having to setup everything again?

Jason•7/18/24, 1:00 PM

Sure it's easy enough if you have data saved in a network storage (just use the same in another pod)

Jason•7/18/24, 1:00 PM

Or if you have it in a pod with no ns, you need to reinstall all of the files/program again

flick401OP•7/18/24, 1:01 PM

I have secure cloud network storage

Jason•7/18/24, 1:01 PM

Use the same template on another pod I guess

Jason•7/18/24, 1:01 PM

Yeah with the same network storage

Madiator2011 (Work)•7/18/24, 1:01 PM

if you used my template all thing should be saved on NS

flick401OP•7/18/24, 1:02 PM

I am going to shut down the current machine and use another gpu.

flick401OP•7/18/24, 1:02 PM

let's give it a try

Jason•7/18/24, 1:02 PM

Okay

flick401OP•7/18/24, 1:02 PM

terminating pod now

Jason•7/18/24, 1:03 PM

Chill, it's fine don't need to update everything here

flick401OP•7/18/24, 1:05 PM

sorry, it's just my 7th time having to setup everything all over again and wnted to just make sure I did things right. Terminating and stopping are two different things but there was no other option. Just nervous I will have to redo everything again.

flick401OP•7/18/24, 1:09 PM

btw @Madiator2011 (Work) There are 20 GB it needs to download everytime you terminate the pod and run it again. Any guess as to what it is downloading?

Madiator2011 (Work)•7/18/24, 1:12 PM

Its base image + build in models

Fflick401 sorry, it's just my 7th time having to setup everything all over again and wnted...

Jason•7/18/24, 1:19 PM

All good, if youre not sure better to stop it first if you have the option to(you don't when you use ns)

flick401OP•7/18/24, 1:25 PM

Ok, that seems to have done it. But I did notice that it was more CPU intensive than GPU. Is that because somewhere I am not configuring comfy to use GPU for processing?

Madiator2011 (Work)•7/18/24, 1:25 PM

nope usually yo do not need do anything to run on gpu

Jason•7/18/24, 1:33 PM

maybe use gpu sampler for more speeds

Jason•7/18/24, 1:33 PM

but it changes abit on the image generation process... ( im not really sure how to explain but you can experiment )

flick401OP•7/19/24, 11:13 AM

@Madiator2011 (Work) you may need to adjust your script to not create a venv in the root. and instead use the python instance in the /workspace

Madiator2011 (Work)•7/19/24, 11:15 AM

@flick401 whats the context

Jason•7/19/24, 11:15 AM

venv in / ?

Madiator2011 (Work)•7/19/24, 11:15 AM

though on what template we talk about

flick401OP•7/19/24, 11:16 AM

bettry comfy ui

Madiator2011 (Work)•7/19/24, 11:16 AM

This is correct behaviour

flick401OP•7/19/24, 11:16 AM

when I do any kind of pip install -r requirements.txt it begins installing everything in the /venv/lib/python3.1.0/site-packages

Madiator2011 (Work)•7/19/24, 11:17 AM

as on secure cloud /workspace is being overwritten

Madiator2011 (Work)•7/19/24, 11:17 AM

did you activated venv first?

flick401OP•7/19/24, 11:18 AM

even if I activate the script first it still uses the /venv

Madiator2011 (Work)•7/19/24, 11:18 AM

what kinda script you try to run

how to stop scripts from replacing my configuration

Similar Threads

Similar Threads

Similar Threads