error log:
2024-05-27T14:08:55.663521063Z RuntimeError: CUDA unknown error - this may be due to an incorrectly set up environment, e.g. changing env variable CUDA_VISIBLE_DEVICES after program start. Setting the available devices to be zero.
2024-05-27T14:08:55.902287850Z --- Starting Serverless Worker | Version 1.5.0 ---
I'm using comfyui , so I'll start the comfyui service before runpod.serverless.start, and the problem occurs occasionally, here is my code
echo "runpod-worker-comfy: Starting ComfyUI"
python /ComfyUI/main.py --output-directory /ComfyUI/tmp/outputs --input-directory /tmp/inputs --disable-auto-launch --disable-metadata &
echo "runpod-worker-comfy: Starting RunPod Handler"
python -u /ComfyUI/rp_handler.py
rp_handler.py inneholder runpod.serverless.start-koden, men det ser ut som om den starter comfyui for tidlig