Rundpod serverless Comfyui template
I couldn’t find any comfyui template on runpod serverless
65 Replies
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
I found the github. Thanks!
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
I"m running into an issue now , Do you know how i can modify the files in my network volume ? I"m trying to add some loras to my workflow
I'm using a custom template so there is no connection option when i start the pod
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
But i want to use a custom template
I'm following the instructions on the foooocus github and apparently you have to set up the pod with their custom template
No connection options
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
This is the guide
https://github.com/davefojtik/RunPod-Fooocus-API/blob/NetworkVolume/docs/network-guide.md
Theres no instruction on how to do that
GitHub
RunPod-Fooocus-API/docs/network-guide.md at NetworkVolume · davefoj...
RunPod serverless worker for Fooocus-API. Standalone or with network volume - davefojtik/RunPod-Fooocus-API
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
I don't understand this
Yes it is
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
So there would be no way to edit the files?
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
I'm using that template because i'm following their guide
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
I just realized i'm using a gpu instead of a cpu
But that should'nt matter right ?
But yes i'm using that template but on a gpu
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
That's fair
Eventually i plan on building my own image , but for now i want to test out their image
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
I think i setup everything up correctly because i sent a request on the serverless endpoint and i got an image back
Thank You! I'll definately do that eventually. I just need a fast solution right now that's why i'm using their image
The issue i have is with adding the loras , i.e editing the network volume files
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
Oh so i can just ditch the template they recommended in their guide and use a runpod default template instead ?
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
Thank you! I'm doing that right now
For some reason i thought i had to use their template or else it would'nt work
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
Seems like i was able to add the loras using a runpod template on a pod , But i sent a request and the lora is not applied to the images . Do i need to restart anything ie the network volume , the serverless endpoint ..
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
I'm pretty sure they are
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
Yes
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
Based on the logs it seems like the lora 'cyberpunk.safetensors' is loaded correctly because if i use a lora name that doesnt exist it gives an error
So probably a problem with the requests
This is unrelated but , i ran my main.py comfy file and its running
I'm using the runpod pytourch template , how can i access the comfy ui
The only open port is that of jupyter
I exposed some ports but i get 'Bad Gateway' when i try to access them
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
But it shows it's running on 8188 @nerdylive
If it helps , my pod is : https://33o7gxa40lsyop-8888.proxy.runpod.net/lab/workspaces/auto-y
the password is 1234
if you run pip install -r requirements.txt
and then python main.py
the server should start running on port 8188
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
Where should i change if from
I changed it from the main.py file
but for some reason its still running on 127.0.0.1
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
Oh my GOD!
It worked!!
Thank you soo much!!
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
By any change are you familiar with the comfy ui worker : https://github.com/blib-la/runpod-worker-comfy/
GitHub
GitHub - blib-la/runpod-worker-comfy: ComfyUI as a serverless API o...
ComfyUI as a serverless API on RunPod. Contribute to blib-la/runpod-worker-comfy development by creating an account on GitHub.
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
Your solution works , i can now view the ui on the port 8188 and generate my images successfully
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
But when i use the serverless endpoint with the same workflow json , i get an error
2024-11-19 14:00:45.074 [c7msa02ut39p9w] [info] invalid prompt: {'type': 'invalid_prompt', 'message': 'Cannot execute because node FaceDetailer does not exist.',
It seems like the custom nodes are not being recognized in the serverless endpoint even though i have the snapshot.json in the /runpod-volume (/workspace) directory
If i try a request with no custom nodes on the runpod serverless endpoint , it works fine.
Wierd thing is it works completely fine on ComfyUI but not on the serverless endpoint
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
I deceided to build the image myself @nerdylive
When i use it on runpod serverless , i get error
[error]
worker exited with exit code 127 and it keeps running indefinately
The worker shows unhealthy: Exiting prematurely before requesting jobs.
and its initializing indefinately
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
This server has recently suffered a network outage and may have spotty network connectivity. We aim to restore connectivity soon, but you may have connection issues until it is resolved. You will not be charged during any network downtime.
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
It seemed like the error was caused because the line endings were converted to CRLF automatically in my windows machine. I was able to convert all the line endings to LF and now i'm getting a new set of errors when i push the image to dockerhub and use it as a serverless template on runpod 😉
Unknown User•12mo ago
Message Not Public
Sign In & Join Server To View
How will i do that? Normally i just build the image and push to dockerhub. And use the image as a template on runpod serverless.
How should i reistall the dependencies ?
You mean rebuild the image again?
Unknown User•11mo ago
Message Not Public
Sign In & Join Server To View