Runpod•14mo ago

Rundpod serverless Comfyui template

I couldn’t find any comfyui template on runpod serverless

Jason•11/15/24, 5:27 AM

It's not public, last time I saw some in github if you like

DEOGEEOP•11/16/24, 9:59 AM

I found the github. Thanks!

Jason•11/16/24, 10:00 AM

Nice

DEOGEEOP•11/16/24, 10:00 AM

I"m running into an issue now , Do you know how i can modify the files in my network volume ? I"m trying to add some loras to my workflow

DEOGEEOP•11/16/24, 10:01 AM

I'm using a custom template so there is no connection option when i start the pod

Jason•11/16/24, 10:01 AM

Just access it with pod if you like to

Jason•11/16/24, 10:01 AM

In pods it will be in /workspace

Jason•11/16/24, 10:01 AM

Use pytorch with jupyter runpod template in pod

DEOGEEOP•11/16/24, 10:01 AM

But i want to use a custom template

DEOGEEOP•11/16/24, 10:02 AM

I'm following the instructions on the foooocus github and apparently you have to set up the pod with their custom template

DEOGEEOP•11/16/24, 10:03 AM

No connection options

Jason•11/16/24, 10:04 AM

Well it's from the template I'm not sure how it's supposed to work maybe you read the Readme for guide?

Jason•11/16/24, 10:04 AM

And edit the pod to expose more ports

JJason Well it's from the template I'm not sure how it's supposed to work maybe you rea...

DEOGEEOP•11/16/24, 10:05 AM

This is the guide
https://github.com/davefojtik/RunPod-Fooocus-API/blob/NetworkVolume/docs/network-guide.md

Theres no instruction on how to do that

GitHub

RunPod-Fooocus-API/docs/network-guide.md at NetworkVolume · davefoj...

RunPod serverless worker for Fooocus-API. Standalone or with network volume - davefojtik/RunPod-Fooocus-API

Jason•11/16/24, 10:06 AM

Isn't it for serverless?

JJason And edit the pod to expose more ports

DEOGEEOP•11/16/24, 10:06 AM

I don't understand this

JJason Isn't it for serverless?

DEOGEEOP•11/16/24, 10:06 AM

Yes it is

Jason•11/16/24, 10:08 AM

Okay then its probably not for pod too

Jason•11/16/24, 10:08 AM

Serverless templates are for serverless mostly unless you design it for pod too

Jason•11/16/24, 10:08 AM

Best to differentiate them

DEOGEEOP•11/16/24, 10:11 AM

So there would be no way to edit the files?

Jason•11/16/24, 10:12 AM

There is, just use the pytorch and jupyter to download your files from somewhere

Jason•11/16/24, 10:12 AM

Why do you need that specific template that doesn't work with pod currently?

DDEOGEE This is the guide https://github.com/davefojtik/RunPod-Fooocus-API/blob/Network...

DEOGEEOP•11/16/24, 10:13 AM

I'm using that template because i'm following their guide

Jason•11/16/24, 10:31 AM

You using that cpu template?

DEOGEEOP•11/16/24, 10:38 AM

I just realized i'm using a gpu instead of a cpu

DEOGEEOP•11/16/24, 10:39 AM

But that should'nt matter right ?

DEOGEEOP•11/16/24, 10:39 AM

But yes i'm using that template but on a gpu

Jason•11/16/24, 10:40 AM

No, unless your running an app that requires the gpu driver and gpu itself

Jason•11/16/24, 10:40 AM

What template or image name are you using

Jason•11/16/24, 10:41 AM

Oh it doesn't require connection or manual setup

Jason•11/16/24, 10:41 AM

In the guide it just says you have to run the specific image, that they has made them wait check on the logs until it says it's done

Jason•11/16/24, 10:42 AM

I'm not advising on doing these tho, as for pre-built image that isn't checked can contain dangerous code or application s

DEOGEEOP•11/16/24, 10:42 AM

That's fair

DEOGEEOP•11/16/24, 10:43 AM

Eventually i plan on building my own image , but for now i want to test out their image

Jason•11/16/24, 10:43 AM

Yup seems like there's an setup script already

Jason•11/16/24, 10:43 AM

Yup sure.. Just saying so that you know it too

DEOGEEOP•11/16/24, 10:44 AM

I think i setup everything up correctly because i sent a request on the serverless endpoint and i got an image back

JJason Yup sure.. Just saying so that you know it too

DEOGEEOP•11/16/24, 10:44 AM

Thank You! I'll definately do that eventually. I just need a fast solution right now that's why i'm using their image

DDEOGEE I think i setup everything up correctly because i sent a request on the serverle...

DEOGEEOP•11/16/24, 10:45 AM

The issue i have is with adding the loras , i.e editing the network volume files

Jason•11/16/24, 10:45 AM

Ah yea just use runpod default template on gpu pod ( cpu pods are bugged right now, you cannot attach network storage )

Jason•11/16/24, 10:46 AM

Like pytorch, then use the web terminal after you run it, to connect the pod

JJason Ah yea just use runpod default template on gpu pod ( cpu pods are bugged right n...

DEOGEEOP•11/16/24, 10:47 AM

Oh so i can just ditch the template they recommended in their guide and use a runpod default template instead ?

Jason•11/16/24, 10:48 AM

Yeah their template is like a setup script only without open ports to connect

DEOGEEOP•11/16/24, 10:49 AM

Thank you! I'm doing that right now

DEOGEEOP•11/16/24, 10:49 AM

For some reason i thought i had to use their template or else it would'nt work

Jason•11/16/24, 10:53 AM

I think so , their template may contain a specific setup script specific to the application in the worker template

Jason•11/16/24, 10:53 AM

Maybe for easiness to setup

DEOGEEOP•11/16/24, 11:54 AM

Seems like i was able to add the loras using a runpod template on a pod , But i sent a request and the lora is not applied to the images . Do i need to restart anything ie the network volume , the serverless endpoint ..

DDEOGEE Seems like i was able to add the loras using a runpod template on a pod , But i ...

Jason•11/16/24, 11:55 AM

are they in the right paths?

Rundpod serverless Comfyui template

Similar Threads

Similar Threads

Similar Threads