R
RunPod•2mo ago
Ralph

Serverless can take several minutes to initualise...?

Should this be the case? An on-demand H100 is pointless to our business if I have to wait 30 seconds on average for it to start up and sometimes several minutes.
9 Replies
nerdylive
nerdylive•2mo ago
Hi what template do you use?
Ralph
Ralph•2mo ago
I have attached screenshots
Ralph
Ralph•2mo ago
No description
No description
No description
nerdylive
nerdylive•2mo ago
oh and 30 seconds~ in cold starts?
haris
haris•2mo ago
@Ralph are you able to provide your pod ID?
digigoblin
digigoblin•2mo ago
Its serverless, no pod id Probably need endpoint id
haris
haris•2mo ago
Ah wait yeah, endpoint ID, sorry
Ralph
Ralph•2mo ago
td0ztman6jeou9 It could well be user error by me. When we first tried serverless it was taking 10-20 seconds from a cold boot to start working
nerdylive
nerdylive•2mo ago
hmm alright lets wait for the runpod's team to check later too!
Want results from more Discord servers?
Add your server
More Posts
Maximum size of single output for streaming handlersWe are currently trying to refactor our RunPod handlers to work asynchronously with streaming of res401 Unauthorizedhaving used a combination of ashleyk's readme and generativelabs video, I have setup a runpod oobaboHow do i add cronjob in a pod?I am using a pytorch image for my pod. I have cloned my repository and created an environment, as weServerless suddenly stopped workingAll my serverless machines disappeared, including my always-on machines. My endpoint is now stuck atCan't connect to Civital lately when donig WGET commands, what am I doing wrong?Username/Password Authentication Failed. root@8350c17f8def:/workspace/ComfyUI/models/checkpoints/sdxTensorRT-LLM setupHas anyone been able to successfully install tensorrt_llm? I'm trying with pip, but I'm running inBalance DisappearedHi, I had an account on Run Pod a long while ago before all the UI changed. I had a Pod as well. I rStable Diffusion Extension Installation Issues:Hi! I'm new to this whole Discord and RunPod, so sorry if I've posted this in the wrong place or madIs it possible to make port 443 externally accessible?Is it possible to make port 443 externally accessible? I want to remove the port number from the DNSHaving problems working with the `Llama-2-7b-chat-hf`I have the following request going to the `runsync` endpoint. ``` { "input": { "prompt":