BAS014
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
Hi @Stewette, @nerdylive I wasnt successfull so I sent a support ticket to RunPod. They replied and asked for logs. I'll let you know what happens.
28 replies
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
Great, let me try, Thanks @nerdylive!
28 replies
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
I'll try a few different configs etc. maybe I find something. will keep you updated
28 replies
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
I've tried "meta-llama/Meta-Llama-3-8B-Instruct"
and getting the same result as @Stewette
28 replies
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
28 replies
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
I’ve been running the request from my python app and the Hello World request test in serverless setup
28 replies
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
Ok perfect, thanks so much.
I’ll try a smaller model
28 replies
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
Ok yeah, how long does that take?
It runs for 10 minutes then I’ve terminated the worker, last night at one stage it ran for 35 minutes and then I terminated it.
Not sure how this works.
Thanks for the help
28 replies
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
Hi @nerdylive
Thanks so much for the response. appreciated.
From what I understand "mistralai/Mistral-Small-24B-Instruct-2501" and "deepseek-ai/DeepSeek-V3" should be fine. vLLM support.
"deepseek-ai/DeepSeek-V3" is one of the suggested models when creating an end-point, and that does it too.
I've left the execution timeout to 600 seconds.
Can't find anthing suspicious in the logs.
The setup was pretty much default except for MAX_MODEL_LEN = 8192 (as suggested in the docs)
Maybe I'm missunderstaning something regarding the models I've tried.
Thanks again
28 replies
RRunPod
•Created by BAS014 on 2/8/2025 in #⚡｜serverless
Workers keep respawning and requests queue indefinetely
Oh and these are the regions I tried eu-se-1 and eur-is-1 and eur-is-2. incase that could be the issue
28 replies