BAS014
BAS014
RRunPod
Created by BAS014 on 2/8/2025 in #⚡|serverless
Workers keep respawning and requests queue indefinetely
Hi there I tried asking in the "ask-ai" channel. but I need some more help. "I've just deployed a servless endpoint on 3 regions, when 1 worker gets to about 7 mins running, it goes to idle then spawns a new worker. over and over. Is this normal? its a small model and workers have been running now for a bout 35 mins? I tried a request but that just goes into a queue and doesnt get completed" I then deleted my endpoint and recreated and still the same. I've tried "mistralai/Mistral-Small-24B-Instruct-2501" and then "deepseek-ai/DeepSeek-V3" Maybe the models are the issue? I understand you dont pay when workers are in idle? Now I manually terminated the worker and canceled the request else it will run till my credit is finished. Anyone have any ideas or am I missing something, do I have to create a handler because the docs dont say I need to before I run the "hello world" test? Thanks
28 replies