Workers keep respawning and requests queue indefinetely
Hi there
I tried asking in the "ask-ai" channel. but I need some more help.
"I've just deployed a servless endpoint on 3 regions, when 1 worker gets to about 7 mins running, it goes to idle then spawns a new worker. over and over.
Is this normal? its a small model and workers have been running now for a bout 35 mins? I tried a request but that just goes into a queue and doesnt get completed"
I then deleted my endpoint and recreated and still the same.
I've tried "mistralai/Mistral-Small-24B-Instruct-2501" and then "deepseek-ai/DeepSeek-V3"
Maybe the models are the issue?
I understand you dont pay when workers are in idle?
Now I manually terminated the worker and canceled the request else it will run till my credit is finished.
Anyone have any ideas or am I missing something, do I have to create a handler because the docs dont say I need to before I run the "hello world" test?
Thanks
I tried asking in the "ask-ai" channel. but I need some more help.
"I've just deployed a servless endpoint on 3 regions, when 1 worker gets to about 7 mins running, it goes to idle then spawns a new worker. over and over.
Is this normal? its a small model and workers have been running now for a bout 35 mins? I tried a request but that just goes into a queue and doesnt get completed"
I then deleted my endpoint and recreated and still the same.
I've tried "mistralai/Mistral-Small-24B-Instruct-2501" and then "deepseek-ai/DeepSeek-V3"
Maybe the models are the issue?
I understand you dont pay when workers are in idle?
Now I manually terminated the worker and canceled the request else it will run till my credit is finished.
Anyone have any ideas or am I missing something, do I have to create a handler because the docs dont say I need to before I run the "hello world" test?
Thanks
