Using Multi process pool with serverless cpu sometime cannot stop.
for My Script speed increase. I use multiprocess for my LLM Translation (open-AI API Usage (LangChain)). but Sometime the worker stop with 0% cpu usage in very long time.
Continue the conversation
Join the Discord to ask follow-up questions and connect with the community
R
Runpod
We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!
R
