Only 1 CPU Core getting utilized
I wanted to deploy an ONNX model that utilizes CPU on RunPod. I am using uvicorn server for the same. I have selected Compute Optimized 5cpu with 16 vCPU and 32GB RAM. After testing using locust, the debugging showed that only 1 CPU core is being utilized. My code uses multiple threads created within the program.
To further confirm:
Which shows that only core 0 can be utilized by the process. This issue is specific to RunPod as it does not happen in my local laptop (Windows)
Is their any configuration to be done to allow this? Or any changes I need to make to my code to allow all cores to be utilized?
To further confirm:
Which shows that only core 0 can be utilized by the process. This issue is specific to RunPod as it does not happen in my local laptop (Windows)
Is their any configuration to be done to allow this? Or any changes I need to make to my code to allow all cores to be utilized?
