How to Minimize I/O Waiting Time?
Hello,
I’m using serverless Runpod for ComfyUI, where I send and return image URLs, leveraging the Google Cloud Bucket SDK. My current flow is:
Runpod handler downloads the image using the URL.
The image is converted to base64 and sent to ComfyUI for processing.
ComfyUI processes the image and returns it as base64.
The Runpod handler uploads the processed image to Google Cloud and returns the URL.
This process involves two I/O operations: downloading and uploading. My serverless pod is idle while waiting for these I/O trips. Could you provide any advice on how to optimize this flow to reduce the I/O waiting time and allow the GPU to start processing faster?
Thank you for your help!
I’m using serverless Runpod for ComfyUI, where I send and return image URLs, leveraging the Google Cloud Bucket SDK. My current flow is:
Runpod handler downloads the image using the URL.
The image is converted to base64 and sent to ComfyUI for processing.
ComfyUI processes the image and returns it as base64.
The Runpod handler uploads the processed image to Google Cloud and returns the URL.
This process involves two I/O operations: downloading and uploading. My serverless pod is idle while waiting for these I/O trips. Could you provide any advice on how to optimize this flow to reduce the I/O waiting time and allow the GPU to start processing faster?
Thank you for your help!
