How fast are network volumes?
Hey, this kind of belongs into here, and also into serverless. For a client we're currently architecting some stuff, and the question we're having is, just exactly how fast are network volumes.
My limited benchmarks make it feel like they add about a minute for an SDXL Model to the execution time, because the Model needs to be loaded to RAM. This seems to be much faster with local storage.
What are your experiences, any pieces of advice? Any gotchas?
Thank you so much
A confused Devops Engineer who has to handle the customers need for speed.
My limited benchmarks make it feel like they add about a minute for an SDXL Model to the execution time, because the Model needs to be loaded to RAM. This seems to be much faster with local storage.
What are your experiences, any pieces of advice? Any gotchas?
Thank you so much
A confused Devops Engineer who has to handle the customers need for speed.
