Two Network Volumes
Id like to have an endpoint with a network volume but across data centers. I don’t mind if network volumes are in a different state as they act like a cache, however i’d like my traffic to be load balanced.
Is that possible ?
5 Replies
Not possible
You can only attach a single network volume to an endpoint
we are planning to allow this in serverless, my guess is sometime in march
Is this updated now?
No not yet
If I had the same need I would approach it by running a rsync server in a CPU pod. I would then create a serverless worker with 0 active workers and 1 max worker in every region with cheapest available CPU/GPU in that region and attach it to local storage in that region to it. You could then use cron on the rsync server to schedule syncs of the storage with the rsync workers. You could also configure your other serverless workers to connect to the pod and force a sync if they notice their models are not available. This solution with 10GB of global storage would cost ~ $52/month to run on RunPod. $43 of which is for the pod so adding additional storage is very inexpensive.
RunPod could implement the solution above and make it multi tenant and they would have true multi region cloud storage practically overnight. All the pieces are already in place.