R
Runpod5mo ago
PBG

s3 object storage as mount

Hi im trying to mount my r2 model storage with rclone, but it fails. the same command worked locally and in google colab. Is there a way to unlock that feature for us?
16 Replies
Dj
Dj5mo ago
I don't think we let you mount directories if you're trying to associate it somewhere on the root (/), try inside /root?
PBG
PBGOP5mo ago
Actually i tried to mount in /home/comfyuser/r2_bucket
Unknown User
Unknown User5mo ago
Message Not Public
Sign In & Join Server To View
PBG
PBGOP5mo ago
actually you can let docker use mounts without privileged permissions, in my local docker-compose file I did it with: volumes: - /dev:/dev - ./r2_cache/:/mnt/r2_cache - ./output/:/home/comfyuser/ComfyUI/output - ./user/:/home/comfyuser/ComfyUI/user devices: - /dev/fuse:/dev/fuse # Mount FUSE device cap_add: - SYS_ADMIN # Required for mounting FUSE filesystems i wanted to use mount over download because it lets you download on demand. so instead of downloading all storage at once, models are only downloaded if app tries to access them (when using as mount). so I hope, Runpod team can unlock that feature as well
Madiator2011 (Work)
fuse wont work
PBG
PBGOP5mo ago
can u fix it?
Madiator2011 (Work)
not possible as nothing is broken
PBG
PBGOP5mo ago
i can use fuse in docker without privileged on my local machine, so why it is not possible on your side?
Madiator2011 (Work)
it's enable exposing fuse device
Dj
Dj5mo ago
SYS_ADMIN is a privileged permission.
Dj
Dj5mo ago
This is just what fit in a screenshot
PBG
PBGOP5mo ago
still it's less permissive compared to full privileged. anyways when you rent a VM on AWS / Google Cloud you usually get full root access to VM, so I think it would be great if you could give more control to clients as well. mounting is a widely used feature in the cloud computing that would also allow us to mount RO network volume to other EU regions (not through runpod UI but still)
Dj
Dj5mo ago
We just can't do that, our infrastructure provides Docker Containers instead of full VMs (why we do this, I don't know - but I think Container images are more portable anyway). We have to make limitations that keeps containers, containers. We can do things to provide full access to the server directly and block out whole servers so your containers can have (effective) root access but FUSE is one of those things that requires a capability we can't just give out.
PBG
PBGOP5mo ago
Sounds fair, maybe you can allow more multiple and third-party volumes from UI then? Its limited to only one volume and only Runpods network volume. I dont propose a specific soultion, I just want to be able to mount my other s3 storages, google drive etc - from UI or from cli doesnt matter.
Unknown User
Unknown User5mo ago
Message Not Public
Sign In & Join Server To View

Did you find this page helpful?