authorization header is malformed

I get crazy, since 2 hours I try to access my storage via S3. I have my network volume on runpod, EU-RO-1. I have my S3 API created in my runpod account Somehow I get the error that "the authorization header is malformed; the region "us-east1" is wrong; expecting "eu-ro-1". Please contact your webhost for more information. What am I doing? I go to pod templates -> select my template kn for 5090 -> select on the top my volume -> therefore my region changes also to eu-ro-1 (since my network volume is selected) I start the pod, live laugh love everything is working, comfyui is running, I can access it I now want to upload my files into my volume so my comfyui workflow can access them, I open cyberduck/aws -> both give me the error stated above
Solution:
Some stuff such as #Better ComfyUI Slim (5090 supported) from @Elder Papa Madiator has a lot of these things already installed with file browser extension etc. Just be wary that #Better ComfyUI Slim (5090 supported) expects a clean network volume for it to set itself up and not conflict with other stuff
Jump to solution
13 Replies
J.
J.2mo ago
@nicore1608 how are you trying to access your s3 api? So it sounds like: 1. you created a pod 2. mounted it to your network volume 3. you wrote to it 4. trying to access it programmatically through some request? https://github.com/justinwlin/Runpod-Network-Volume-Storage-Tool I have a side project that has an interative mode that might make things easier:
uv run runpod-storage interactive
uv run runpod-storage interactive
im not sure what is: cyberduck/aws
J.
J.2mo ago
Looking at this: https://cyberduck.io/s3/ i think u are misunderstanding that network storage is not equal to an s3 bucket from AWS.
J.
J.2mo ago
S3 API on runpod means that we can programmatically accept some programmatic access behaviors, but we do not act / support all storage bucket operations I think that is maybe where you are getting confused, and thus why you get errors such as: "us-east1" bc that is an AWS region, not a runpod region, and probably not something we support
nicore1608
nicore1608OP2mo ago
Thanks dude, that helps a lot I think there's something I don't understand in general. I want to load my files onto the volume, how do I do that? My Runpod runs with the template kn 5090 comfy ui, so it saves to the volume comfyui and allows everything I do to be saved. Now I want to add my files, my models. How do I access the Runpod as a file explorer? When I open it on the web, I only get comfyui (makes sense since its my runpod template)
J.
J.2mo ago
So anything under the /workspace is automatically in the network volume If you start another pytorch official template by us ontop that same network volume, you'll see that the network storage stuff is the same files as your comfy ui files. What i linked, the github repo, is a method so you can access the network storage (the harddrive) without having to spin up a pod specifically since certain network storage depending on the region and data center allows for this sort of access protocol. In terms of adding your files / models, usually depending on your comfy ui template, you have a jupyter labs or some sort of other program on another port running, where you can run terminal commands such as: wget / curl "some url Which is then able to download the models to your specified directory @nicore1608 when you launch on a network volume you generally should see where do you want to mount it to, the default being /workspace Think of that as your "harddrive location" if you were to plug in a hard drive, anything written / read frrom there is persisted. and you can mount many pods on that same hard drive
J.
J.2mo ago
In terms of a GUI it's hard, you might need to modify the ports on your pod / you need access to some sort of terminal on your pod. I have an example here: https://docs.runpod.io/community-solutions/copyparty-file-manager/overview But you will need to restart your pod (which should be fine if everything is in a network volume, create a new port so that the application can launch / you can access it, and a terminal so you can run the install script)
Runpod Documentation
CopyParty file manager - Runpod Documentation
Web-based GUI for easy file browsing, uploading, downloading, and media viewing on Runpod
Solution
J.
J.2mo ago
Some stuff such as #Better ComfyUI Slim (5090 supported) from @Elder Papa Madiator has a lot of these things already installed with file browser extension etc. Just be wary that #Better ComfyUI Slim (5090 supported) expects a clean network volume for it to set itself up and not conflict with other stuff
nicore1608
nicore1608OP2mo ago
I will give it a shot, appreciate all your effort and explanations! - I've gotten a little smarter. I'll let you know if it worked
J.
J.2mo ago
@nicore1608 dmed u too
Madiator2011
Madiator20112mo ago
Nah better comfy Slim works fine with existing storages
nicore1608
nicore1608OP2mo ago
its working perfectly with the file browser provided with madiator's template, thank you so much both of you!! finally made it work ❤️
J.
J.2mo ago
ohh awesome thanks! 🙏 good to know
incomplete
incomplete4w ago
have the same problem, non of the S3 client UI works reliably, incluiding aws s3

Did you find this page helpful?