How in the hell do I get my files off my pod... ima pull my hair out...
How do my files off of the damn pod... this is the dumbest design I ahve ever seen. It almost makes sense and then is like of die in hell if you want your files... complete trash from a users standpoint... I dont mind paying but what the actual fuck
65 Replies
????
If you have SFTP access to the pod, you can connect and pull your files that way. If not, you’ll need to use the terminal and either upload your files somewhere (like with a simple script to Telegram or Google Drive) or package them into a Docker image and push it — so you can pull it anywhere later. Depends on what’s easier for your setup.
What a miserable pain in the ass… I may just try to find someone else with GPUs for rent just trying to speed up one task in my process this may not be worth it…
I’m just going to report this service as fraud on my card and go find another… will go back to using my A6000’s local. Absolute trash assholes for setting this up like this…
There are many ways to do it, you could install a runpod cli tool, here is a quick video, hope it helps: https://youtu.be/Z3bCRDvBSY8?si=YyvJC16MqD6YvDDM
https://github.com/runpod/runpodctl
RunPod
YouTube
Upload Files into RunPod Pod Instances - Simple methods: wget, runp...
Learn how to upload files into your pods through simple, no-fuss commands - drag and drop, wget, and runpodctl.
runpodctl download and install instructions: https://github.com/runpod/runpodct
Music Credit: Mellow Static by Cocosmusic https://pixabay.com/music/beats-mellow-static-287464/
GitHub
GitHub - runpod/runpodctl: 🧰 | RunPod CLI for pod management
🧰 | RunPod CLI for pod management. Contribute to runpod/runpodctl development by creating an account on GitHub.
Yea that’s what I’m going to do to get what I have finished down then I’m finding something less fucked
Why not just people access to the storage they are paying for in a reasonable way… I loved the experience until this part now I want to just get my shit off of it as fast and possible and find a service with a more reasonable and honest file management options…
Like I was like hell yeah can easily have users that can’t afford GPUs utilize this… oh no absolute bullshit to get your files down like the only thing I care about besides renting your whore GPUs
It’s fine don’t answer me I was about to batch process over 2000 LoRAs on your shit was just my test run to see if the service was worthy….
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
I just want to easily download my processed LoRAs just trying to supplement my stack of A6000s I just want to run like 20 4090 pods at once and download my data off the exploitable server without it be a major pain in the ass
The service itself fine up until I want my damn files back
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
Setup doesn’t have Jupiter, I just want to access the storage and get my Lora’s then move on to the next
I just want to pull the files from the workspace that’s it
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
This is on my windows box, Im needing to train from multiple machines while im out of the country was hoping to keep everything rolling hot if I can get it working. Do I need to do this for each pod or once its setup with the account eaiser to manage. I need like 10-20 pods going with FluxGym where I can just pull them easily. Im sorry for being pissed I just have always used all local and was like what the hell... eveything was easy but getting my files
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
I have one but had no intention of using it for this.
If i just pay for one of the cloud connectors what would be the easiest and quickest way for me to get this rolling...
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
yeah I was considering cloud connectors...
If not im assuming I will have to install runpodctl on each computer and authenticate pass keys or something for each pod
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
Local Lab FluxGym Lora Training with Kohya ss
thelocallab/fluxgym-flux-lora-training
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
Let me fire it back up... I paused them after I couldnt get the files
Im going to grab a coffee and see if I can get it setup... its spinning back up now
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
/app# which runpodctl
/usr/bin/runpodctl
it looks like its there I think i just to install and hook it up on my Windows side?
runpodctl v1.14.3
@Jason So i got it transferring empty files smh... so can i just make the pod with 0 container storage and like 200gb of volume storage and not have it wipe on closing without having to move all the files to the workspace....
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
I did like 70gb CS and 100gb VS just trying to avoid having to move the output after.
Thanks for the help I about have this beat
Unknown User•5mo ago
Message Not Public
Sign In & Join Server To View
yeah that makes sense... I will spin up one more test, and move it all, then download it all from runpodctl and see if I think its still worth scaling to 10-20x with having to do that for each one, every 2 hours.
@Jason success thanks man I was ready to find another service over what a pain that was... but once setup its not too bad. Now to scale it up and let it rip...
At first it was honestly incredibly infuriating and I was very glad I didnt just spin 10 up out of the hole. because I almost did.
Skill issues aren't fraud
bro if you think that is a normal way for anyone to get files you are high on paint... Im sorry I havent been drug into the world of broke mfers without gpus until this moment lol...
SFTP to get files from a remote machine is normal on 100% of hosting companies I use
but i got we are all good now... enjoy working for companies
But ultimately they are GPU rental, whatever software you run on it is you
true like I said everything was easy accept when I wanted my files back in the middle of the night... I dont mind paying but I have seen nothing but RunPod ads on everything for months finally decided to try it out... and admittedly it is pretty sweet and better than buying 8 H200 or 8 H100.... I get it now but boy that was a fat gottcha moment
Next time make sure you have an SSH key setup in your account
All the official templates from them, and my code canvas templates auto install an SFTP server if you have that
You login with something like WinSCP and your all set
awesome!
Just do it before tuning so you don't have that after the fact
I will do that real quick before I scale this out. Thanks for the advice! Im just a man on a mission firing off AI rockets lol... Im really not that big of an asshole lol
yeah this seems wayyy better
And unlike those jupyter UI's SFTP is pretty snappy
But you only get it if that key is set
Awesome I really appreciate it! Im going to see if I can get this going and then make 10 of them lol
And of course whatever template your using needs to have this, not all community made templates have this so always check first
Yeah I think that is what Im running into... Im using a template that was designed to push it to hugging face but that the last thing I want to do.
Public IP is also neccesary
Thats the thing, Runpod is a service which only purpose is hosting a docker image of choice. So you want a docker image you actually like
If you use a docker image that you don't like thats not their fault
it makes sense, I guess I just assumed I would be able to get my files out as easily as I got it in... but that was not the case set me back maybe 10-12 hrs but it should make up for it when Im generating 50-100 loras a day
Only if the docker was made that way
So really your beef was not with runpod but whoever made the docker, or if they have sftp on board with the lack of an SSH key
yeah im pretty sure that is 100% the case... it may be worth me just setting one up from scratch to do exactly what I want.
I have a template thats meant to be a blank canvas
https://henk.tech/ccnperunpod
I have it down to only needing 1-2 lines of code at the end to get what i want out of it!
That link of mine gets you jupyter, vscode and if you have your SSH key setup also SSH/SFTP (again make sure to get a pod with public ssh port)
Awesome Im going to run some pods how I have it now while I work through this. I know its going to be sick once its truly in action.
Before launching it you can change dependency versions by editing the template so if you want a different python or cuda you can
Oh and code canvas supports auto running a script both for installing and once installed
That is pretty awesome... thank you again. I will let you know once I have it up and going!
RUN_SCRIPT with a link to a script to run it after install (has its own tmux session)
INSTALL_SCRIPT for running your script before jupyter launches
As env variables
And then PACKAGES takes conda packages
Its a flexible one though so if you install incompatible stuff thats on you but also fixable most of the time
I have it all running locally on a couple machines on both Windows and linux. Im really familiar with what Im running just not in this ocean of insanity lol.
In docker?
its in something called pinokio right now with a Gradio front end to setup initial trainning.
I was using Comfy directly but this seems faster and is fairly easy for anyone to use for my batch. I still have to have a lot of things tweaked.
Comfy is such a dependency hell I avoid it haha
In theory it can be installed on codecanvas but all those additional things it always need are tricky
I love Comfy but I feel like it is kinda the weakest link in its own chain... It is really easy to write custom nodes for though
Try termius instead of putty next time
It doesnt look like from the 90s
Way user friendly interface
It seems like half of the servers on here are complete trash... have to sift through them because so many shit servers... Im not even on community... half the NC shit is trash and so far almost all the EU ones are lol