R
RunPod3mo ago
Waosh76

cant get my pod to work right

hi im new to runpod im trying to add models and loras to my runpod as well as trying to install runpodctl but i cant figure it out when i try to follow the tutorial for the runpodctl i keep getting errors. Help would be greatly appreciated thank you in advance
197 Replies
Madiator2011
Madiator20113mo ago
what error you get?
Waosh76
Waosh763mo ago
when i put the windows link like in the tutorial i get error 404
No description
Waosh76
Waosh763mo ago
and whenever i try running python relauncher.py like in the video i get an error message and it keeps trying again and idk how to stop it shutting down the terminal doesnt work like error 404 and it doesnt recognize the ckpt file
Madiator2011
Madiator20113mo ago
you need use powershell
Waosh76
Waosh763mo ago
how do i do that do i need to download it from somewher?
Madiator2011
Madiator20113mo ago
btw if you use one of @ashleyk templates they have my uploader tool included
Waosh76
Waosh763mo ago
where do i get it and what does the uploader tool do?
Madiator2011
Madiator20113mo ago
aka you can upload models via web browser
Waosh76
Waosh763mo ago
that would be most useful where can i find the template?
Madiator2011
Madiator20113mo ago
most recent is at https://www.runpod.io/console/explore/ts8ze6urzh Note you need use filter and pick CUDA 12+
Waosh76
Waosh763mo ago
whats that
Madiator2011
Madiator20113mo ago
also read the text you will see in that link
Madiator2011
Madiator20113mo ago
after pressing deploy you will see this click the last icon
No description
Madiator2011
Madiator20113mo ago
then change allowed CUDA version
No description
Waosh76
Waosh763mo ago
then select a pod that has it
Madiator2011
Madiator20113mo ago
pick then gpu you want
Waosh76
Waosh763mo ago
k i launched it
Madiator2011
Madiator20113mo ago
btw on customize section you might up volume storage
No description
Waosh76
Waosh763mo ago
wheres that before starting it?
Madiator2011
Madiator20113mo ago
after you pick gpu
Waosh76
Waosh763mo ago
o i already launched the pod its downloading stuff extracting*
Madiator2011
Madiator20113mo ago
you can always press 3 lines icon and edit pod
Waosh76
Waosh763mo ago
should i wait until its done with all the setting up or is it safe to do it now
Madiator2011
Madiator20113mo ago
it's safe just make sure to up it if you plan uploading lot of models
Waosh76
Waosh763mo ago
k its up where do i upload models and stuff?
Madiator2011
Madiator20113mo ago
click connect and button with 2999 is my uploader tool
Madiator2011
Madiator20113mo ago
No description
Madiator2011
Madiator20113mo ago
then you can drop model files there
No description
Waosh76
Waosh763mo ago
k its taking a bit tho bc models files are big... i dont need to do this again unless i terminate right
Madiator2011
Madiator20113mo ago
if you stop pod the models will stay but someone can take the hpu so you could end up with 0 GPU issue if you terminate pod it will delet both container and volume storage
Waosh76
Waosh763mo ago
its not an issue if i wait until its free again tho right
Madiator2011
Madiator20113mo ago
yes btw my uploader has cool thing that allows you to pause and resume upload
Waosh76
Waosh763mo ago
you wouldnt have something to speed the upload up by chance 😭 also does it work to upload more stuff while i use it and refresh/restart if after?
Madiator2011
Madiator20113mo ago
not sure what you mean?
Waosh76
Waosh763mo ago
like can i upload a model or lora and generate stuff in another window at the same time
Madiator2011
Madiator20113mo ago
I mean you can upload multiple file at once
Waosh76
Waosh763mo ago
can i upload vaes as well or are some already included?
Madiator2011
Madiator20113mo ago
I mean my tool is not made to limit what file you can upload note you will need to move them after upload as they are saved to /workspace
Waosh76
Waosh763mo ago
k i suppose thatll be in the port 888 in the folder like it would be if i had it locallly
Madiator2011
Madiator20113mo ago
yes there is jupiter nootebook included anyway late here just in case ask @justin [Not Staff]
Waosh76
Waosh763mo ago
k ty for your help
justin
justin3mo ago
https://discord.com/channels/912829806415085598/1194711850223415348 https://discord.com/channels/912829806415085598/1208261602315345951 i mean many ways to upload if ur talking about from ur computer to the pod as said in the easy way to ssh to pod / file transfer; or using the uploading tool madiator has some faster than others and then downloading models directly to the pod just standard hf / civitai requests
Waosh76
Waosh763mo ago
madiators seems to work well but its quite slow for me at least
justin
justin3mo ago
ur ultimately bottlenecked by ur internet / http request
Waosh76
Waosh763mo ago
yea...
justin
justin3mo ago
the fastest u can get is probably scp through ssh connection with an existing pod u can do the password ssh setup i detail in the ssh guide / then use scp to transfer stuff over that the fastest ull get if from local computer or u make the request to download from the pod which can be decently fast so instead of ur computer to pod, which is prob bottleneck by ur internet, the pod has faster internet in general and can download direct from some source
Waosh76
Waosh763mo ago
ill try that but i didnt understand a thing you just said sry
justin
justin3mo ago
Just like from the pod u run a curl command to download ur model lile curl <some url> to download model from ur pod terminal Is prob the easiest can read the hugging face / civitai download guide
Waosh76
Waosh763mo ago
you mean the jupiter notebook? @justin [Not Staff] is the openssh already on the template?
justin
justin3mo ago
No from terminal If ur using runpod official templates yes The jupiter notebook has a tab u can open called terminal where u can write commands
Waosh76
Waosh763mo ago
o that ty i was confused
justin
justin3mo ago
https://www.phind.com/search?home=true / Chatgpt are great to ask more questions. just know that if anything tells u to do sudo some command u can remove sudo for runpod
Waosh76
Waosh763mo ago
so i need to setup this right
No description
justin
justin3mo ago
You can for a running pod use the password setup
justin
justin3mo ago
GitHub
Runpod-Tips-and-Tricks/SSH On Runpod at main · justinwlin/Runpod-Ti...
Runpod Tips and tricks repository. Contribute to justinwlin/Runpod-Tips-and-Tricks development by creating an account on GitHub.
Waosh76
Waosh763mo ago
so i put this in terminal? pip install OhMyRunPod OhMyRunPod --setup-ssh cat /workspace/root_password.txt
justin
justin3mo ago
as individual commands and not all at once yes so line by line copy and paste it in and click enter
Waosh76
Waosh763mo ago
i did so now what do i need to do
Madiator2011
Madiator20113mo ago
btw if you have my uploader app you can go to admin pannel open admin pannel in new window and press setup ssh
Waosh76
Waosh763mo ago
what do i do with the password it gives me?
Madiator2011
Madiator20113mo ago
you also get 2 files for connecting with windows or linux
justin
justin3mo ago
WHen you run the SCP command or an ssh command it will ask u for a password
justin
justin3mo ago
GitHub
Runpod-Tips-and-Tricks/SSH On Runpod/README.md at main · justinwlin...
Runpod Tips and tricks repository. Contribute to justinwlin/Runpod-Tips-and-Tricks development by creating an account on GitHub.
justin
justin3mo ago
U can run the ssh command from ur actual computer terminal / command prompt and see if u can connect to runpod and then if that works, in a new terminal u can run the SCP command
Waosh76
Waosh763mo ago
you mean my own computer or the terminal of jupyter
justin
justin3mo ago
ur own computer ur laptop / desktop
Waosh76
Waosh763mo ago
so the cmd terminal
Madiator2011
Madiator20113mo ago
you can also use filezilla
Waosh76
Waosh763mo ago
which one is it
justin
justin3mo ago
run the ssh command in command prompt from ur actual computer to see if u can establish a connection for testing U must btw switch out the @root address to whatever it is for ur pod
Waosh76
Waosh763mo ago
whats the command tho i cant find the right one
justin
justin3mo ago
No description
Madiator2011
Madiator20113mo ago
press connect button on m y pods page
justin
justin3mo ago
wonder if it told him this lol
Waosh76
Waosh763mo ago
where do i see the root of my pod
Madiator2011
Madiator20113mo ago
root is just udername
justin
justin3mo ago
No description
Madiator2011
Madiator20113mo ago
username
justin
justin3mo ago
oh rlly? huh. but i guess as another way is u can look under tcp port mapping and replace the numbers with ur own -p is that external port i believe so for ex. the image i sent it is:
ssh root@194.68.245.28 -p 22198 -i ~/.ssh/id_ed25519
ssh root@194.68.245.28 -p 22198 -i ~/.ssh/id_ed25519
Madiator2011
Madiator20113mo ago
you can just copy command from connect button
justin
justin3mo ago
i think his doesn't show it cause he has no ssh public keys on his runpod profile from this image
Waosh76
Waosh763mo ago
i put the ssh command in my pc it didnt work with changing the root and external as well
justin
justin3mo ago
what did u get?
Waosh76
Waosh763mo ago
no such file or directory
justin
justin3mo ago
can u copy and paste ur command? that seems wrong
Waosh76
Waosh763mo ago
connect to hos ... connection refused
justin
justin3mo ago
hm send me ur command? just wondering does this pod matter? like do u have existing stuff on it? XD
Waosh76
Waosh763mo ago
no
justin
justin3mo ago
Ok Just for the sake of simplicity: You can terminate the pod then
Waosh76
Waosh763mo ago
i did
justin
justin3mo ago
Just wondering, I guess, let's just start with first: What do u want to download? Are these models custom? Or from where?
Waosh76
Waosh763mo ago
from civitai
justin
justin3mo ago
And then in the future, if you want to set up SSH this is how you can do it, I recommend just use my wrapper:
pip install git+https://github.com/justinwlin/runpod-python
runpod config
runpod ssh add-key
runpod pod connect [YOUR_POD_ID_HERE]
pip install git+https://github.com/justinwlin/runpod-python
runpod config
runpod ssh add-key
runpod pod connect [YOUR_POD_ID_HERE]
Pod ID is what i sent in the picture, that establishes an ssh connection. Again, an SSH connection is different than running a pure SCP command, since the SCP will establish a SSH command independently, so if u run an SCP command or something like that you always need it to be in a new terminal tab locally with no connections. https://github.com/justinwlin/Runpod-Tips-and-Tricks/blob/main/SSH%20On%20Runpod/README.md#using-an-ssh-wrapper And then in the future u can run the commands I have here:
# Sending a file
runpod pod send <PODID> localtext.txt /remote.txt

# Downloading a file
runpod pod download <PODID> remote.txt local.txt
# Sending a file
runpod pod send <PODID> localtext.txt /remote.txt

# Downloading a file
runpod pod download <PODID> remote.txt local.txt
Since you are using my custom wrapper. Okay cool What model / templates are you using? I think honestly civitai if you are doing that 1) I think is great to setup ssh anyways, so u can just do :
pip install git+https://github.com/justinwlin/runpod-python
runpod config
runpod ssh add-key
pip install git+https://github.com/justinwlin/runpod-python
runpod config
runpod ssh add-key
If you want for the future, which is why i said just terminate it for now. But u prob dont need SSH realistically right now. You can just run the command in ur Pod terminal to download, but is good to have, in case u need to download large amount of files or outputs 2) I just wanted to know exactly what is happening so I can recommend u steps for u to try and go through, without u just burning compute time With civitai in the future for your pod you want to do in the pod terminal:
Waosh76
Waosh763mo ago
where do i do all of this
justin
justin3mo ago
This is for ur local pc / whatever this is prob more helpful if u end up wanting to download a large amount of outputs or files from ur pod in the future not so much uploading a civitai checkpoint BUt for civitai model in runpod u would run in the runpod terminal:
apt-get update
apt-get install wget

wget -P {your local model directory, not including a file name} -q --show-progress --content-disposition https://civitai.com/api/download/models/{modelVersionId}?token={your api key from civitai user settings}

-P puts it in the right folder
-q suppresses useless console output
--show-progress shows progress as console output
--content-disposition names the file correctly (otherwise you'll need to rename it to after downloading)
apt-get update
apt-get install wget

wget -P {your local model directory, not including a file name} -q --show-progress --content-disposition https://civitai.com/api/download/models/{modelVersionId}?token={your api key from civitai user settings}

-P puts it in the right folder
-q suppresses useless console output
--show-progress shows progress as console output
--content-disposition names the file correctly (otherwise you'll need to rename it to after downloading)
So an example command might be:
wget -P ~/workspace -q --show-progress --content-disposition https://civitai.com/api/download/models/1234?token=supersecretauth
wget -P ~/workspace -q --show-progress --content-disposition https://civitai.com/api/download/models/1234?token=supersecretauth
Or the -P is wherever you want to download the model to In this case for ex. I was saying put it in the ~/workspace directory Source: https://www.reddit.com/r/StableDiffusion/comments/19f8wdm/comment/ko92bzg/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button Honestly SSHing your models up to runpod is prob slower than you just telling ur Pod to download it
Waosh76
Waosh763mo ago
im so lost so like there is a way to just input the civitai links in the runpod terminal to access everything on my pod?
justin
justin3mo ago
Okay I guess let's simplify: 1) If you make a pod you go to the terminal 2) You run the following to download:
wget -P ~/workspace -q --show-progress --content-disposition https://civitai.com/api/download/models/1234?token=supersecretauth
wget -P ~/workspace -q --show-progress --content-disposition https://civitai.com/api/download/models/1234?token=supersecretauth
No, you need to get the model id
Waosh76
Waosh763mo ago
but i dont need to download it or upload it i just need the civitai page for that
justin
justin3mo ago
Yes
No description
justin
justin3mo ago
https://civitai.com/api/download/models/367044 This is an example the model id is: 367044 So then I would do: wget -P ~/workspace -q --show-progress --content-disposition https://civitai.com/api/download/models/367044?token=supersecretauth with the right token authentication
Waosh76
Waosh763mo ago
whats the token authentication
justin
justin3mo ago
its in ur user settings on civitai otherwise civitai will block u from downloading at times
Waosh76
Waosh763mo ago
o ok
justin
justin3mo ago
Yeah lots of ppl complain about their model not working, but it just a civitai issue where they have required u to generally have an authentication token Yea anyways I recommend u can do it locally, if u have wget / curl, if u have window subsystem linux installed. im not a windows user so i can't speak much to it. but u can do it locally just to play before u use runpod but my best bet is if ever confused, just ask chatgpt / phind about the commands / if it can fix it up for u as long as u give it context anyways yeah hope that clarifies things 1) Runpod Pod you can run a wget command to download the model directly 2) in the future, you can use SSH/SCP to download outputs from ur model, I assume they are images to ur computer, or some other method if u have it, like pushing up to github, some script to upload to somewhere, etc.
Waosh76
Waosh763mo ago
idk
justin
justin3mo ago
?
Waosh76
Waosh763mo ago
im sorry im bad at programming i understand half of what youre saying also im on windows
justin
justin3mo ago
Yea no worries, i wasn't used to all it either
Waosh76
Waosh763mo ago
idk if that changes anything to what you said
justin
justin3mo ago
I guess the main thing is just play around No not really if u want to use the service u can, if u dont, u dont have to xD but i guess, the main thing is that if u want to use any service, i think runpod is relatively the easiest but u do need to get over the linux curve which i just did so by asking chatgpt
Waosh76
Waosh763mo ago
i mean having windows instead of linux
justin
justin3mo ago
I mean runpod is linux U can use mac / windows just know that u generally need to be able to run a command prompt / some sort of way to connect to linux servers *since runpod is a linux server
Waosh76
Waosh763mo ago
mb thats why the ssh command earlier didnt work on my pc?
justin
justin3mo ago
No, u can run ssh commands on window, just most ppl use something called windows subsystem linux (WSL) to do it. But that's a whole thing in itself. as Madiator said, there is also Firezilla which allows you to have GUI to connect to a linux server thro username / password, but im not familiar with it Personally, for my windows computer, i just watched a tutorial on how to do WSL on YT, and just set it up, and i never think about it much since all the commands that work on mac, should work on PC but there are maybe other alternatives, im not familiar with
justin
justin3mo ago
xD ok back to work 🏃
Waosh76
Waosh763mo ago
... fr
Madiator2011
Madiator20113mo ago
ssh client if build in windows so still having issues or no issue? or I should make new issue if no issues?
Waosh76
Waosh763mo ago
im still at the starting point i feel like i didnt understand anything i needed to do at all
Waosh76
Waosh763mo ago
not that both of you explained it badly i just dont understand programming at all yea no fr im dogshit when it comes to programming
justin
justin3mo ago
1) I guess, let's start with the: Make a wget request, start up a runpod pod, and then paste the command into the terminal to run it 🙂 That is a great first step 2) Once you get that going, then I guess you can really do whatever you want
Madiator2011
Madiator20113mo ago
Do not worry let me kick out Justin for now
justin
justin3mo ago
xD Off i go
Waosh76
Waosh763mo ago
lol
Madiator2011
Madiator20113mo ago
@Waosh76 so lets start from start. so curently you have pod running or not?
Waosh76
Waosh763mo ago
do i need to make one of those as a start?
No description
Waosh76
Waosh763mo ago
no i dont so it doesnt charge for nothing
Madiator2011
Madiator20113mo ago
ssh keys are easy though requires setup from your side Let me guide you how to use Filezilla is it ok?
Waosh76
Waosh763mo ago
sure
Madiator2011
Madiator20113mo ago
Download FileZilla Client for Windows (64bit x86)
Download FileZilla Client 3.66.5 for Windows (64bit x86)
Waosh76
Waosh763mo ago
manual or no?
Madiator2011
Madiator20113mo ago
also are you deploying pod on Secure Cloud or Community?
Waosh76
Waosh763mo ago
secure
Madiator2011
Madiator20113mo ago
good so that Filezilla you install on your pc
Waosh76
Waosh763mo ago
filezilla or filezilla with manual?
Madiator2011
Madiator20113mo ago
No description
Madiator2011
Madiator20113mo ago
FileZilla just normal FileZilla
Waosh76
Waosh763mo ago
ok
Madiator2011
Madiator20113mo ago
let me know when you install it
Waosh76
Waosh763mo ago
my firewall removes it...
Madiator2011
Madiator20113mo ago
I mean you get pop up? mind showing the error you get?
Waosh76
Waosh763mo ago
its not an error my firewall says its unsafe and deletes it
Madiator2011
Madiator20113mo ago
what firewall?
Waosh76
Waosh763mo ago
norton
Waosh76
Waosh763mo ago
i restored it
Madiator2011
Madiator20113mo ago
Filezilla is known app so its wierd that Norton delets it
Waosh76
Waosh763mo ago
norton likes to do that with a bunch of stuff
Madiator2011
Madiator20113mo ago
ye it's agresive sometimes reason I switched to bitdefender
Waosh76
Waosh763mo ago
ok i got it installed whats next
Madiator2011
Madiator20113mo ago
Shall we start with new pod or you want reuse old one btw I have max 10min
Waosh76
Waosh763mo ago
i terminated it so i need a new one anyway we can do it tomorrow if its better for u
Madiator2011
Madiator20113mo ago
ok it's fine just deploy new pod remember about cuda filter
Waosh76
Waosh763mo ago
whats cuda filter..
Madiator2011
Madiator20113mo ago
nah as it's new pod it will be fast
Waosh76
Waosh763mo ago
do i use the template again?
Waosh76
Waosh763mo ago
it was this one right
No description
Waosh76
Waosh763mo ago
o right that
Madiator2011
Madiator20113mo ago
No this one is combo here https://www.runpod.io/console/explore/ts8ze6urzh The one you gave would take long time to start and you only want auto1111 web ui with models
Waosh76
Waosh763mo ago
its downloading and extracting everything again so its gonna take a while as well
No description
Madiator2011
Madiator20113mo ago
ok its fine is it up? @Waosh76
Waosh76
Waosh763mo ago
not yet
Madiator2011
Madiator20113mo ago
so after you get it up press button 8888 and you will see
No description
Madiator2011
Madiator20113mo ago
download file named filezilla
Waosh76
Waosh763mo ago
this is whats in the workspace
No description
Madiator2011
Madiator20113mo ago
check pod logs or try refresh jupiter
Waosh76
Waosh763mo ago
No description
Madiator2011
Madiator20113mo ago
look at container logs
Madiator2011
Madiator20113mo ago
you should see like this
No description
Waosh76
Waosh763mo ago
it says please wait
Madiator2011
Madiator20113mo ago
mind showing full log?
Waosh76
Waosh763mo ago
No description
Madiator2011
Madiator20113mo ago
btw make sure to press the play icon in corner
No description
Waosh76
Waosh763mo ago
got it now
No description
Waosh76
Waosh763mo ago
said container is ready it was pressed already
Madiator2011
Madiator20113mo ago
good it requires syncing python venv in most templates and that takes time so now look at video and you will see what to do
Madiator2011
Madiator20113mo ago
btw if you go to web ui on port 3000 you get automatic1111 with civitAI extension that lets you download models without having to upload them manually
No description
Madiator2011
Madiator20113mo ago
anyway im off now
Waosh76
Waosh763mo ago
ok ty cant connect the thing with filezilla "connection refused" "unable to establish connection" just tells me i need an api key and that i can get it in the civitai browser+ settings but idk where that is
Madiator2011
Madiator20113mo ago
Just saying you can use browser and if model do not work use FileZilla
Waosh76
Waosh763mo ago
wheres the sd webui settings tab in jupyter i guess but cant find it if youre still there
Madiator2011
Madiator20113mo ago
Web ui is separate thing On my pods page press connect button clicking 8888 will open Jupiter, 3000 will open automatic1111 web ui
Waosh76
Waosh763mo ago
ye ik i think i get it but i need to put my api somewhere in 8888 nvm im stupid theres a setting window in the webui
Madiator2011
Madiator20113mo ago
Can you show me where it ask you to put api key?
Waosh76
Waosh763mo ago
i got it
Waosh76
Waosh763mo ago
it was here in the settings tab on the webui
No description
Waosh76
Waosh763mo ago
i downloaded a model refreshed the ui and it didnt seem to do anything worked tysm for the help hi, sorry to bother you, i ran into an issue the browser+ thing shows up error whenever i try to search for anything that ever happen before?
Waosh76
Waosh763mo ago
i suppose this in the corner has something to do with it
No description
Waosh76
Waosh763mo ago
i think its just the civitai changed their api and the civitai broswer+ extension now has a newer model which hasnt been implemented yet
Madiator2011
Madiator20113mo ago
Probably