Runpod•2y ago

How to get Public IP and set symmetrical port mapping on Pod via Python SDK

I have created a pod with python in the following way

runpod.api_key = os.getenv("RUNPOD_API_KEY")
bot_name = 'Testing Pod Public IP 1'

pod = runpod.create_pod(
    name=bot_name,
    image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
    gpu_count=1,
    gpu_type_id='NVIDIA A40',
    network_volume_id="8y",
    volume_mount_path="/workspace",
    ports= "8888/http,22/tcp,70001/tcp",
    env={
        "PUBLIC_KEY": "ssh-ed25519 ",
        "JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
        "RUNPOD_PUBLIC_IP": "10.2.25.69",
        "RUNPOD_TCP_PORT_70001": 5000
    },
    support_public_ip=True,
    docker_args="/workspace/start_finetune.sh",
    container_disk_in_gb=20                    
)

print(pod)

runpod.api_key = os.getenv("RUNPOD_API_KEY")
bot_name = 'Testing Pod Public IP 1'

pod = runpod.create_pod(
    name=bot_name,
    image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
    gpu_count=1,
    gpu_type_id='NVIDIA A40',
    network_volume_id="8y",
    volume_mount_path="/workspace",
    ports= "8888/http,22/tcp,70001/tcp",
    env={
        "PUBLIC_KEY": "ssh-ed25519 ",
        "JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
        "RUNPOD_PUBLIC_IP": "10.2.25.69",
        "RUNPOD_TCP_PORT_70001": 5000
    },
    support_public_ip=True,
    docker_args="/workspace/start_finetune.sh",
    container_disk_in_gb=20                    
)

print(pod)

runpod.api_key = os.getenv("RUNPOD_API_KEY")
bot_name = 'Testing Pod Public IP 1'

pod = runpod.create_pod(
    name=bot_name,
    image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
    gpu_count=1,
    gpu_type_id='NVIDIA A40',
    network_volume_id="8y",
    volume_mount_path="/workspace",
    ports= "8888/http,22/tcp,70001/tcp",
    env={
        "PUBLIC_KEY": "ssh-ed25519 ",
        "JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
        "RUNPOD_PUBLIC_IP": "10.2.25.69",
        "RUNPOD_TCP_PORT_70001": 5000
    },
    support_public_ip=True,
    docker_args="/workspace/start_finetune.sh",
    container_disk_in_gb=20                    
)

print(pod)

runpod.api_key = os.getenv("RUNPOD_API_KEY")
bot_name = 'Testing Pod Public IP 1'

pod = runpod.create_pod(
    name=bot_name,
    image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
    gpu_count=1,
    gpu_type_id='NVIDIA A40',
    network_volume_id="8y",
    volume_mount_path="/workspace",
    ports= "8888/http,22/tcp,70001/tcp",
    env={
        "PUBLIC_KEY": "ssh-ed25519 ",
        "JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
        "RUNPOD_PUBLIC_IP": "10.2.25.69",
        "RUNPOD_TCP_PORT_70001": 5000
    },
    support_public_ip=True,
    docker_args="/workspace/start_finetune.sh",
    container_disk_in_gb=20                    
)

print(pod)

I also tried to use the console for clarity, but even when I put 70001 in TCP it wont map 5000:5000 but instead it assigns a port itself.

Even when it does, how do I know which port it is via python?

Jason•7/11/24, 8:18 AM

Yes, sometimes you may get symetricall port mapping, but sometimes you don't

Jason•7/11/24, 8:18 AM

*even if you have added port number more than (? howmuch i forgot)

Jason•7/11/24, 8:21 AM

So to get the external port number you mapped you can get it from these env varibles inside the pod:

TCP port 22: RUNPOD_TCP_PORT_22RUNPOD_TCP_PORT_22
Public ip: RUNPOD_PUBLIC_IPRUNPOD_PUBLIC_IP

Asad CognifyOP•7/11/24, 8:24 AM

How do I get these? What is the command in python?
Port number more than 70000

Jason•7/11/24, 8:25 AM

os.environ contains an list of environment variable i guess

Jason•7/11/24, 8:25 AM

so os.environ['RUNPOD_PUBLIC_IP']

Jason•7/11/24, 8:25 AM

like that, or if it doesn't work please search google

Asad CognifyOP•7/11/24, 8:25 AM

When I create a pod I dont see it in the printed variable

{'id': 'dfg', 'desiredStatus': 'RUNNING', 'imageName': 'runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04', 'env': ['PUBLIC_KEY=ssh-ed25519 m', 'JUPYTER_PASSWORD=h7xw7gxh407nxshza6f3', 'RUNPOD_PUBLIC_IP=10.2.25.69', 'RUNPOD_TCP_PORT_70000=5000'], 'machineId': 'gp8l45q218uu', 'machine': {'podHostId': '85f0xhj08uxndo-644112f0'}}

{'id': 'dfg', 'desiredStatus': 'RUNNING', 'imageName': 'runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04', 'env': ['PUBLIC_KEY=ssh-ed25519 m', 'JUPYTER_PASSWORD=h7xw7gxh407nxshza6f3', 'RUNPOD_PUBLIC_IP=10.2.25.69', 'RUNPOD_TCP_PORT_70000=5000'], 'machineId': 'gp8l45q218uu', 'machine': {'podHostId': '85f0xhj08uxndo-644112f0'}}

Jason•7/11/24, 8:25 AM

I still see your public ip

Jason•7/11/24, 8:25 AM

'RUNPOD_PUBLIC_IP=10.2.25.69',

Jason•7/11/24, 8:26 AM

if you don't have the port number there, its not exposed.

JJason 'RUNPOD_PUBLIC_IP=10.2.25.69',

Asad CognifyOP•7/11/24, 8:26 AM

Yeah But I passed that env variable myself. The actual assigned publib ip is something else

Jason•7/11/24, 8:26 AM

keep in mind normal tcp port range:

AAsad Cognify Yeah But I passed that env variable myself. The actual assigned publib ip is som...

Jason•7/11/24, 8:27 AM

No i think thats not the way you expose an tcp port

Asad CognifyOP•7/11/24, 8:27 AM

https://docs.runpod.io/pods/configuration/expose-ports

Expose ports | RunPod Documentation

Exposing ports on your pod to the outside world: Learn how to expose ports via RunPod's Proxy or TCP Public IP, and discover the benefits and limitations of each method, including symmetrical port mapping requests.

Jason•7/11/24, 8:27 AM

ports= "8888/http,22/tcp,70001/tcp",
this is how you expose ports

Jason•7/11/24, 8:27 AM

please describe what are you having trouble with, what are you expecting, and what have you tried

Asad CognifyOP•7/11/24, 8:27 AM

I created them like this

pod = runpod.create_pod(
    name=bot_name,
    image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
    gpu_count=1,
    gpu_type_id='NVIDIA A40',
    network_volume_id="8y",
    volume_mount_path="/workspace",
    ports= "8888/http,22/tcp,70001/tcp",
    env={
        "PUBLIC_KEY": "ssh-ed25519 ",
        "JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
        "RUNPOD_PUBLIC_IP": "10.2.25.69",
        "RUNPOD_TCP_PORT_70001": 5000
    },
    support_public_ip=True,
    docker_args="/workspace/start_finetune.sh",
    container_disk_in_gb=20                    
)

pod = runpod.create_pod(
    name=bot_name,
    image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
    gpu_count=1,
    gpu_type_id='NVIDIA A40',
    network_volume_id="8y",
    volume_mount_path="/workspace",
    ports= "8888/http,22/tcp,70001/tcp",
    env={
        "PUBLIC_KEY": "ssh-ed25519 ",
        "JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
        "RUNPOD_PUBLIC_IP": "10.2.25.69",
        "RUNPOD_TCP_PORT_70001": 5000
    },
    support_public_ip=True,
    docker_args="/workspace/start_finetune.sh",
    container_disk_in_gb=20                    
)

Asad CognifyOP•7/11/24, 8:28 AM

Okay

Jason•7/11/24, 8:28 AM

"RUNPOD_TCP_PORT_70001": 5000 < this is unecessary btw

Jason•7/11/24, 8:28 AM

okay

Asad CognifyOP•7/11/24, 8:29 AM

I created a new pod
I want to know its public ip
I exposed port 5000 in ports parameter, but the mapping is asymetrical, how can I make it symetrical to 5000

Asad CognifyOP•7/11/24, 8:29 AM

Via python using runpod library

Jason•7/11/24, 8:29 AM

Im not sure how to get the public ip via runpod's library but you can access it inside the pod using env variables

Jason•7/11/24, 8:30 AM

I exposed port 5000 in ports parameter, but the mapping is asymetrical, how can I make it symetrical to 5000

Thats random,there is a chance you can get it and may not get it

Jason•7/11/24, 8:30 AM

all clear?

Madiator2011 (Work)•7/11/24, 8:45 AM

RUNPOD_TCP_PORT_70001 wont work like this
you will need to set port to something like 70001 +
then from inside pod you would need to reed env variable RUNPOD_TCP_PORT_70001 to see what symetric port got assigned for you

Jason•7/11/24, 8:46 AM

oh more than 70001

Asad CognifyOP•7/11/24, 8:53 AM

Okay if I got this correct then,
Then I create the pod like this

pod = runpod.create_pod(
    name=bot_name,
    image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
    gpu_count=1,
    gpu_type_id='NVIDIA A40',
    network_volume_id="8y",
    volume_mount_path="/workspace",
    ports= "8888/http,22/tcp,70002/tcp",
    env={
        "PUBLIC_KEY": "ssh-ed25519 ",
        "JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
    },
    support_public_ip=True,
    docker_args="/workspace/start_finetune.sh",
    container_disk_in_gb=20                    
)

pod = runpod.create_pod(
    name=bot_name,
    image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
    gpu_count=1,
    gpu_type_id='NVIDIA A40',
    network_volume_id="8y",
    volume_mount_path="/workspace",
    ports= "8888/http,22/tcp,70002/tcp",
    env={
        "PUBLIC_KEY": "ssh-ed25519 ",
        "JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
    },
    support_public_ip=True,
    docker_args="/workspace/start_finetune.sh",
    container_disk_in_gb=20                    
)

Then I ssh into the pod and

printenv | grep -i RUNPOD_TCP_PORT_70002

printenv | grep -i RUNPOD_TCP_PORT_70002

This will give me the mapping

Asad CognifyOP•7/11/24, 8:53 AM

But if I want to use the port and IP programatically, how can I do that?

JJason > I exposed port 5000 in ports parameter, but the mapping is asymetrical, how ca...

Jason•7/11/24, 8:53 AM

as i said...

Jason•7/11/24, 8:53 AM

theres a chance you might not get it

Asad CognifyOP•7/11/24, 8:54 AM

But there is currently no way for me to get the port (even if symetrical) through the runpod python library?

AAsad Cognify But if I want to use the port and IP programatically, how can I do that?

Jason•7/11/24, 8:55 AM

Send this to somewhere else where you need it, via http if you are looking for a simple way

Jason•7/11/24, 8:55 AM

Via runpodctl exec if there is ( im not sure if this exists )

Jason•7/11/24, 8:56 AM

or you start a ssh connection, run commands there

Madiator2011 (Work)•7/11/24, 8:56 AM

nope symetric ports are not even like full official and setting high port is kinda trick

Jason•7/11/24, 8:56 AM

haha finally you got the role

How to get Public IP and set symmetrical port mapping on Pod via Python SDK

Similar Threads

Similar Threads

Similar Threads