environment variables

Solved

how to get environment variables while build?

I set variables in endpoint settings, but they are not available during build.
Please tell me if I missed something?

...
RUN python setup.py

# copy models
COPY ./models .

# Entrypoint
CMD ["python", "-u", "handler.py"]

...
RUN python setup.py

# copy models
COPY ./models .

# Entrypoint
CMD ["python", "-u", "handler.py"]

use_auth_token = os.getenv("HF_TOKEN")
print(f"Downloading model - {use_auth_token}")

snapshot_download(...)

use_auth_token = os.getenv("HF_TOKEN")
print(f"Downloading model - {use_auth_token}")

snapshot_download(...)

result:

[INFO] #13 13.75 Downloading model - None

[INFO] #13 13.75 Downloading model - None

Solution

You can either build the Docker image yourself, push to a docker registry and deploy from there. Or if you want to use the Github Integration you need to put your key inside the Dockerfile, this is the current solution.

Jump to solution

Runpod•10mo ago•

7 replies

Tony

environment variables

Solved

how to get environment variables while build?

I set variables in endpoint settings, but they are not available during build.
Please tell me if I missed something?

...
RUN python setup.py

# copy models
COPY ./models .

# Entrypoint
CMD ["python", "-u", "handler.py"]

...
RUN python setup.py

# copy models
COPY ./models .

# Entrypoint
CMD ["python", "-u", "handler.py"]

use_auth_token = os.getenv("HF_TOKEN")
print(f"Downloading model - {use_auth_token}")

snapshot_download(...)

use_auth_token = os.getenv("HF_TOKEN")
print(f"Downloading model - {use_auth_token}")

snapshot_download(...)

result:

[INFO] #13 13.75 Downloading model - None

[INFO] #13 13.75 Downloading model - None

Solution

Jump to solution

environment variables

Similar Threads

environment variables

Similar Threads

Similar Threads

Similar Threads