2024-03-01T16:08:54.761577365Z [FATAL tini (6)] exec docker failed: No such file or directory Error

Hey folks I'm having trouble running my image on Runpod. My image works properly on a normal root access Docker environment but doesn't work on the Runpod template structure. It's my first time on Runpod, can anyone help out?
No description
No description
21 Replies
Madiator2011
Madiator20114mo ago
what is the error
ashleyk
ashleyk4mo ago
In the post title:
2024-03-01T16:08:54.761577365Z [FATAL tini (6)] exec docker failed: No such file or directory Error
2024-03-01T16:08:54.761577365Z [FATAL tini (6)] exec docker failed: No such file or directory Error
You probably need a CUDA base image for starters
FROM runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04

WORKDIR /app

RUN apt-get update && apt-get install -y \
git \
&& rm -rf /var/lib/apt/lists/*

COPY requirements.txt /app/

RUN pip install --no-cache-dir diffusers accelerate -r requirements.txt

COPY . /app

ENV MODEL_DEVICE=gpu

COPY --chmod=755 start.sh /start.sh

CMD ["/start.sh"]
FROM runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04

WORKDIR /app

RUN apt-get update && apt-get install -y \
git \
&& rm -rf /var/lib/apt/lists/*

COPY requirements.txt /app/

RUN pip install --no-cache-dir diffusers accelerate -r requirements.txt

COPY . /app

ENV MODEL_DEVICE=gpu

COPY --chmod=755 start.sh /start.sh

CMD ["/start.sh"]
Try this. You don't need EXPOSE, add the ports to your template/pod
voiceofkronos
voiceofkronos4mo ago
@ashleyk The cuda base image worked, thank you so much! 2024-03-01T18:56:20.332807898Z /opt/nvidia/nvidia_entrypoint.sh: line 67: exec: docker: not found any idea about this one?
ashleyk
ashleyk4mo ago
Where do you see this? Are you trying to run it from within your start.sh script?
voiceofkronos
voiceofkronos4mo ago
Here it is @ashleyk
No description
ashleyk
ashleyk4mo ago
Did you set a docker start command for your pod or something?
voiceofkronos
voiceofkronos4mo ago
@ashleyk , you are right. The default run script was working. I edited it, and now it's up and running. Last question: I have an endpoint that listens on port 8081. When I send a request, I can't reach the port and can't get results. How I should configure template config, below on image?
No description
ashleyk
ashleyk4mo ago
1. Make your app bind to 0.0.0.0 and not 127.0.0.1. 2. Add HTTP port 8081 to your pod, or alternatively a TCP port if there is a possibility that your request execution time will exceed 100s. I see you already added it as a TCP port. TCP ports require a public IP, so if you are using Community Cloud, you need to ensure that you check the Public IP filter at the top of the page. Then you need to go to the Connect button TCP port mappings and get the external port mapping and use the external port. 8081 will be the internal port.
voiceofkronos
voiceofkronos4mo ago
I'm using secure cloud, when I remove TCP port I'm losing public ip
ashleyk
ashleyk4mo ago
I always add at least port 22 for SSH access.
voiceofkronos
voiceofkronos4mo ago
This is the last config, still can't reach the port. I checked it with telnet. Am I missing something? @ashleyk
No description
voiceofkronos
voiceofkronos4mo ago
@ashleyk
No description
No description
ashleyk
ashleyk4mo ago
You probably didn't bind your app to 0.0.0.0 like I said above it can't work if it binds to 127.0.0.1.
voiceofkronos
voiceofkronos4mo ago
@ashleyk it's already 0.0.0.0
No description
ashleyk
ashleyk4mo ago
What port did you telnet to?
voiceofkronos
voiceofkronos4mo ago
8081?
ashleyk
ashleyk4mo ago
No, wrong, see above. https://discord.com/channels/912829806415085598/1213184975629717525/1213203762621980743 Use EXTERNAL port NOT the internal one.
voiceofkronos
voiceofkronos4mo ago
okay but the endpoint is working on 8081, how am ı going to hit it? Should i bind it to 8081?
ashleyk
ashleyk4mo ago
No, bind it to 0.0.0.0 Hit it by connecting to EXTERNAL PORT. Use TCP port mapping, or else change it to an HTTP port and use the proxy URL You CANNOT connect to 8081, its impossible. EXTERNAL PORT only. NOT INTERNAL.
voiceofkronos
voiceofkronos4mo ago
solved, thanks for your support!! @ashleyk
ashleyk
ashleyk4mo ago
Glad you got it working 🥳
Want results from more Discord servers?
Add your server
More Posts