Hi! I'm trying to deploy a simple serverless worker for PDF processing that requires GPUs. I've followed the docs and was able to build it. But, when I send a request, it's forever stuck and workers exit. I'm having a hard time debugging it since it takes more than half an hour to build and upload the image.
Dockerfile:
FROM nvidia/cuda:12.4.1-runtime-ubuntu22.04ENV DEBIAN_FRONTEND=noninteractiveWORKDIR /# Install system dependencies, Python 3.10, and set it as defaultRUN apt-get update && \ apt-get install -y --no-install-recommends \ software-properties-common \ wget \ git \ libgl1 \ libglib2.0-0 && \ add-apt-repository ppa:deadsnakes/ppa && \ apt-get update && \ apt-get install -y --no-install-recommends \ python3.10 \ python3.10-venv \ python3.10-distutils \ python3-pip && \ update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.10 1 && \ rm -rf /var/lib/apt/lists/*...COPY src .# Set the entry point to activate the virtual environment and run the command line toolCMD ["/bin/bash", "-c", "source /opt/mineru_venv/bin/activate && python3 -u /runpod_handler.py"]
FROM nvidia/cuda:12.4.1-runtime-ubuntu22.04ENV DEBIAN_FRONTEND=noninteractiveWORKDIR /# Install system dependencies, Python 3.10, and set it as defaultRUN apt-get update && \ apt-get install -y --no-install-recommends \ software-properties-common \ wget \ git \ libgl1 \ libglib2.0-0 && \ add-apt-repository ppa:deadsnakes/ppa && \ apt-get update && \ apt-get install -y --no-install-recommends \ python3.10 \ python3.10-venv \ python3.10-distutils \ python3-pip && \ update-alternatives --install /usr/bin/python3 python3 /usr/bin/python3.10 1 && \ rm -rf /var/lib/apt/lists/*...COPY src .# Set the entry point to activate the virtual environment and run the command line toolCMD ["/bin/bash", "-c", "source /opt/mineru_venv/bin/activate && python3 -u /runpod_handler.py"]
Recent Announcements
Continue the conversation
Join the Discord to ask follow-up questions and connect with the community
R
Runpod
We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!