Ulibach
RRunPod
•Created by c on 5/9/2025 in #⚡｜serverless
Veryyyyyy slow serverless VLLM
bumping this
INFO 05-17 20:09:56 [loader.py:458] Loading weights took 113.32 seconds
finetuned gemma3 12b model deployed via webui (vllm 0.8.5) with a network storage attached. is this a disk io issue?
50 replies