TF
RRunPod
•Created by TF on 4/29/2025 in #⛅｜pods-clusters
(Beginner Question) Hosting Quantized model
Hi, I'm new to runpod can anyone point me towards how I can host a quantized model like this? I want to try the 2.71bit version first. https://huggingface.co/unsloth/DeepSeek-V3-0324-GGUF-UD
5 replies