TF
RRunPod
•Created by TF on 4/29/2025 in #⛅｜pods-clusters
(Beginner Question) Hosting Quantized model
Thank you I'll test it out and report back 🙂
5 replies
RRunPod
•Created by md on 5/12/2024 in #⚡｜serverless
Run Mixtral 8x22B Instruct on vLLM worker
I'm trying to do the same thing as you right now lol will update if I figure something out
126 replies