© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

Mixtral Possible? - Runpod

Runpod•2y ago•

20 replies

Mixtral Possible?

Wondering if it's possible to run AWQ mixtral on serverless with good speed

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Similar Threads

Help: Serverless Mixtral OutOfMemory Error

RRunpod / ⚡｜serverless

Empty Tokens Using Mixtral AWQ

RRunpod / ⚡｜serverless

Run Mixtral 8x22B Instruct on vLLM worker

RRunpod / ⚡｜serverless

Error building worker-vllm docker image for mixtral 8x7b

RRunpod / ⚡｜serverless