© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

TheBloke/goliath-120b-GPTQ with RunPod Kobold AI United - Runpod

Runpod•2y ago•

12 replies

🆁🅰🅻🅻🅴

TheBloke/goliath-120b-GPTQ with RunPod Kobold AI United

Hi! I got goliath-120b-GPTQ running with 3 A40. But the text generation speed is extremely slow. What is the best option for GPU config and settings to run this model?

Thank you in advance!

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906Members

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Similar Threads

How do I install a model with kobold ai?

RRunpod / ⛅｜pods

Training AI with a RunPod GPU

RRunpod / ⛅｜pods

Assistance with Deploying AI App on RunPod

RRunpod / ⛅｜pods

Issue with Runpod teams

RRunpod / ⛅｜pods