© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

Head size 160 is not supported by PagedAttention - Runpod

Runpod•2y ago•

2 replies

Head size 160 is not supported by PagedAttention

Hello, I hope everyone is doing great! I am stuck with this error: ValueError: Head size 160 is not supported by PagedAttention. Supported head sizes are: [64, 80, 96, 112, 128, 256]

Does it mean I have to RETRAIN MY MODEL?
Full logs are in attachment

message.txt4.5KB

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Similar Threads

Is Vulkan supported?

RRunpod / ⚡｜serverless

chat template not supported

RRunpod / ⚡｜serverless

Docker daemon is not started by default?

RRunpod / ⚡｜serverless

Cannot run Cmdr+ on serverless, CohereForCausalLM not supported

RRunpod / ⚡｜serverless