Runpod•4w ago

Can't run gpt-oss:120b on ollama

I can't deploy gpt-oss:120b model on ollama, because serverless doesn't allow me to change Container Disk size, it fixed at 20GB. Any change to this value (or enviroment values) will be revert to default value. Do you guy know how to fix this thing?

2 Replies

CamaroZ•4w ago

Hey, you can create a network volume with a custom size. And attach them to the serverless endpoint.

datlsOP•4w ago

@CamaroZ it helps me to pass volume issue, but it loops in crashed after downloaded 100%, and redownload from scratch

Gaming

Programming

Can't run gpt-oss:120b on ollama

Did you find this page helpful?