gpt-oss-120
Is there any working template to run gpt-oss-120? Or instructions on how to install?
P
Hhttps://koboldai.org/runpodcpp is normally a good way to run these, edit KCPP_MODEL to https://huggingface.co/ggml-org/gpt-oss-120b-GGUF/resolve/main/gpt-oss-120b-mxfp4-00001-of-00003.gguf?download=true and change the --contextsize to your liking (make sure you have enough vram). You may also want to add --jinja to the KCPP_ARGS.
