© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

I want to deploy a serverless endpoint with using Unsloth - Runpod

Runpod•13mo ago•

1 reply

I want to deploy a serverless endpoint with using Unsloth

Unsloth do bnb qunatization and it's better loading their model, I think. I did training using Unsloth on a pod; I want to deploy it on a serverless endpoint and get the OpenIA client API

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Similar Threads

Was this page helpful?

Similar Threads

Deploy serverless endpoint with github error

RRunpod / ⚡｜serverless

Serverless Endpoint Streaming

RRunpod / ⚡｜serverless

Problem to create Serverless Endpoint

RRunpod / ⚡｜serverless

How to Deploy VLLM Serverless using Programming Language

RRunpod / ⚡｜serverless