Hosted Serverless
I looked at your website and I am not sure if you host models in a multi-tenant style. I want to be able to call some common models like Mixtral at low cost without paying for a dedicated server. Do you offer this?
7 Replies
Unknown User•2y ago
Message Not Public
Sign In & Join Server To View
Mixtral can run on serverless. Takes a minute and a half to spin up though…
Unknown User•2y ago
Message Not Public
Sign In & Join Server To View
Uhhh… I have it on a 48GB gpu
Unknown User•2y ago
Message Not Public
Sign In & Join Server To View
Unknown User•2y ago
Message Not Public
Sign In & Join Server To View