© 2026 Hedgehog Software, LLC

Twitter GitHub Discord

More

Communities Docs About Terms Privacy

Can we run aphrodite-engine on Serverless? - Runpod

Runpod•2y ago•

9 replies

Can we run aphrodite-engine on Serverless?

aphrodite-engine is a fork from vLLM and also supports exl2 format, which gives it a huge advantage. Are there any plans to support aphrodite-engine in future on RunPod's serverless offering?
I believe currently aphrodite-engine is only supported as a single server on RunPod.
Thanks

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Similar Threads

Can we run Node.js on a Serverless Worker?

RRunpod / ⚡｜serverless

Can u run fastapi gpu project on serverless runpod?

RRunpod / ⚡｜serverless

Serverless vLLM changing engine arguments

RRunpod / ⚡｜serverless

Run LLM Model on Runpod Serverless

RRunpod / ⚡｜serverless