How to deploy multimodal (text, image to text such gemma-3-27b-it ) using Serverless endpoints?

Hi, I tried using vllm serverless and deploy the gemma-3-27b-it but it's not working, is there any tutorial or support for multimodal?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Was this page helpful?

How to deploy multimodal (text, image to text such gemma-3-27b-it ) using Serverless endpoints? - Runpod

Runpod•4mo ago•

31 replies

Hi, I tried using vllm serverless and deploy the gemma-3-27b-it but it's not working, is there any tutorial or support for multimodal?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Was this page helpful?