using meta-llama/Meta-Llama-3.1-8B-Instruct in servelss

i am trying to run meta-llama/Meta-Llama-3.1-8B-Instruct in serverless, what is right vllm/vllm-openai image version to use?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Was this page helpful?

using meta-llama/Meta-Llama-3.1-8B-Instruct in servelss - Runpod

Runpod•3h ago•

2 replies

i am trying to run meta-llama/Meta-Llama-3.1-8B-Instruct in serverless, what is right vllm/vllm-openai image version to use?

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Was this page helpful?