Running llama 3.3 70b using vLLM and 160gb network volume

Hi, I want to check if 160 gb is enough for llama 70b and whether I can use use a smaller network volume

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Was this page helpful?

Running llama 3.3 70b using vLLM and 160gb network volume - Runpod

Runpod•15mo ago•

48 replies

Hi, I want to check if 160 gb is enough for llama 70b and whether I can use use a smaller network volume

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Was this page helpful?