Runpod•

21 replies

Can't run a 70b model, gets stuck.

Original message was deleted

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906Members

Resources

Recent Announcements

Similar Threads

Twitter GitHub Discord

Communities Docs About Terms Privacy

Star

Setup for Free

Can't run a 70b model, gets stuck. - Runpod

Runpod•

21 replies

Can't run a 70b model, gets stuck.

Original message was deleted

Continue the conversation

Join the Discord to ask follow-up questions and connect with the community

Runpod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906 Members

Join

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906Members

Resources

Recent Announcements

Similar Threads

can't run 70b

RRunpod / ⚡｜serverless

2y ago

Can't run a 70B Llama 3.1 model on 2 A100 80 gb GPUs.

RRunpod / ⚡｜serverless

2y ago

Docker image pulling gets stuck

RRunpod / ⚡｜serverless

2mo ago

SDXL Dreambooth - can’t load model

RRunpod / ⚡｜serverless

2y ago

Similar Threads

Continue the conversation

Join the Discord to ask follow-up questions and connect with the community

Runpod

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906 Members

Join

Similar Threads

can't run 70b

RRunpod / ⚡｜serverless

2y ago

Can't run a 70B Llama 3.1 model on 2 A100 80 gb GPUs.

RRunpod / ⚡｜serverless

2y ago

Docker image pulling gets stuck

RRunpod / ⚡｜serverless

2mo ago

SDXL Dreambooth - can’t load model

RRunpod / ⚡｜serverless

2y ago