how to host 20gb models + fastapi code on serverless

I have 20gb model files and a fastapi pipeline code to perform preprocessing and inference+ training.
How can I use runpods serverless?

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906Members

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Twitter GitHub Discord

Communities Docs About Terms Privacy

Star

Setup for Free

how to host 20gb models + fastapi code on serverless - Runpod

Runpod•2y ago•

28 replies

how to host 20gb models + fastapi code on serverless

I have 20gb model files and a fastapi pipeline code to perform preprocessing and inference+ training.
How can I use runpods serverless?

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,906Members

Resources

Recent Announcements

Similar Threads

YOLO models on serverless?

RRunpod / ⚡｜serverless

8mo ago

How to download models for Stable Diffusion XL on serverless?

RRunpod / ⚡｜serverless

2y ago

FastAPI RunPod serverless request format

RRunpod / ⚡｜serverless

2y ago

SDXL Serverless Worker: How to Cache LoRA models

RRunpod / ⚡｜serverless

2y ago

Similar Threads

Was this page helpful?

Similar Threads

YOLO models on serverless?

RRunpod / ⚡｜serverless

8mo ago

How to download models for Stable Diffusion XL on serverless?

RRunpod / ⚡｜serverless

2y ago

FastAPI RunPod serverless request format

RRunpod / ⚡｜serverless

2y ago

SDXL Serverless Worker: How to Cache LoRA models

RRunpod / ⚡｜serverless

2y ago