R
RunPod2mo ago
houmie

Do I need to allocate extra container space for Flashboot?

I'm planning to use Llama3 model that takes about 40 GB space. I believe Flashboot takes a snapshot of the worker and keeps it on the disk to load it within seconds when the worker becomes active. Do I need to allocate enough space on the container for this? In this case, since I'm planning to select a 48 GB vRAM GPU, do I need to allocate 40 GB Model + 48 GB for snapshot + 5 GB extra space = 93 GB container space?
Thanks
3 Replies
digigoblin
digigoblin2mo ago
Flashboot is basically a serverless algorithm and does not require disk space
nerdylive
nerdylive2mo ago
No Container space is for temporary files that you save
houmie
houmie2mo ago
Thanks