Do I need to allocate extra container space for Flashboot?
I'm planning to use Llama3 model that takes about 40 GB space. I believe Flashboot takes a snapshot of the worker and keeps it on the disk to load it within seconds when the worker becomes active.
Do I need to allocate enough space on the container for this? In this case, since I'm planning to select a 48 GB vRAM GPU, do I need to allocate 40 GB Model + 48 GB for snapshot + 5 GB extra space = 93 GB container space?
Thanks
Thanks
3 Replies
Flashboot is basically a serverless algorithm and does not require disk space
No
Container space is for temporary files that you save
Thanks