what am i doing wrong, serverless workers optimization



10 Replies
! cypher
! cypherOP2w ago
i dont know this discord is dead
Dj
Dj2w ago
Sometimes just downloading from GitHub can be rough. If you can help it, downloading in parallel can be useful
! cypher
! cypherOP2w ago
is there like a blueprint, for best cold start optimization i want to keep the min workers at 0 i have models already on network volume, in same datacenter location but its like 40gb of models
Unknown User
Unknown User2w ago
Message Not Public
Sign In & Join Server To View
mastr0g
mastr0g2w ago
@Jason Is the model cache feature different (and more efficient) than downloading the models from the Dockerfile with the Flashboot enabled?
Unknown User
Unknown User2w ago
Message Not Public
Sign In & Join Server To View
mastr0g
mastr0g6d ago
@Jason When using the cached model feature in the endpoint setting, should I remove commands to download associated huggingface files (model, textencoders,vae, etc) from my Dockerfile ?
Unknown User
Unknown User6d ago
Message Not Public
Sign In & Join Server To View
mastr0g
mastr0g6d ago
@Jason What should be the specific path? There is no information in the online documentation. If I use cached model and remove the initial download from Dockerfile, ComfyUI cannot find my model files in /comfyui/models/
Unknown User
Unknown User6d ago
Message Not Public
Sign In & Join Server To View

Did you find this page helpful?