Speeding up loading of model weights
Hi guys, I have setup my severless docker image to contain all my required model weights. My handler script also loads the weights using the diffusers library's
Anyone has experience optimising the time needed tp load weights? Could we pre-load it on ram or something (I may be totally off)?
.from_pretrained local_files_only=true--- Starting Serverless Worker | Version 1.6.2 ---Anyone has experience optimising the time needed tp load weights? Could we pre-load it on ram or something (I may be totally off)?
