Slow initialization, even with flashboot, counted as execution time
I am running a serverless Fooocus API endpoint from this code base https://github.com/davefojtik/RunPod-Fooocus-API.
It takes a long time to initialize, even with Flashboot, and the initialization counts as execution time. In subsequent runs with Flashboot, the time is dramatically lower, until Flashboot's cache clears.
The issue is raised and discussed here https://github.com/davefojtik/RunPod-Fooocus-API/issues/5
It takes a long time to initialize, even with Flashboot, and the initialization counts as execution time. In subsequent runs with Flashboot, the time is dramatically lower, until Flashboot's cache clears.
The issue is raised and discussed here https://github.com/davefojtik/RunPod-Fooocus-API/issues/5
GitHub
Hi @davefojtik I was trying the further optimize the speed and what I noticed is the docker image takes 40+ seconds in the first startup on a 4090 to start usually, most of your requests are passed...
