Multiple Issues with cached model: stabilityai/stable-diffusion-3.5-large
Hi there.
I have been trying to setup my custom worker with stabilityai/stable-diffusion-3.5-large over the past few days and nothing seems to work.
I have my container disk set to 200GB to ensure there is enough space on the container volume. I have the cached model set with my hugging face token. And I can see in my logs that the cached model path with the snapshot is being created as I see the following in my output:
However, I continue running into multiple issues.
1. Similar to this post, I get this error:
- this has made my worker continue to instantiate forever and ever.
2. If I get past this error, I get different errors stating that no "safetensor file" exists for a specific portion of the file. Which doesn't make sense to me because I had thought the workers only start if the cached model is completely downloaded, according to the wiki.
ex 1:
ex 2:
I have been trying to setup my custom worker with stabilityai/stable-diffusion-3.5-large over the past few days and nothing seems to work.
I have my container disk set to 200GB to ensure there is enough space on the container volume. I have the cached model set with my hugging face token. And I can see in my logs that the cached model path with the snapshot is being created as I see the following in my output:
Model found at: /runpod-volume/huggingface-cache/hub/models--stabilityai--stable-diffusion-3.5-large/snapshots/ceddf0a7fdf2064ea28e2213e3b84e4afa170a0fHowever, I continue running into multiple issues.
1. Similar to this post, I get this error:
image ready, model not found- this has made my worker continue to instantiate forever and ever.
2. If I get past this error, I get different errors stating that no "safetensor file" exists for a specific portion of the file. Which doesn't make sense to me because I had thought the workers only start if the cached model is completely downloaded, according to the wiki.
ex 1:
OSError: Error no file named pytorch_model.bin, model.safetensors, tf_model.h5, model.ckpt.index or flax_model.msgpack found in directory /runpod-volume/huggingface-cache/hub/models--stabilityai--stable-diffusion-3.5-large/snapshots/ceddf0a7fdf2064ea28e2213e3b84e4afa170a0f/text_encoder_2.ex 2:
FileNotFoundError: No such file or directory: "/runpod-volume/huggingface-cache/hub/models--stabilityai--stable-diffusion-3.5-large/snapshots/ceddf0a7fdf2064ea28e2213e3b84e4afa170a0f/text_encoder_3/model-00001-of-00002.safetensors"
