Don
Don
PostsComments
RRunPod
Created by Don on 5/31/2024 in #⚡｜serverless
Bug in cancellation
Thanks
10 replies
RRunPod
Created by Don on 5/31/2024 in #⚡｜serverless
Bug in cancellation
No description
10 replies
RRunPod
Created by Don on 2/14/2024 in #⚡｜serverless
unsupported model error
do you know how can i convert model so that i might have that tag? or some other solution for this problem?
6 replies
RRunPod
Created by Don on 2/14/2024 in #⚡｜serverless
unsupported model error
No description
6 replies
RRunPod
Created by Don on 2/14/2024 in #⚡｜serverless
unsupported model error
i get below error when i try to build docker file with misri/cyberrealistic_v41BackToBasics but when i try with emilianJR/CyberRealistic_V3 it run successfully 
 => ERROR [ 7/10] RUN python /model_fetcher.py --model_url=https://huggingface.co/stablediffusionapi/cyberrealistic-41                  51.0s
------
 > [ 7/10] RUN python /model_fetcher.py --model_url=https://huggingface.co/stablediffusionapi/cyberrealistic-41:

49.69 Traceback (most recent call last):
49.69   File "/model_fetcher.py", line 70, in <module>
49.70     download_model(args.model_url)
49.70   File "/model_fetcher.py", line 48, in download_model
49.70     StableDiffusionPipeline.from_pretrained(
49.70   File "/usr/local/lib/python3.10/dist-packages/diffusers/pipelines/pipeline_utils.py", line 739, in from_pretrained
49.70     loaded_sub_model = load_method(os.path.join(cached_folder, name), **loading_kwargs)
49.70   File "/usr/local/lib/python3.10/dist-packages/diffusers/models/modeling_utils.py", line 553, in from_pretrained
49.70     set_module_tensor_to_device(model, param_name, param_device, value=param)
49.70   File "/usr/local/lib/python3.10/dist-packages/accelerate/utils/modeling.py", line 106, in set_module_tensor_to_device
49.70     new_module = getattr(module, split)
49.70   File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1269, in __getattr__
49.70     raise AttributeError("'{}' object has no attribute '{}'".format(
49.70 AttributeError: 'AttentionBlock' object has no attribute 'to_q'
------
Dockerfile:54
--------------------
  52 |     # Fetch the model
  53 |     COPY builder/model_fetcher.py /model_fetcher.py
  54 | >>> RUN python /model_fetcher.py --model_url=${MODEL_URL}
  55 |     RUN rm /model_fetcher.py
  56 |     
--------------------
ERROR: failed to solve: process "/bin/bash -c python /model_fetcher.py --model_url=${MODEL_URL}" did not complete successfully: exit code: 1
 => ERROR [ 7/10] RUN python /model_fetcher.py --model_url=https://huggingface.co/stablediffusionapi/cyberrealistic-41                  51.0s
------
 > [ 7/10] RUN python /model_fetcher.py --model_url=https://huggingface.co/stablediffusionapi/cyberrealistic-41:

49.69 Traceback (most recent call last):
49.69   File "/model_fetcher.py", line 70, in <module>
49.70     download_model(args.model_url)
49.70   File "/model_fetcher.py", line 48, in download_model
49.70     StableDiffusionPipeline.from_pretrained(
49.70   File "/usr/local/lib/python3.10/dist-packages/diffusers/pipelines/pipeline_utils.py", line 739, in from_pretrained
49.70     loaded_sub_model = load_method(os.path.join(cached_folder, name), **loading_kwargs)
49.70   File "/usr/local/lib/python3.10/dist-packages/diffusers/models/modeling_utils.py", line 553, in from_pretrained
49.70     set_module_tensor_to_device(model, param_name, param_device, value=param)
49.70   File "/usr/local/lib/python3.10/dist-packages/accelerate/utils/modeling.py", line 106, in set_module_tensor_to_device
49.70     new_module = getattr(module, split)
49.70   File "/usr/local/lib/python3.10/dist-packages/torch/nn/modules/module.py", line 1269, in __getattr__
49.70     raise AttributeError("'{}' object has no attribute '{}'".format(
49.70 AttributeError: 'AttentionBlock' object has no attribute 'to_q'
------
Dockerfile:54
--------------------
  52 |     # Fetch the model
  53 |     COPY builder/model_fetcher.py /model_fetcher.py
  54 | >>> RUN python /model_fetcher.py --model_url=${MODEL_URL}
  55 |     RUN rm /model_fetcher.py
  56 |     
--------------------
ERROR: failed to solve: process "/bin/bash -c python /model_fetcher.py --model_url=${MODEL_URL}" did not complete successfully: exit code: 1
6 replies
RRunPod
Created by Don on 2/12/2024 in #⚡｜serverless
automatic serverless api slow response problem
No description
27 replies
RRunPod
Created by Don on 2/12/2024 in #⚡｜serverless
automatic serverless api slow response problem
No description
27 replies
RRunPod
Created by Don on 2/12/2024 in #⚡｜serverless
automatic serverless api slow response problem
it's already on for me
27 replies
RRunPod
Created by Don on 2/12/2024 in #⚡｜serverless
automatic serverless api slow response problem
No description
27 replies
RRunPod
Created by Don on 2/12/2024 in #⚡｜serverless
automatic serverless api slow response problem
Have you gone through this link https://github.com/ashleykleynhans/runpod-worker-a1111 to create a Docker image with network volume?
27 replies
RRunPod
Created by Don on 2/12/2024 in #⚡｜serverless
automatic serverless api slow response problem
I am trying this repo that has a caching system, but I am encountering a dependency errors.https://github.com/runpod-workers/worker-a1111
27 replies
RRunPod
Created by Don on 2/12/2024 in #⚡｜serverless
automatic serverless api slow response problem
Yeah, that is not suitable for me as I don't have a lot of requests coming, and waiting 30 seconds would cost too much.
27 replies
RRunPod
Created by Don on 2/12/2024 in #⚡｜serverless
automatic serverless api slow response problem
@ashleyk hi , i have tried your repo https://github.com/ashleykleynhans/runpod-worker-a1111 with stable diffusion but it takes two miniues to serverless to generate image. how can i make this faster? starting webui is still taking lot of time
27 replies
RRunPod
Created by Don on 2/1/2024 in #⛅｜pods-clusters
Proxy Url related info
i can do this with private ip of pod but port is changing from default 80 and that is not accepted by cloudflare
12 replies
RRunPod
Created by Don on 2/1/2024 in #⛅｜pods-clusters
Proxy Url related info
i want to give diffrent url to different user like stable diffusion ui access in same server in my app through cloudflare i can remove access to them when their time is over so that he doesn't get main url and other user can still can use it
12 replies
RRunPod
Created by Don on 2/1/2024 in #⛅｜pods-clusters
Proxy Url related info
do you know how can i do workaround to this as i can't expose runpod proxy url in my site and in ip default 80 port is assigned to other port in runpod which is not supported
12 replies