using RTX 4090 Pod want to create API from civitai diffuser models - is cog best way?
Would love to avoid Docker.. and want to stick to my own server instead of serverless. input would be one of several safetensor models and some parameters, and then the generated image is the output of the API.
4 Replies
what is confusing me is that it looks like a RunPod is itself a docker container.. so using docker in a docker container dopesn't seen to work
Ah Bazel
so this Bazel example no longer compiles..
Build Docker Images on Runpod with Bazel | RunPod Documentation
RunPod's GPU Pods use custom Docker images to run your code.
error :
WARNING: Target pattern parsing failed.
ERROR: Skipping '//:push_custom_image': error loading package '': Unable to find package for @@[unknown repo 'rules_oci' requested from @@]//oci:pull.bzl: The repository '@@[unknown repo 'rules_oci' requested from @@]' could not be resolved: No repository visible as '@rules_oci' from main repository. Was the repository introduced in WORKSPACE? The WORKSPACE file is disabled by default in Bazel 8 (late 2024) and will be removed in Bazel 9 (late 2025), please migrate to Bzlmod. See https://bazel.build/external/migration.
ERROR: error loading package '': Unable to find package for @@[unknown repo 'rules_oci' requested from @@]//oci:pull.bzl: The repository '@@[unknown repo 'rules_oci' requested from @@]' could not be resolved: No repository visible as '@rules_oci' from main repository. Was the repository introduced in WORKSPACE? The WORKSPACE file is disabled by default in Bazel 8 (late 2024) and will be removed in Bazel 9 (late 2025), please migrate to Bzlmod. See https://bazel.build/external/migration.
INFO: Elapsed time: 0.065s
INFO: 0 processes.
ERROR: Build did NOT complete successfully
----let me know if there are updated docs for Bazel and deploying to runpod?
you can build images locally and then push them to docker hub to use in runpod