Topics

RunPod•4mo ago

how to distribute usage of GPU

I purchased 2 RTX A5000 runpods. but my server is using only 1 GPU on 99%. other gpu is 0. is this wrong?

6 Replies

ashleyk•4mo ago

Some applications like A1111 don't support multiple GPU

Robbie•4mo ago

oh... really? could I indicate the GPU when running the python script?

ashleyk•4mo ago

Which python script?

Robbie•4mo ago

running tts engine script

ashleyk•4mo ago

If you got it from Github, I suggest logging a Github issue to ask how to enable muiltiple GPU

Robbie•4mo ago

\

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

11KMembers

View on Discord

Want results from more Discord servers?

Add your server

More Posts

Serverless not returning errorThe following code: ``` def handler(event): try: logger.info('validating input') Converting to Team AccountHi, will my history usage and billing be public to my team if I convert my personal account into a t Getting 404 error when making request to serverless endpointI'm using the python SDK, and pasting in the endpoint ID into the provided example code. Here is the out of memory errorout of memory error GPU terminalCant connect to web terminal or ssh to pod Compatibility of RTX A6000 for Multi-GPU TrainingI would like to inquire about the types of GPUs that support multi-GPU training. For instance, is it Out of memory errors on 48gb gpu which didn't happen beforeSome requests fail due to OOM, but the endpoint uses 48gb and is definitely capable of processing th H100 multi-gpus settingsWhen I tried to load weights from checkpoints on my custom model using multi-gpus, weights are not l Container fails to start randomlyContainer fails to start randomly error pod id **840b98harmlsgb wqaz2xufma32pt eqyabu82t6l3y9** sys Is it possible to run fully on sync?All the async functions and webhooks are so much pain, can we just fully run on sync?