Runpod•2y ago

How do I select a different template to the default in the new RunPod UI?

I might be missing something obvious, but: in the new RunPod Pods > Deploy UI, after selecting a GPU config, how do I pick a template other than the default?

RunPod Pytorch 2.2.10
runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04

There used to be a way to search for other provided templates, but I can't figure out how to do that in the new UI.

Thanks!

BelieveDiffusionOP•4/10/24, 4:01 AM

Huh… so, I'd selected H100 80GB SXM5 as the GPU config when I posted the message above. I just spotted that if I select (say) L40 or A40 instead, I see a "change template" option that isn't visible with the H100 config. Are alternate templates not available for H100 GPUs now?

digigoblin•4/10/24, 5:13 AM

I believe its because torch is compiled specifically for H100.

BelieveDiffusionOP•4/10/24, 3:14 PM

Ah, I see. Thank you!

Alseki•4/10/24, 3:51 PM

Not that I'm an expert, but I think its an error. I used to be able to run other templates on the H100. And then for a chunk of today no non-torch templates were loading at all for any GPU's. Now it looks like they have fixed it for most, just not the H100 yet [unless this is now a deliberate change]

kaj•4/10/24, 5:59 PM

you should be able to change templates on h100s now

Alseki•4/10/24, 6:31 PM

Ideal. Thanks

Nubby•4/10/24, 6:41 PM

Hi, it seems that i have a problem with the templates too.
Whenever i pick a template, let's say Koboldccp official, all arguments inside are completely blank, which defeats the purpose of a template.
Is there anything i could to to fix it? New ui seems to have broken it.

NNubby Hi, it seems that i have a problem with the templates too. Whenever i pick a tem...

digigoblin•4/10/24, 6:43 PM

Ask @Henky!! if he knows about this.

Henky!!•4/10/24, 6:43 PM

I have heard of this yes

Ddigigoblin Ask @Henky!! if he knows about this.

Nubby•4/10/24, 6:43 PM

I've already talked with him

Henky!!•4/10/24, 6:43 PM

But its a runpod bug, I don't know whats causing it

Nubby•4/10/24, 6:44 PM

i will just go around and run pytorch instead and apply the notebook

Henky!!•4/10/24, 6:44 PM

It happens before my template is even running

digigoblin•4/10/24, 6:44 PM

Probably similar issue to volume disk setting getting lost

Henky!!•4/10/24, 6:45 PM

Koboldcpp has no volume disk so thats normal

Henky!!•4/10/24, 6:45 PM

Or the persistent disk I mean

Nubby•4/10/24, 6:45 PM

New ui requires us to pick a GPU and THEN pick the template, so the link wtih official kobold ccp is non-functional, but there's an additional bug that makes all values in the config blank