H100 VRAM usage limited by power

So I am paying for a H100 but only getting the "power" of an A40? This doesn't seem right?
It never exceeds 30% of total VRAM available

Also 310 watt power limit seems very low?

Runpod Join

We're a community of enthusiasts, engineers, and enterprises, all sharing insights on AI, Machine Learning and GPUs!

21,202Members

Resources

Recent Announcements

Similar Threads

Was this page helpful?

Twitter GitHub Discord

Communities Docs About Terms Privacy

Star

Setup for Free

Twitter GitHub Discord

Communities Docs About Terms Privacy

H100 VRAM usage limited by power - Runpod

Runpod•6mo ago•

4 replies

ForkMeDaddy

H100 VRAM usage limited by power

So I am paying for a H100 but only getting the "power" of an A40? This doesn't seem right?
It never exceeds 30% of total VRAM available

Also 310 watt power limit seems very low?