H100 VRAM usage limited by power
So I am paying for a H100 but only getting the "power" of an A40? This doesn't seem right?
It never exceeds 30% of total VRAM available
Also 310 watt power limit seems very low?
3 Replies
We do not apply any power limiting to any of the servers in our Secure Cloud fleet. Additionally, this is the expected power limit of the NVIDIA H100 PCIe per NVIDIA. https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/h100/PB-11773-001_v01.pdf
Unknown User•2w ago
Message Not Public
Sign In & Join Server To View