AMD mi300x
hey there folks, how many of these amds do y'all run ? it seems like a really tiny amount and i'd love to get access to them sometimes , but they're always booked , i looked away from my dashboard for just a second and it was gone ha !
8 Replies
We do not have a lot of these GPUs, but it looks like there should be 1 right now 👀 @Tonic
oh snap dont tempt me (ill try in the morning though tbf, i'm on CET rn)
such an insanely hot rig to be offering , really wish i was a fly on the wall
Neat, I needed one to xD
Luckily for tonic I never need them long
@Tonic go grab it 😄
https://go.runpod.io/amd if you want ROCm 6.4.1
gosh golly really been struggling with all the custom images and compilers today , and still this is way easier than it's ever been tbh
btw , super happy to see you around 🙂
Me figuring out how to make it ROCm 6.4.1 helped
Before that I couldn't use rocm on here
oh god i have some rocm / aiter ptsd right now
are you actually checking out the amd kernels and such ?
No, I discovered the rocm 6.4.1 runtime is compatible with whatever kernel they have despite the image being 6.1
it's a good machine tbh , i've liked it , not sure about optimizing on it though , as in , it's not that straightforward or easy (yet)