How to get a general idea for max volume size on secure cloud?
I have been able to deploy 2TB drives, but what is the standard here? How much storage is there generally per server to estimate what i should expect to be able to get?
JNot sure but the hosts requirement should estimate them to around 2tb per gpu recommended
JAnd for 80gbs around 4tb per gpu recommended
JThat should estimate the avg of machines hosted to runpod should have
ZThank you!
ZAny idea how/if i could work with runpod to get more?
JYep your welcome bro
JHmm like request more storage?
JI'd recommend trying to contact support or try network storage
JThey have bigger limits right
Zuse network storage now
JBut only available in one region ( usable by machines in one region)
Z15TB
Zsuper slow
JOh super slow?
Zgoing to try migrating to nvme volume when needed on pod
Zcan trim down a lot but 4TB might not cut it for some stuff
JCan try allocating more and see what happens
JIf theyre available then great
Zyep tried that it depends really cant get anything super big though
JWhat do you need the big data storage for btw
Zcomputer vision with HD video input
JIn that case might try working with rp's support maybe
Zbroken into images for faster training
JWoo that's cool
ZYou say that until you try to make it fast
JLike frame by frame?
JHaha yeah everyone getting into technical side won't see this as a fun thing
Zyes each frame seperate, decoding video takes to long during training
Zpreprocessing took days and I screwed it up multiple times!
Jdang, you need so much data o_o
Jdo u need it all avaliable every time?
JYea network storage I/O operations has some speed issues with a lot of files coming in and out.
Zyes for most
Zrealistically i can get it down a lot smaller right now
Zbut later on yes maybe up to 10 terabytes of data will be needed for a train
Zlike right now i bet 5 TB would suffice but I have extra data in network drive