the promise of DIGITS was to have 128 GB mixed RAM/vRAM for a reasonable price, which they could actually do because it's hard to abuse a desktop PC in datacenters. that's probably the main reason why most cards only have 16 GB vram, to avoid AI companies to buy consumer cards