`tensor.tensor.Tensor`, `max.tensor.Tensor` or `max.driver.Tensor`?

Are we meant to use

tensor.tensor.Tensor

tensor.tensor.Tensor

max.tensor.Tensor

max.tensor.Tensor

max.driver.Tensor

max.driver.Tensor

? The first one might be a re-export of the second, but

max.driver.Tensor

max.driver.Tensor

is the only one which seems to handle multi-device, however most of the max APIs don't seem to work on it despite it seeming to be a better match for

ManagedTensorSlice

ManagedTensorSlice

. However, I don't see a way to move data off of the GPU with the

max.tensor.Tensor

max.tensor.Tensor

tensor.tensor.Tensor

tensor.tensor.Tensor

variants, and I get segfaults in what looks like a memcpy from a GPU pointer to a CPU pointer.

Modular•15mo ago•

1 reply

Are we meant to use

tensor.tensor.Tensor

tensor.tensor.Tensor

max.tensor.Tensor

max.tensor.Tensor

max.driver.Tensor

max.driver.Tensor

? The first one might be a re-export of the second, but

max.driver.Tensor

max.driver.Tensor

is the only one which seems to handle multi-device, however most of the max APIs don't seem to work on it despite it seeming to be a better match for

ManagedTensorSlice

ManagedTensorSlice

. However, I don't see a way to move data off of the GPU with the

max.tensor.Tensor

max.tensor.Tensor

tensor.tensor.Tensor

tensor.tensor.Tensor

variants, and I get segfaults in what looks like a memcpy from a GPU pointer to a CPU pointer.