I’m currently using Modal for my GPU training workload, how does this differ?
Modal is an ephemeral sandbox, whereas machine0 is a persistent VM you own: root, your own driver/CUDA/kernel, GPU passed straight through, and a fixed GPU per size.
So you are using Modal VMs for training (I assume RL evals?).
Modal is an ephemeral sandbox, whereas machine0 is a persistent VM you own: root, your own driver/CUDA/kernel, GPU passed straight through, and a fixed GPU per size.
So you are using Modal VMs for training (I assume RL evals?).