AI Toolkit with Serverless
Is there a way to get the AI toolkit image that's available as a Pod template for serverless? I'm looking for a way to train WAN LoRAs with an endpoint, any help in this would be super appreciated.
2 Replies
Serverless are bursty. They instantiate, handle a request, and disappear. If you're training something that will take longer than a few seconds, I think you'll want a pod. Otherwise you will lose your state periodically as your serverless workers are reaped.
Is there a way to set this up from a pod where I can send and receive the data?