Get TorchCompile working in serverless with Flux/ComfyUI
Has anyone been able to get TorchCompile working in serverless environment when using Flux/ComfyUI?
For some reason I keep getting pure noise back after the job is completed. The workflow seems to work fine in a pod but in serverless the TorchCompile node for Flux gives problems.
6 Replies
Unknown User•4mo ago
Message Not Public
Sign In & Join Server To View
Torch Compile node delivers a noticably speed gain when attached to my Comfy workflow using Flux.
It works fine on a H100 pod that I launched and enjoy a nice 20% speed gain.
But the moment I use that same Comfy workflow in serverless (80GB Pro / H100's) with pretty much the same environment build. I keep getting images with static noise as final image results back.
This comfy node
I've deployed Wan 2.1 + torchcompile on serverless as well which works perfectly. Gives a nice extra performance boost and no issues
But with Flux + Torch Compile I keep getting a noisy image back.
Unknown User•4mo ago
Message Not Public
Sign In & Join Server To View
@gokuvonlange did you figure this out ?