Hi, does anyone have a workflow suggestion for replacing someone's face in a video? I couldn't get w
Hi, does anyone have a workflow suggestion for replacing someone's face in a video? I couldn't get whole videos to look good so now I crop the video to a 512x512 square with the face mostly centered and then put it back in the full, uncropped video.
This is my process:
-set full uncropped video to 24fps in After Effects
- face track the video in AE and crop video to 512x512, face as big as possible
- Extract all frames to pngs
-remove every other frame (fewer imgs to process, will interpolate later)
- batch replace face with extension in img2tmg to give me a jump start
- img2img that batch with HED controlnet, original frames in the CN
- import that batch as a png sequence in AE at 12fps
-export new 512x512 video and run it into Flowframes to interpolate/increase fps
-import flowframes video into AE, place on the face in the uncropped original video
-make a simple mask to hide the edge of the blurred video
-make another layer of the video on top, 50% opacity, delay 1 frame
any suggestions? I'm using automatic1111 if that matters.
This is my process:
-set full uncropped video to 24fps in After Effects
- face track the video in AE and crop video to 512x512, face as big as possible
- Extract all frames to pngs
-remove every other frame (fewer imgs to process, will interpolate later)
- batch replace face with extension in img2tmg to give me a jump start
- img2img that batch with HED controlnet, original frames in the CN
- import that batch as a png sequence in AE at 12fps
-export new 512x512 video and run it into Flowframes to interpolate/increase fps
-import flowframes video into AE, place on the face in the uncropped original video
-make a simple mask to hide the edge of the blurred video
-make another layer of the video on top, 50% opacity, delay 1 frame
any suggestions? I'm using automatic1111 if that matters.
