I used both SHOW and TALKSHOW.
I had a video that was split into 9-second segments, and I used SHOW to generate mesh videos for each segment. For each split, I used the final_all.pkl files and new audio (WAV) files in TALKSHOW, and trained three models: body pixel, face, and body-vq. However, the mesh video generated after training doesn't match what I got from SHOW, and it doesn't accurately reflect how the person is positioned in the original video provided to SHOW and because of this the anchor output videos are distorted. What can be the issue, how to train TALKSHOW for exact same mesh videos and mesh position as we gor from SHOW, on which the unet and controlnet are trained.
I used both SHOW and TALKSHOW.
I had a video that was split into 9-second segments, and I used SHOW to generate mesh videos for each segment. For each split, I used the final_all.pkl files and new audio (WAV) files in TALKSHOW, and trained three models: body pixel, face, and body-vq. However, the mesh video generated after training doesn't match what I got from SHOW, and it doesn't accurately reflect how the person is positioned in the original video provided to SHOW and because of this the anchor output videos are distorted. What can be the issue, how to train TALKSHOW for exact same mesh videos and mesh position as we gor from SHOW, on which the unet and controlnet are trained.