Skip to content

Mismatch in Mesh Video Output after Training TALKSHOW and used in trained make your anchor model #28

Description

@FD01076

I used both SHOW and TALKSHOW.
I had a video that was split into 9-second segments, and I used SHOW to generate mesh videos for each segment. For each split, I used the final_all.pkl files and new audio (WAV) files in TALKSHOW, and trained three models: body pixel, face, and body-vq. However, the mesh video generated after training doesn't match what I got from SHOW, and it doesn't accurately reflect how the person is positioned in the original video provided to SHOW and because of this the anchor output videos are distorted. What can be the issue, how to train TALKSHOW for exact same mesh videos and mesh position as we gor from SHOW, on which the unet and controlnet are trained.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions