Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for creating motion module datasets #28

Open
FizzleDorf opened this issue Oct 23, 2023 · 1 comment
Open

Add support for creating motion module datasets #28

FizzleDorf opened this issue Oct 23, 2023 · 1 comment

Comments

@FizzleDorf
Copy link

Add option for creating small video clips from video. This is for any animate diff repo (training scripts are included with repos) or the motion module training gui. This paper also requires video and images for it's method so doing both image and video datasets at the same time may be something to consider for the future. ffmpeg is already a requirement so this should be possible.

@cyber-meow
Copy link
Owner

Thank you for the suggestion. I may look into it when I have time.
However I think this will require some work as we either need dedicated tools for video clips or find a way to combine information from different frames to form the prompt.
I will already need to try training with video clips myself to see what kind of dataset is meaningful in this case.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants