DEV Community

Ammar
Ammar

Posted on

Eye Blinking and Lip Sync for Animal Images Using AI in Python

I am trying to create a system where a user uploads an image of an animal and types a message, and the system generates a video with AI-generated speech, synchronized lip movements, and eye blinking for the animal. I have explored platforms like Vidnoze, D-ID Studio, Lipsync AI by Gooey, and Python packages like Wave2Lip and LipGAN. However, these solutions work well for human faces but don't seem to work on animal images.

I am particularly struggling with lip sync and realistic eye blinking for animal faces. Are there any existing tools, models, or techniques to achieve this for animals? Any suggestions or guidance on how to train or modify models for animal faces would be greatly appreciated.

Top comments (0)