"Pika AI Video Generator Launches Lip Sync Feature for Character Lip Movements"

2024-02-28

Despite the impressive demonstration of the Sora AI video generation model by OpenAI, the public still cannot access it. However, competitor Pika is attracting users by launching the Lip Sync feature. This new feature allows users to add voice dialogues to videos and automatically synchronize the characters' lip movements, providing users with a more realistic experience.


With the technical support of ElevenLabs, Pika's Lip Sync feature supports text-to-audio and uploaded audio tracks. Users simply need to input or record the dialogue they want the video characters to say, and Pika's artificial intelligence will generate matching lip animations. This innovative feature is currently limited to Pika Pro users (a subscription service priced at $58 per month, charged at $696 for a 12-month advance payment) or members invited to join Pika's "Super Collaborator" program.

Although the quality and authenticity of the videos generated by Pika may be slightly inferior to OpenAI's Sora or other competitors like Runway, the launch of the Lip Sync feature has positioned Pika as a leader in disrupting traditional movie production software. By addressing the final barrier of artificial intelligence in creating longer narrative films, Pika is providing creators with more comprehensive tools.

Meanwhile, competitor Runway has also updated its Multi Motion Brush feature. This feature allows users to add up to five independent motion directions to different objects and scenes in videos. Now, Runway is adding region detection capabilities to automatically select and highlight the objects to which motion should be applied, simplifying the operation process.

Although Pika also allows users to edit video components and expand the canvas, it currently does not provide a similar "brush" tool, which may be slightly lacking in terms of motion control. However, with the continuous development of artificial intelligence technology, we have reason to believe that Pika and other competitors will continue to introduce more innovative features to meet the diverse needs of creators.