Pika Drives AI Video Innovation with Launch of New Sound Effects Feature

2024-03-12

With OpenAI continuously sharing its impressive Sora video clips, this smooth and realistic generative AI video model has attracted a lot of attention. However, Sora is currently an internal model and has not been released to the public. In this competitive moment, Pika, another leading company in the video AI field, has launched a new feature on its web platform pika.art this weekend, which automatically generates sound effects for AI videos. Pika's innovative move brings a whole new dimension to AI-generated videos. In the past, most of these videos were silent, and users had to use other editing software to add sound files. Now, with Pika's new feature, users can directly add sound effects within the application, eliminating the need to search for sound files separately and greatly improving production efficiency. It is worth mentioning that this new feature comes less than two weeks after Pika introduced its lip-sync feature. The introduction of the lip-sync feature has taken AI-generated content to a whole new level, making it more suitable for individual creators and business use cases. Now, Pika combines lip-sync with the generative AI video visualizer, providing users with the first "integrated" major generative AI video creation platform. Users can use AI to complete all operations of sound effects, dubbing, and visual effects in one place, greatly simplifying the creative process. By providing these three core features, Pika aims to become the ideal choice for filmmakers. It eliminates the need for photographers, cameramen, sound designers, and even actors, at least in some projects. Users no longer need to go out for shooting or search for files in multiple image and sound databases and programs to piece together a movie. Now, they just need to input their imagination, and Pika can quickly generate all the content. However, currently, Pika states that this new feature is only available to members of the Super Collaborator program or users who pay a monthly $58 Pro subscription fee. The company plans to promote it to all users in the future to meet broader market demands. Pika offers two ways to obtain AI video sound effects. One is context generation, where the AI model automatically selects the most suitable audio based on text prompts. The other is a post-method, where users can add AI-generated sound effects to specific clips after generating or uploading silent clips. Users can easily add sound effects by turning on the sound switch during input prompts or selecting the sound effects function in the editing interface and writing relevant prompts. Although this feature has just been announced, it is expected to provide AI video creators with a much-needed tool to enhance their creations. In the past, users had to obtain audio from other sources, which increased the difficulty and production time. Pika claims to be the first company in the AI video field to incorporate generated audio as part of the video output, and this innovation will undoubtedly drive the development of the entire industry. It is worth noting that Pika is not the only company exploring the use of text prompts to generate sound. Competitors such as ElevenLabs and Meta are also making progress in this field. However, these competitors have not yet provided built-in video generative AI models, giving Pika a clear advantage. Since its launch in December 2023, Pika has been committed to strengthening its products to compete, especially against the upcoming OpenAI Sora. Recently, Pika collaborated with ElevenLabs to introduce the lip-sync feature and plans to add more features based on it. The company has raised $55 million in funding, with a valuation of nearly $200 million, and is determined to challenge OpenAI and other players in the creative AI field who have received substantial financial support. With continuous innovation and breakthroughs in the AI video field by companies like Pika, we have reason to believe that future video creation will be more convenient, efficient, and creative.