Want to weave various video clips generated by Stability AI into a movie? Now there is a tool for that.
Morph Studio, a company with its own text-to-video model, recently launched a tool called AI Movie Maker. It presents itself in the form of a storyboard, allowing users to create and edit scenes by inputting text prompts and combining them into a coherent narrative.
The foundation of this creative process is the partnership between Morph and Stability AI, but Morph ultimately plans to release a series of generative video models for users to choose from. Morph refers to the process of generating, editing, and cross-cutting as a "workflow." Users can share their unique workflows in Morph's creator community, and others can replicate and modify templates by simply changing the AI prompts.
Xu Huaizhe, co-founder of Morph, said that in traditional film production, shooting, editing, and post-production are separate processes, but AI blurs the boundaries of these stages and turns them into a continuous process. If a user is not satisfied with a certain shot, they can regenerate it on Morph's canvas. AI introduces a new workflow for film production.
Xu Huaizhe is one of the dropouts from a group of PhD students in computer vision at the Hong Kong University of Science and Technology. They founded Morph Studio in 2023. He sees ByteDance's popular video editing app CapCut as a potential competitor to Morph and hopes to ensure that his startup is not easily replaced.
Xu Huaizhe believes that Morph's competitive advantage will depend on its ability to build a vibrant user community. He suggests that the community is irreplaceable. Technically, Morph has made significant efforts to fine-tune its models to better meet the needs of creators.
Currently, Morph has about 10 employees and has raised $2.5 million in funding from Baidu Ventures.
Morph's first product is a place to share AI-generated memos, which fully demonstrates Xu Huaizhe's commitment to creating a video community. The mission of this startup is to develop high-definition videos, but to explore use cases, it first fine-tuned models for creating GIFs based on text prompts.
Xu Huaizhe said that nowadays, young people communicate and consume news through memos. While there are many image-based communities like Reddit and 9Gag, there has not been an online community based on videos until now.
This perspective prompted Xu Huaizhe to create a Telegram group where people can only "converse" through GIFs. Within a few days, the group grew to 300 members, and the GIFs posted by users included Elon Musk wearing a spacesuit or Donald Trump dancing disco, all generated by Morph's AI model. Subsequently, a similar Discord channel was also opened. Now, Morph is focusing its resources on improving the movie-making platform.
Xu Huaizhe said that they found people don't care if GIFs look a bit fake, but they like it when they can tell that they are generated by AI. People are using memos to convey deeper meanings than what can be expressed through text.
