Stability AI has recently unveiled a new AI model called "Stable Virtual Camera," which is capable of transforming 2D images into "immersive" videos with realistic depth and perspective.

Stable Virtual Camera is often utilized in digital filmmaking and 3D animation for real-time scene capturing and navigation. Stability AI claims that by integrating generative AI technology, this model offers enhanced control and customization.

The model can generate new perspective videos of a scene from one or multiple images (up to 32), based on user-specified camera angles. It also creates videos along "dynamic" camera paths or preset paths such as "spiral," "dolly zoom," "movement," and "panning."

The current release of Stable Virtual Camera is a research preview version, capable of producing videos in three aspect ratios: square (1:1), vertical (9:16), and horizontal (16:9), with lengths up to 1000 frames. However, Stability AI cautions that the model might produce lower quality results under certain conditions, especially when images contain people, animals, or "dynamic textures" like water.

In a blog post, the company pointed out that highly blurred scenes, complex camera paths intersecting with objects or surfaces, and irregularly shaped objects could lead to flickering artifacts, particularly when there's a significant difference between the target viewpoint and the input image.

Stable Virtual Camera is available for research purposes under a non-commercial license and can be downloaded via the AI development platform Hugging Face.

Previously, Stability AI gained attention for its popular image generation model, Stable Diffusion. Last year, the company received new funding from investors including Eric Schmidt and Napster founder Sean Parker, who are trying to reverse the company’s fortunes. It was reported that Imad Mostaq, co-founder and former CEO of Stability AI, caused financial difficulties due to mismanagement, resulting in employee resignations, the breakdown of a partnership with Canva, and investor concerns about the company’s future.

In recent months, Stability AI has appointed a new CEO, added Titanic director James Cameron to the board, and released several new image generation models. In early March this year, the company also collaborated with chipmaker Arm to launch an AI model capable of generating audio (including sound effects) on mobile devices running Arm chips.