Adobe Previews Experimental AI Tools to Enhance Creative Cloud Applications

2024-10-16

Adobe is previewing a series of experimental AI tools focused on animation, image generation, as well as video and photo cleanup. These tools may be integrated into its Creative Cloud applications in the future.

While each tool targets different areas, they share a common goal: to automate the majority of tedious and complex tasks involved in content creation, while providing users with more control than simply inputting prompts into AI generators. This initiative aims to help users create animations and images or perform advanced video editing without requiring extensive time or expertise.

The first tool, named “Project Scenic,” allows users to have greater flexibility in controlling images generated by Adobe’s Firefly model. Unlike relying solely on text descriptions, Scenic generates a complete 3D scene, enabling users to add, move, and resize specific objects. Ultimately, the results of these adjustments serve as references for producing 2D images that align with the 3D design.

Next is “Project Motion,” a two-step tool that simplifies the creation of animated graphics in various styles. The first step involves a straightforward animation builder that lets users add dynamic effects to text and basic images without any animation experience. The second step further refines the animation video by adding colors, textures, and background sequences through text descriptions and reference images, transforming the video accordingly.

“Project Clean Machine” is an editing tool designed to automatically remove distractions from images and videos, such as camera flashes and unwanted people in the frame. It functions similarly to an automated content-aware fill feature but is more advanced, as it not only eliminates unwanted visual elements but also corrects any negative effects they may cause. For example, if fireworks in the background cause a few seconds of overexposed footage, Clean Machine will remove the flash while ensuring the overall color and lighting of the video remain consistent.

Adobe unveiled these tools as part of its “Sneaks” projects at the MAX conference, which are ongoing projects aimed at showcasing new technologies and gauging public interest. Although there is no guarantee that Sneaks projects will receive full releases, features such as Photoshop’s object removal and After Effects’ content-aware fill have originated from similar initiatives.

Currently, these Sneaks projects are not available for public trial, but this may change in the coming months.