Adobe has teased some of its upcoming generative AI video tools, including a new feature that can produce video clips from still images. This latest preview builds on the in-development Firefly video model that the software giant showed off in April, which is set to boost AI video and audio editing features in Adobe’s Creative Cloud applications.
The new promotional teaser shows footage produced by Firefly’s text-to-video capabilities that Adobe announced (but didn’t show) earlier this year. The tool allows users to generate video clips using text descriptions and adjust the results using various “camera controls” that simulate camera angles, movement, and distance of shooting. Also introduced an image-to-video feature for the Firefly video model that can generate clips using specific reference images. Adobe suggests it can be useful for creating additional B-roll footage or to patch gaps in production timelines.
If the sample footage is any indication of the final release, the resulting video quality is similar to what we’ve seen from OpenAI’s Sora model so far, which Adobe is also “exploring” as a third-party integration for Premiere Pro its video. software. Duration is limited, however, with Adobe’s VP of generative AI, Alexandru Costin, saying The Verge that videos created by the text-to-video and image-to-video features have a maximum length of five seconds.
One advantage of Adobe’s own model over Sora is its promise that Firefly is “commercially safe” due to its practice of openly licensed, public domain, and Adobe Stock content, which may reduce some concerns about copyright infringement. copyright.
The text-to-video and image-to-video features will both be available in beta as standalone Firefly applications later this year. Adobe said Firefly’s new video model will be integrated into its Creative Cloud, Experience Cloud, and Adobe Express applications.
The company also showed some additional clips of the upcoming “Generative Extend” feature for Premiere Pro that can extend the length of existing video footage, similar to Photoshop’s Generative Expand tool for photo backgrounds. Adobe says it will also arrive at an unspecified date “next year.”
