Adobe has launched Firefly, a new AI video generator that aims to revolutionise the creative process. This creative tool, currently in limited public beta, is the company's first publicly available video model designed for commercial purpose. Firefly showcases a significant step forward in Adobe's commitment to inculcate AI to empower creators and push the boundaries of creativity.

Firefly effortlessly integrates with your favourite Adobe tools like Photoshop, Express, Illustrator, Substance 3D, and more. Its  multilingual capabilities (over 100 languages) allow creators worldwide to unlock their creative potential. Plus, the content it generates is commercially safe, meaning you can confidently use it in your projects.  

Firefly consists of a number of handful tools which are inculcated in video editing tools like Premiere Pro that will allow the users to stretch footage and generate video by just giving images and text prompts.

A new beta tool for Premiere Pro has been launched, allowing users to extend video clips by up to 2 seconds in either 720p or 1080p at 24 FPS. This feature is particularly useful for making minor adjustments to footage, such as correcting eyelines or addressing unexpected clips, which can help reduce the need for retakes. 

Also, the tool can enhance audio quality by extending sound effects and ambient noise by up to 10 seconds. While it doesn't support spoken dialogue or music, it proves to be quite valuable for small audio and video editing tasks. Two new video generation tools of adobe are getting introduced on the web: text to video and the other is image to video. These tools are currently limited to the beta within Firefly web app. 

Text to video tools function similarly to other generative technologies, like OpenAI's Sora. They enable users to input text prompts to create video clips, and can replicate various styles, including traditional film, 3D animation, and stop motion. Also users can refine the generated clips with features such as camera control, which allows for the simulation of different camera angles, movements, and shooting distances.

Image to video is helpful in enhancing the video generation process by allowing users to use a reference image along with a text command to generate the video. This feature of Adobe is useful for generating b-roll from photos or visualising potential reshoots by uploading stills from existing videos.

Comprehensively image-to-video is an innovative tool in video editing technology, but users should be aware of its current limitations.

Currently, the Firefly Video Model is limited to public beta. If you want to use the new tools, you have to join the waitlist for now. On this limited public beta, AI generations are free. Adobe will soon share more information regarding Firefly video generation offers and pricing when the Firefly Video Model moves out of limited public beta.