Adobe announces new Firefly AI tools for video editors

Adobe recently revealed its next generation of AI features, a collection of generative models called Firefly. These are the first features to generate both images and font effects.

Using them, digital artists will be able to create professional-quality illustrations using text prompts. In addition, Firefly’s multimodal nature means that audio, video, illustrations and 3D models can all be generated via the system through words. 

Source: Adobe

Firefly’s generative AI models can both create and transform audio, video, illustrations and 3D models using text prompts similar to those used in Dall-E and ChatGPT, the company said. Adobe Firefly will be part of a series of new Adobe Sensei generative AI services across Adobe’s clouds.

Firefly is currently available in beta across the Adobe suite on programs such as Premiere Pro, Illustrator, After Effects and Photoshop. Creators can sign up here to join the beta and request access to Firefly. They’ll be accessible through a closed beta program later this year. 

The first model of the Firefly family is trained on images from Adobe’s Stock photo catalog, the company said. It’s openly licensed content and media from the public domain, which ensures the model won’t result in lawsuits. It also indicates that stock photographers and artists will be compensated for the use of their works in training these AIs.  

Here are some of the initial Firefly features:

  • Text to image: Creators can type their vision into a box and generate an image of it in seconds.
  • Generate text styles and textures: Using another text-to-image generation style, this feature stylizes text. It can add textures and styles to text by interpreting a prompt and applying it to the words. Creators can turn text into essentially any style they want with a simple description.

Now, just a month after its initial announcement, Adobe announced today that it is already working on a host of upgrades for Creative Cloud video, and for audio applications such as Premiere Pro and Adobe After Effects. The additions should be coming to Firefly’s beta program later in 2023. 

The new features announced this week are designed to help professional editors cut down on work and save time on tasks such as boosting colour levels, inserting placeholder images, adding effects, and autonomously recommending b-roll for a given project. Creators can simply type their ideas into Firefly’s AI text prompt and let the algorithm work away.

This includes “text to colour enhancements,” a capability that can adjust the brightness and saturation levels and shift the time of day in an image using natural language prompts, Adobe says. 

Some newly announced features include:

  • Advanced music and sound effects: Using text prompts, users can ask Firefly to generate custom sounds and music to fit a specific mood and scene, either as temporary or final tracks.
  • Animated fonts, graphics and logos: Subtitles, logos and title cards can be generated quickly with custom animations based on the creator’s preferences described in words.
  • Script and b-roll capabilities: Firefly will accelerate pre-production, production and post-production workflows, using AI analysis of script text to automatically create storyboards and pre-visualizations while also recommending b-roll clips for rough and final cuts.

Adobe says there will be how-to guides to walk new users through the process of using these features. 

Would you recommend this article?

Share

Thanks for taking the time to let us know what you think of this article!
We'd love to hear your opinion about this or any other story you read in our publication.


Jim Love, Chief Content Officer, IT World Canada

Featured Download

Samira Balsara
Samira Balsara
Samira is a writer for IT World Canada. She is currently pursuing a journalism degree at Toronto Metropolitan University (formally known as Ryerson) and hopes to become a news anchor or write journalistic profiles. You can email her at [email protected]

Featured Story

How the CTO can Maintain Cloud Momentum Across the Enterprise

Embracing cloud is easy for some individuals. But embedding widespread cloud adoption at the enterprise level is...

Related Tech News

Get ITBusiness Delivered

Our experienced team of journalists brings you engaging content targeted to IT professionals and line-of-business executives delivered directly to your inbox.

Featured Tech Jobs