- tech360.tv
Adobe Unveils New AI Tools for Premiere Pro, Revolutionising Video Editing
Adobe introduces generative AI tools within Premiere Pro, enabling users to add or remove objects in a scene and extend clips. The new tools are powered by a video model and join Adobe's Firefly family of AI capabilities. Adobe plans to integrate third-party generative AI models directly into Premiere Pro, expanding the ecosystem of plugins.
In a groundbreaking announcement, Adobe revealed the introduction of generative AI tools within its renowned video editing software, Premiere Pro. This move is set to transform the editing process, empowering users to effortlessly add or remove objects in a scene and extend existing clips.
The new generative AI tools, which will be integrated into Premiere Pro, are designed to streamline editing workflows. These tools will be powered by a video model that joins Adobe's esteemed Firefly family, which includes Image, Vector, Design, and Text Effects.
As part of its ongoing commitment to innovation, Adobe is continuously developing its Firefly AI models, encompassing imaging, video, audio, and 3D capabilities. These models will be seamlessly integrated across Creative Cloud and Adobe Express. Additionally, Adobe has provided a glimpse into its vision of incorporating third-party generative AI models directly into applications like Premiere Pro.
Recognising the importance of third-party plugins, Adobe is expanding its support for an ecosystem of plugins within Premiere Pro. Early explorations have demonstrated how professional video editors can leverage video generation models from OpenAI and Runway, all within the familiar environment of Premiere Pro. This integration opens up possibilities for generating B-roll footage to enhance projects and utilising the Generative Extend tool from Pika Labs to add a few seconds to shots.
Ashley Still, Senior Vice President of the Creative Product Group at Adobe, expressed the company's commitment to empowering creators: "Adobe is reimagining every step of video creation and production workflow to give creators new power and flexibility to realise their vision. By bringing generative AI innovations deep into core Premiere Pro workflows, we are solving real pain points that video editors experience every day, while giving them more space to focus on their craft."
The developments introduced by Adobe include Generative Extend, a feature that seamlessly adds frames to make clips longer, facilitating precise timing edits and smooth transitions. This technology addresses a common challenge faced by professional editors, enabling them to create additional media for fine-tuning edits or covering transitions.
Another remarkable addition is Object Addition and Removal, which simplifies the process of selecting and tracking objects, allowing for easy replacement. This tool can remove unwanted items, change an actor's wardrobe, or swiftly add set dressings such as paintings or photorealistic flowers on a desk.
Furthermore, Adobe introduces Text to Video, a feature that generates entirely new footage directly within Premiere Pro. By typing text into a prompt or uploading reference images, users can ideate and create storyboards or generate B-roll to complement live-action footage.
While the conversation around generative AI often revolves around competition, Adobe envisions a more diverse future. Drawing from its decades of experience with AI, Adobe believes that AI-generated content is most valuable when seamlessly integrated into the creative process. For most Adobe customers, generative AI will serve as a starting point and a source of inspiration.
In its pursuit of industry-standard tools and seamless workflows, Adobe aims to enable users to incorporate materials from any source across any platform. Whether utilising Adobe Firefly or other specialised AI models, Adobe is committed to making the integration process as effortless as possible within its applications.
As part of its responsible innovation approach, Adobe has developed its own AI models and is dedicated to ensuring the integration of third-party models aligns with the company's safety standards. As a founding member of the Content Authenticity Initiative, Adobe pledges to attach Content Credentials to assets produced within its applications. This free, open-source technology acts as a nutrition label for online content, providing users with transparency regarding how content was created and which AI models were utilised on Adobe platforms.
In addition to the groundbreaking generative AI video tools, Adobe will also introduce new audio workflows in Premiere Pro, set to be available to users in May. These tools will provide editors with precise control over audio quality, including interactive fade handles for custom audio transitions and AI-powered audio tagging for easy categorisation.
With effect badges and redesigned waveforms, Premiere Pro users can quickly identify clips with effects and effortlessly add new ones. The intelligently resizable waveforms adapt to changes in track height, ensuring optimal readability.
Adobe introduces generative AI tools within Premiere Pro, enabling users to add or remove objects in a scene and extend clips.
The new tools are powered by a video model and join Adobe's Firefly family of AI capabilities.
Adobe plans to integrate third-party generative AI models directly into Premiere Pro, expanding the ecosystem of plugins.
Source: FORBES