1. Adobe is developing new AI video features for Premiere Pro with integration with third-party services like OpenAI’s Sora, Runway, and Pika Labs.
2. The update is currently in internal testing at Adobe with a planned public release later this year, focusing on AI capabilities to extend clips and edit objects within sequences.
3. The AI features will enhance video production workflows, allowing for generative expansion of clips, in-video editing, and the addition or removal of objects using AI models like Sora, Runway, and Pika Labs, with the goal of enhancing rather than replacing existing video production methods.
Adobe is developing new AI video features for Premiere Pro, including integration with third-party services like OpenAI’s Sora, Runway, and Pika Labs. The update is currently being tested internally at Adobe, with no public release date yet. The new features will allow users to extend clips and add or remove objects within a sequence using AI. Adobe is reimagining the video creation and production workflow to give creators more power and flexibility.
The use of generative AI models like Sora, Runway, and Pika Labs has been controversial among some creatives, with concerns about job impact, data training provenance, and quality. However, many see generative AI as a way to enhance video production rather than replace it. Adobe wants to bring generative AI innovations into core Premiere Pro workflows to solve real pain points for video editors and allow them to focus on their craft.
New AI features coming to Premiere Pro include generative expansion and in-video editing, using the Adobe Firefly AI video model. This allows users to extend clips by predicting pixels to match the existing content and remove or add objects in a scene with just a mouse click. AI models will also be able to generate b-roll footage within Premiere Pro, providing editors with more creative options without the need to film additional footage.
While these new AI video features are not yet available to the public, they have been demonstrated using an internal version of Premiere Pro with real integration of the AI models. Adobe aims to enhance the video editing process and empower creators with advanced tools for editing and enhancing their video projects.