Adobe Firefly Gets New AI Video Editing Tools, Partner Models, and Browser-Based Editor

Adobe has expanded its Firefly inventive AI platform with new video enhancing capabilities, third-party mannequin integrations, and a light-weight browser-based video editor designed to maneuver past “immediate roulette” towards real inventive management. The replace introduces Runway’s Aleph mannequin for exact clip enhancing, Topaz Astra for decision upscaling, and Black Forest Labs’ FLUX.2 for enhanced picture technology.For filmmakers and content material creators who’ve adopted Adobe’s regular improvement of AI-powered instruments, this replace represents one other step within the firm’s technique to place Firefly as a unified inventive hub somewhat than simply one other text-to-video generator. The additions tackle two persistent criticisms of generative video instruments: the shortage of exact enhancing management and the necessity to soar between a number of platforms to attain skilled outcomes. Adobe’s method now lets customers decide the precise mannequin for every process whereas protecting every thing inside a single interface.Now we have lined Adobe’s Firefly video capabilities extensively right here at CineD, from the preliminary announcement of the Firefly Video Mannequin to its public beta launch earlier this 12 months. The platform has advanced significantly since these early days, and this newest replace continues that trajectory by specializing in workflow refinement somewhat than simply uncooked technology functionality.Immediate to Edit with Runway’s Aleph modelThe most important addition for video professionals is the brand new Immediate to Edit characteristic, which integrates Runway’s Aleph mannequin straight into Firefly. Somewhat than regenerating whole clips from scratch when changes are wanted, creators can now add present footage and make focused edits utilizing pure language directions. The workflow is simple: generate a video in Firefly, then refine it utilizing particular edit instructions powered by Aleph.Runway launched Aleph in July 2025 as an in-context video mannequin able to multi-task visible technology. The mannequin can add, take away, and rework objects inside clips, generate new digicam angles, modify lighting situations, apply fashion transfers, and deal with a variety of post-production duties that may historically require handbook compositing work. In response to Runway’s documentation, Aleph analyzes uploaded footage to know scene context earlier than implementing modifications, sustaining temporal consistency throughout frames.For Adobe, this partnership represents a departure from relying solely on in-house fashions. By integrating Aleph, Firefly positive aspects subtle video manipulation capabilities that complement its present technology instruments. The mixture means creators can generate preliminary content material with Adobe’s commercially protected Firefly Video Mannequin, then apply extra focused edits via Aleph with out leaving the platform.New digicam movement controlsAdobe has additionally launched enhanced digicam movement controls that give filmmakers extra say in how the digital digicam strikes via generated scenes. The workflow makes use of a reference-based method: add your beginning body picture alongside a video clip demonstrating the digicam motion you need to recreate. Firefly then applies that movement sample to your new content material.This addresses one of many elementary challenges with AI video technology, the place digicam conduct usually feels random or disconnected from cinematic conventions. Through the use of precise footage as a movement reference, creators can pull from their very own shot libraries or present manufacturing work to information the AI’s output. It isn’t fairly the identical as handbook keyframing, but it surely provides considerably extra predictability than textual content prompts alone.Topaz Astra integration for video upscalingResolution limitations have been a constant ache level for AI-generated video. Most instruments output at 1080p or decrease, which restricts their usefulness in skilled pipelines the place 4K or greater supply is customary. Adobe is addressing this via integration with Topaz Astra, the cloud-based video upscaler from Topaz Labs.Topaz Astra video-upscaler is now built-in straight with Adobe Firefly. Picture credit score: AdobeAstra makes use of the corporate’s Starlight AI fashions to upscale footage to 1080p or 4K whereas enhancing element and readability. In contrast to easy decision scaling, the software provides two distinct modes: Exact mode maintains the unique look whereas cleansing up artifacts, whereas Inventive mode can “think about” new element into the footage. For AI-generated content material particularly, Inventive mode might help easy out the telltale inconsistencies that usually plague artificial video.The mixing means Firefly customers can generate clips on the platform’s native decision, then push them to broadcast-ready high quality with out exporting to a separate software. For creators working with older or lower-quality supply materials, Astra can even assist restore readability and cut back noise, basically serving double obligation as each an upscaler and a restoration software.FLUX.2 from Black Forest Labs joins FireflyOn the picture technology facet, Adobe is including FLUX.2 from Black Forest Labs to Firefly’s rising roster of accomplice fashions. FLUX.2 is the most recent iteration of the FLUX mannequin household and represents a big leap in picture high quality, immediate following, and multi-reference consistency.Inside Firefly, FLUX.2 generates and edits pictures at as much as 1 megapixel decision with versatile side ratios. The mannequin delivers what Black Forest Labs calls photorealistic element with superior textual content rendering capabilities, an space the place many AI picture mills nonetheless battle. Notably, FLUX.2 can work with as much as 4 reference pictures concurrently, enabling character and magnificence consistency throughout a number of generations.FLUX.2 from Black Forest Labs is obtainable in Adobe Firefly. Picture credit score: Black Forest LabsThe mannequin is obtainable in Firefly’s Textual content to Picture module, Immediate to Edit characteristic, and Firefly Boards. Adobe can also be bringing FLUX.2 to Photoshop desktop instantly, with Adobe Categorical integration deliberate for January. This cross-platform availability displays Adobe’s broader technique of constructing succesful AI fashions accessible wherever inventive work occurs.Firefly video editor enters public betaBeyond new fashions and options, Adobe is launching a devoted Firefly video editor in public beta. Described as a light-weight, browser-based meeting area, the editor lets creators mix AI-generated clips with private footage and audio in a streamlined interface.The software shouldn’t be supposed to switch full-featured NLEs like Premiere Professional. As a substitute, it serves as a ending atmosphere for AI-generated content material, the place creators can assemble generated clips into coherent sequences with out switching to heavier software program. Consider it as the ultimate step in an AI-first workflow: generate your footage, apply edits and upscaling, then reduce it collectively in a easy timeline earlier than export or handoff to extra subtle enhancing instruments.The Firefly video editor shouldn’t be meant to switch Premiere Professional, only a first step after producing. Picture credit score: AdobeUnlimited generations via mid-JanuaryAs a promotional push, Adobe is providing limitless picture and video generations to Firefly plan subscribers via January 15. This is applicable to all Firefly and accomplice fashions for picture technology, plus limitless video generations utilizing the Firefly Video Mannequin particularly. For creators who’ve been rationing their technology credit, this window provides a chance to experiment extra freely with the platform’s expanded capabilities.The larger image for skilled workflowsAdobe frames this replace round a key perception: creators don’t need to be locked right into a single AI mannequin or pressured to hop between disparate instruments to finish a undertaking. The mixture of Adobe’s personal commercially protected fashions with industry-leading accomplice instruments like Runway, Topaz, and Black Forest Labs creates what the corporate calls a sensible, end-to-end inventive workflow.This method carries specific relevance for skilled customers who want each inventive flexibility and authorized readability. Adobe has persistently emphasised that Firefly fashions are skilled on licensed content material, making generated belongings protected for industrial use with out the copyright ambiguity that surrounds many competing instruments. By internet hosting accomplice fashions inside the similar atmosphere, Adobe extends a few of that workflow integration whereas letting creators entry specialised capabilities when wanted.Whether or not this multi-model technique will fulfill skilled cinematographers stays to be seen. The instruments are spectacular on paper, however real-world manufacturing calls for a degree of precision and predictability that generative AI has not but persistently delivered. Nonetheless, for previsualization, idea improvement, and sure sorts of content material creation, Firefly’s increasing toolkit represents a genuinely helpful useful resource.What do you concentrate on Adobe’s method to integrating third-party AI fashions into Firefly? Are you planning to check the brand new Immediate to Edit characteristic with Runway’s Aleph mannequin? Don’t hesitate to tell us within the feedback beneath!