Matt Collins from Krotos demonstrates Krotos Studio, a sound technology platform featuring an integrated panel for Adobe Premiere Pro. The tool is designed to streamline the sound design process for video editors by using AI-assisted analysis to automatically add sound to video timelines. This “video to sound” technology analyzes a selected region of a video clip, identifies scene cuts, and populates the timeline with appropriate audio layers.
—
HDMI® Technology is the foundation for the worldwide ecosystem of HDMI-connected devices; integrated with displays, set-top boxes, laptops, audio video receivers and other product types. Because of this global usage, manufacturers, resellers, integrators and consumers must be assured that their HDMI® products work seamlessly together and deliver the best possible performance by sourcing products from licensed HDMI Adopters or authorized resellers. For HDMI Cables, consumers can look for the official HDMI® Cable Certification Labels on packaging. Innovation continues with the latest HDMI 2.2 Specification that supports higher 96Gbps bandwidth and next-gen HDMI Fixed Rate Link technology to provide optimal audio and video for a wide range of device applications. Higher resolutions and refresh rates are supported, including up to 12K@120 and 16K@60. Additionally, more high-quality options are supported, including uncompressed full chroma formats such as 8K@60/4:4:4 and 4K@240/4:4:4 at 10-bit and 12-bit color.
—
The system adds multiple layers of background ambience and transition effects such as risers, wooshes, and impacts, all synchronized with the video content. The AI makes decisions on what sounds to use, but the audio itself is not generative. Instead, Krotos Studio pulls from a large library of high-quality, real audio clips recorded by professional sound designers. This approach aims to maintain professional audio quality while significantly reducing the manual effort of browsing, auditioning, and synchronizing sound effects.
Once the initial sounds are placed on the Premiere Pro timeline, editors have full control to iterate and customize the results. The Krotos Studio panel allows users to swap out specific sounds—for example, changing an “intense” impact to a “soft” one—while maintaining perfect sync. Because all the audio is placed on the timeline in separate layers, editors can use standard Premiere tools to cut, delete, or adjust the volume of individual elements, providing granular control over the final mix.
The AI selects sounds from the library based on the visual context of the video. For instance, for a city scene, it will select clips from its urban environment collection. While the AI aims for accuracy, the workflow is designed to accommodate and easily correct any suboptimal choices. The editor can quickly identify a misplaced sound on the timeline, make a cut, and adjust it as needed, blending the speed of AI with the precision of manual editing.
Krotos has a background in developing specialized tools for professional sound designers, with their other products having been used in major productions like “Stranger Things” and “Game of Thrones.” The company is now leveraging that expertise to bring similar technology to a broader market of video editors, focusing on simplifying complex sound design tasks directly within the NLE environment.
