Poor audio quality has always been a challenge for film creators, whether amateurs or professional filmmakers, who need to address audio problems caused by wind interference, suboptimal microphone placement, crowd noise and other sound interference, any of which The presence of any of these may render the video unavailable. Therefore, Adobe is studying how to use artificial intelligence technology as an audio processing solution to make it easier for everyone to create high-quality creations.
Adobe recently demonstrated the latest technology it is developing「Project Sound Lift」AI can be used to split recordings into different audio tracks with one click, such as separating voices, applause, laughter, alarms, crowds and various other environmental noises in videos, etc., and each audio track can be controlled individually so that Post-processing to maximize overall sound impact and quality.
Project Sound Lift helps users easily process audio recordings in a variety of scenarios, using AI to independently enhance, transform and control speech and sound. Adobe’s “speech enhancement” technology, currently available in Adobe applications such as Premiere Pro, is integrated into Project Sound Lift, further changing the way creators produce and manage studio-quality audio content.
Past audio AI models often required clean, pure input sounds (such as a single speaker or sound source with no background noise or echo), but real-world recording situations rarely meet these conditions. In fact, when recording, the audio file may contain Noise, reverberation, multiple speakers and various sudden sounds are often uncontrollable. This limitation hinders the application of audio artificial intelligence in daily recording, and makes it difficult for ordinary users to use complex audio tools.
Project Sound Lift developed by Adobe will use AI technology to simply separate speech and environmental sounds in daily life scenes, including dividing speech, applause, laughter, music and other various noises into different audio tracks, each Each track can be controlled individually to enhance the quality and content of your video.
Source: Adobe
