EXCLUSIVE: Adobe’s corrective AI can change voiceover emotions


Adobe’s Oriol Nieto uploaded a short video containing a combination of scenes and voiceover, but no sound effects. The AI ​​model analyzed the video and divided it into scenes, with emotional tags and descriptions for each scene. Then came the sound effects. The AI ​​model captures a scene with an alarm clock, for example, and automatically creates a sound effect. I selected a scene where the main character (an octopus, in this case) was driving a car, and added a door closing sound effect.

It wasn’t perfect. The alarm sound wasn’t realistic, and in a scene where two characters were hugging, the AI ​​model added an unnatural rustle to clothing that didn’t work. Instead of editing manually, Adobe used a Conversational interface (e.g. ChatGPT) to describe changes. In the car scene, there was no ambient sound from the car. Instead of manually selecting the scene, Adobe used a conversational interface and asked the AI ​​model to add a car sound effect to the scene. He managed to find the scene, create the sound effect, and place it perfectly.

These features are not available experimentally, but they usually find their way into the Adobe suite. For example, coordinationa Photoshop feature that automatically places assets with accurate colors and lighting in the scene, was demonstrated at Sneaks last year. And now it’s in Photoshop. It is expected to appear sometime in 2026.

Adobe’s announcement comes just months after video game voice actors He ended a strike that had lasted nearly a year To secure protections around AI – companies are required to obtain consent and submit disclosure agreements when game developers want to recreate a voice actor’s voice or likeness through AI. It was the voice actors Bracing for the impact of artificial intelligence It’ll be around in the business for some time now, and Adobe’s new features, even if they don’t generate a voiceover from scratch, are… Another sign of transformation Artificial intelligence is impacting the creative industry.

Leave a Reply

Your email address will not be published. Required fields are marked *