Adobe Is Working On 'Photoshop For Audio' That Will Let You Add Words Someone Never Said (theverge.com) 161
An anonymous reader quotes a report from The Verge: Adobe is working on a new piece of software that would act like a Photoshop for audio, according to Adobe developer Zeyu Jin, who spoke at the Adobe MAX conference in San Diego, California today. The software is codenamed Project VoCo, and it's not clear at this time when it will materialize as a commercial product. The standout feature, however, is the ability to add words not originally found in the audio file. Like Photoshop, Project VoCo is designed to be a state-of-the-art audio editing application. Beyond your standard speech editing and noise cancellation features, Project VoCo can also apparently generate new words using a speaker's recorded voice. Essentially, the software can understand the makeup of a person's voice and replicate it, so long as there's about 20 minutes of recorded speech. In Jin's demo, the developer showcased how Project VoCo let him add a word to a sentence in a near-perfect replication of the speaker, according to Creative Bloq. So similar to how Photoshop ushered in a new era of editing and image creation, this tool could transform how audio engineers work with sound, polish clips, and clean up recordings and podcasts. "When recording voiceovers, dialog, and narration, people would often like to change or insert a word or a few words due to either a mistake they made or simply because they would like to change part of the narrative," reads an official Adobe statement. "We have developed a technology called Project VoCo in which you can simply type in the word or words that you would like to change or insert into the voiceover. The algorithm does the rest and makes it sound like the original speaker said those words."
Law enforcement's gonna love this! (Score:5, Insightful)
When recording voiceovers, dialog, and narration, people would often like to change or insert a word or a few words due to either a mistake they made or simply because they would like to change part of the narrative...
When recording suspects, police would often like change or insert a word or a few words in order to manufacture evidence by changing part of the narrative.
FTFY
OTOH, if it's really good enough to be undetectable, it might cause a lot of legitimate and unaltered recordings to be thrown out of court on the grounds of reasonable doubt.
Re: Law enforcement's gonna love this! (Score:5, Insightful)
Re: (Score:2)
This sounds shopped. I can tell by the {samples/notes/octaves/pitch/frequency/timbre/vibrato}
Re: (Score:2)
Police already know how to prove these sort of thing haven't been tampered with: it's called "the chain of evidence". These techniques are simply going to have to be applied to recorded testimony, that's all.
Re: (Score:2)
Police already know how to prove these sort of thing haven't been tampered with: it's called "the chain of evidence". These techniques are simply going to have to be applied to recorded testimony, that's all.
First, it's called "Chain of Custody", and it already exists for recorded evidence.
Second, when the "Custody" continues to be in the LEA's hands, who's to say that someone at the LEA didn't replace the recording in the Evidence Bag with a SoundShopped one?
Re:Law enforcement's gonna love this! (Score:5, Interesting)
It's apt that this technology is being made widespread at the same time that the blockchain is gaining adoption. What we need is to blockchain every bit of relevant public discourse, updating the concept of the "chain of custody" to the XXIst century.
Re: (Score:2)
XXIst century.
Well it is MMXVI, after all. Or as the kids put it these days "II 0 I VI"
Re: (Score:2)
Re: (Score:1)
Or you know, shouting stuff that isn't happening. STOP RESISTING, GET YOUR HANDS OUT OF YOUR POCKETS, when the person is on the ground handcuffed and being beaten...
Re: (Score:2)
When recording voiceovers, dialog, and narration, people would often like to change or insert a word or a few words due to either a mistake they made or simply because they would like to change part of the narrative...
When recording suspects, police would often like change or insert a word or a few words in order to manufacture evidence by changing part of the narrative.
FTFY
OTOH, if it's really good enough to be undetectable, it might cause a lot of legitimate and unaltered recordings to be thrown out of court on the grounds of reasonable doubt.
It'll add a whole new level to "Its a shop. I have a lot of experience with shops and also you can tell by the audiopixels".
Re: (Score:2)
When recording voiceovers, dialog, and narration, people would often like to change or insert a word or a few words due to either a mistake they made or simply because they would like to change part of the narrative...
When recording suspects, police would often like change or insert a word or a few words in order to manufacture evidence by changing part of the narrative.
heheh yeah the advertised use-case scenario is about as believable as private mode in browsers designed for shopping for gifts for your wife without her knowledge. But then again if your wife is regularly checking your internet history you probably have other issues to deal with.
Adobe Photoshop for audio? (Score:2)
Re: (Score:2)
Yeah, pretty much. Though I'd argue that, at least for singers, the photoshop of audio is Melodyne (or autotune, though most pros I know use the former).
Will be available... (Score:2)
Re: (Score:2)
I imagine Bad Lip Reading will have fun with it.
Adobe Trump! (Score:3)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
does that lead to a post-shaming society?
Sir, I will have you know that you are a shameless optimist. We don't tolerate your kind around these parts. Please show yourself out.
Re: (Score:2)
yes, you will have experts at lip reading and body language arguing both for and against the authenticity of a recording. So just like attorneys, these paid 'experts' are going to be the only winners in this shit. In the end you will still be as confused as ever, but a lot poorer as a result.
What could *possibly* go wrong? (Score:2)
MIT did this with video in 2002 (Score:2)
I am pretty sure it was posted on Slashdot (can't find it), but the Boston Globe reported in 2002 that scientists at MIT could convincingly alter video to make it appear that someone said something they didn't, with only 2 minutes of footage:
http://www.rense.com/general25... [rense.com]
(Link to article on Boston Globe is dead.) They couldn't alter the audio convincingly, or at least didn't try. However, I also recall seeing on Slashdot (10+ years ago; also can't find it) that someone (Bell? MIT?) could take about 2,000
Re: (Score:2)
Post-truth politics won't matter when someone releases convincingly altered video and audio of a public figure doing something that they never did.
There will be a need for cryptographically verifiable video, where you can prove what camera video came from, and what happened (or didn't happen) to it during the editing process. It's not impossible. It's just hard and there will be a gap between needing it (now) and when it happens.
Re: (Score:1)
Cryptographically verifiable video's been available for well over a decade from some professional DVRs. It's just not in common use. Typical IP cameras and the like don't sign their video, but a good recording device usually will.
You can still spoof the video or audio feed into the recorder, but the path from the DVR to the courts can be demonstrated to be unaltered.
Can do this already (Score:3, Informative)
Re: (Score:3)
You apparently didn't even bother to read the summary. You stitched together things that were said. This creates things that weren't said.
Voice actors and musicians (Score:2)
For example why pay (a bunch of money to) Mark Hamill to provide the voice for a new animated version of the Joker when you can use this tool
Re: (Score:2)
Even if that were true, the voice actor certainly has control over their name.
The studio would not be able to claim the actor plays a part in any of the promotional material for the movie.
Re: (Score:3)
Sequels.
Especially low-budget / direct-to-video. The characters are established, so you only need to sell them on its existence. No need to use the actor's name. The actor signed away their "likeness" for promotion of the original movie. One could always argue that the sequel is "promotion" for sales of the original movie on DVD/Blu-Ray.
Re: (Score:2)
Contracts are about to get a bit more specific - you can always use a different actor in a sequel, but big names (e.g. Mark Hamill) aren't going to sign contracts allowing a production studio to continue to use their voice over someone else's face.
Re: (Score:2)
Also, what's to stop the actor from publically stating that he or she didn't record the audio for this particular project.
There's always contracts, I suppose, but any decent agent will include clauses prohibiting the production company from creating an entirely "synthetic" performance - small alterations would be OK, it'll save a lot of money having to do pickups.
Re: (Score:2)
will argue that it's different enough
I'm sure the original contracts included provisions for using the artist's "likeness." Most people assumed photos, but who's to say they can't just interpret the contract to have already included these rights?
Re: (Score:2)
On a slightly different note, how many voice actors have recorded twenty minutes of dialog in the past? How many of their contracts give them control over how the movie studios use those recordings or mandate that the studios give them royalties for using "remixed" versions of their voices?
"In a world..."
(And, of course, the obligatory link. [youtube.com] I can't hear that phrase without thinking of this. Although Pablo Francisco does a pretty good job. [youtube.com])
Won't affect the powerful... (Score:2)
Currently, politicians and the powerful elites are rarely heard from in person, anyway. We get to see the results of their secret meetings and closed-door sessions through carefully crafted press releases and the societal changes we see every day. The controllers, I'm sure, positively love this technology, because it will give them an additional outlet to turn the screws on the little guys.
Think about it, ubiquitous mobile video was probably the last tool that was still on the side of the people. Now, when
Writing Comprehension Fail (Score:2)
Like Photoshop, Project VoCo is designed to be a state-of-the-art audio editing application.
It's in TFA, so I guess /. isn't to blame. Nice job, Verge editor.
Called it years ago.... (Score:2)
Our entire historical "record" is suspect, not even audio can be believed anymore....
Re: (Score:2)
Like it ever was...
Clearly, people don't care about words as much as they do about actions.
Re: (Score:2)
"My name is Werner Brandis. My voice is my passport. Verify me."
Innocent my ass. (Score:4, Insightful)
"...So similar to how Photoshop ushered in a new era of editing and image creation, this tool could transform how audio engineers work with sound, polish clips, and clean up recordings and podcasts."
Enough with this "innocent" sales bullshit. I am far more concerned about how this tool can and will be used against me, in a court of law, forcing me to hire enough expertise to defend against shit I never said.
The average citizen can't even remotely afford a good legal defense these days. This is going to make that even more difficult by having to hire appropriate audio experts to analyze audio recordings to determine if they've been manipulated or not.
And no, this isn't like Photoshop, where often the only tool that is necessary to validate manipulation is the human eye and common sense (yeah, I'm talking to you magazine editors, who still feel the need to digitally alter some of the most naturally beautiful humans on the planet.)
Re: (Score:2)
Well this will just lead to all audio evidence being thrown out and only eyewitness accounts being considered evidence.
Ah, yes, the eyewitness. (Score:2)
Because it's so terribly difficult to tamper with perception and memory.
Re: (Score:2)
Well this will just lead to all audio evidence being thrown out and only eyewitness accounts being considered evidence.
Sorry, but you are fucking delusional.
In a courtroom, all audio will be accepted as authentic, and the accused will be responsible for financing the experts to prove otherwise.
This will be done in this way in order to support the business community that offers expert testimony and expert analysis to refute otherwise, much in the same way that the legal community only recognizes those with a medical degree when providing legal testimony against related cases.
In short, a courtroom isn't going to recognize you
Re: (Score:2)
A video recording is still considered genuine.
Yeah, right up until the point where legal precedent says it's not.
Let's not be ignorant in our thinking that video can't be manipulated, and it's only a matter of time until it's proven to be invalid in a courtroom.
Re: (Score:2)
This will lead to a new class of audio/video recording devices that will claim to be tamper-proof - probably by calculating a hash at the time of recording, so video/audio from devices that don't do this will be treated as second-class or unreliable from the court's viewpoint.
Yes, there's all sorts of subversion possible, but at least encoding a verifiable date & time code into the hash makes recordings harder to forge.
Re: (Score:3)
Blame YOURSELF and the dumb public for only buying false realities.
You ASS-U-ME that I share the same values as the "dumb public" when I do not. Don't be ignorant, as I do not support those organizations who feel a need to perpetuate false realities.
And my point regarding natural beauty was directed at the millions companies pay for humans who are defined under the elite label of model. If you're going to pay a ton of money for models, why in the hell would you feel a need to Photoshop them? That's akin to buying a Ferrari and then spending all your time behind a video
voice authentication systems to be bypassed with (Score:3)
voice authentication systems to be bypassed with ease now.
Re: (Score:2)
Oblig: My voice is my passport.
Any single factor authentication scheme is just begging to be bypassed...
Re: (Score:2)
at bell my voice is my password
Re: (Score:2)
Re: (Score:2)
voice authentication systems to be bypassed with ease now.
As a great man once said, "There's nothing more useless than a lock with a voice print."
DNA Editing (Score:2)
How long before we get Adobe DNA editor where DNA sequences from blood found at the crime scene can be edited to match the DNA of the suspect?
Subliminaly? (Score:3)
Can it add subliminal suggestive messages too? Of course, I'm being facetious but when, not if, this technology is misused, wouldn't it be a good idea to embed subliminal audio watermarking so that juries and the media will know that the audio is faked?
Finally - one small step for A man !!! (Score:3)
The audio from Neil Armstrong can finally be corrected.
The wisdom of sicilian omerta proven once again! (Score:1)
> Project VoCo can also apparently generate new words using a speaker's recorded voice
In the Godfather saga, mafia top dog Don Vito di Corleone refused to ever speak on the phone, for fear of the FBI recording his words and editing the tapes into fake conversations. His wisdom retro-actively justifies the high position he achieved in the Cosa Nostra.
In other news:
> the software can understand the makeup of a person's voice and replicate it, so long as there's about 20 minutes of recorded speech
The sam
Governments don't need to wait for Adobe (Score:1)
What if this technology is already available and being used in combination with man-in-the-middle attacks for the modification of communications in real time? A state-sponsored malicious actor can even start wars between unsuspected countries. Governments don't need to wait for Adobe to write software for their cyberwar arsenals.
The only way to (try and) guard against this that I can think of is cryptographically signing and verifying all important communications, whether between country leaders or between
Clearly this is how Skynet begins! (Score:1)
So you say you have this technology that creates words that people never actually said.
But it sounds just like their voice.
Clearly this is how Skynet begins!
Sarah: "No, I can't tell you where I am mom. I was told not to say."
Mom: "Oh, but honey, I need to know where I can reach you. You tell me to hide out here in the cabin like some kind of fugitive and you won't tell me what's going on? I am worried sick dear."
Sarah: "Ok. Here's the number...."
Mom: "Ok. Go ahead.... Uh-huh. I've got it."
Sarah: "I love yo
Make all audio recordings inadmissable (Score:2)
Of course, should Trump win...there will be no fair trial and just a police state of Judge Dredd's running around killing people for breathing wrong.
Somebody had to take the babysitter home... (Score:2)
...and I notice she was sitting on her SWEET CAN I GRAB HER SWEET CAN
Movies with Deceased Actor Avatars (Score:1)
No way (Score:2)
Lol, no way will this ever be abused or used for nefarious purposes. *cough*
It's getting to the point where no amount of "evidence" will be able to "prove" or "disprove" anything.
I have incontrovertible photos, video, and audio that show you killed Bob Smith, and you have incontrovertible photos, video, and audio that show you didn't. As for 3rd party witnesses, maybe their audio/video data was hacked and modified, and maybe it wasn't. Who can say?
video of the demo here (Score:2)
Creative Cloud crap (Score:2)
And similar to how Creative Cloud has made vassals out of people who work on photographs, videos, websites, and presentations, Project VoCo will do the same to people who work with audio.
Data (Score:2)
https://www.youtube.com/watch?... [youtube.com]
One step for man... (Score:2)
A giant leap backwards for forensics
Highlighting this Capability is a Good Thing (Score:2)
Releasing software allowing the editing of spoken words in audio recordings is probably the best way to ensure people know this capability exists. Everyone knows about Photoshop and the kinds of things it makes possible so that the old phrase "the camera never lies" is known to be obsolete. If audio speech editing capabilities were somehow kept from the public the potential for abuse would be much greater.
Re: (Score:3)
Moving to a truth-free society. (Score:5, Interesting)
Yeah. Now all those photosnarks that have a picture of a politician saying something they didn't say will have audio clips attached.
We really are moving to a truth-free society.
Re:Moving to a truth-free society. (Score:4, Interesting)
That was my first thought as well. How long until we have clips of "I'm Republican candidate Jack Johnson and I love eating puppies! I kill and eat them all day long. Vote for me." followed by "I'm Democratic candidate John Jackson. People have wondered how I stay so healthy. Well, I take a daily bath in the blood of newborn babies. Vote for me."
Right now, "it feels true" spreads fast across the Internet regardless of any facts backing it. How fast would it spread if there's "audio proof" that some candidate said some horrible things? On the flip side, what if a politician actually DID say something horrible? Could they deny it, claim it was "Audio Photoshopped", and get away with it?
Re: (Score:2)
Google. Bad Lip Reading.
Especially Ted Cruz and Bushes Of Love.
Re: (Score:2)
Re: (Score:2)
Give it up. That word is not going to catch on no matter how hard you try to force it.
Re: (Score:2)
--Re:Moving to a truth-free society. (Score:2)
Never give up, never surrender. [youtube.com]
Today slashdot, tomorrow the world!
Re:Moving to a truth-free society. (Score:5, Insightful)
“Convictions are more dangerous foes of truth than lies.”
Friedrich Nietzsche
People will believe what they are told because they already want to believe it. It wont even matter that the real audio source is available for independent review.
Re:Well, that's horrifying (Score:4, Interesting)
Sadly, this means likely even more revisionist history coming our way.
This is a tool they NEVER thought of in 1984....no need for double speak and re-writing the books, just change what people say....
Re: (Score:2)
I am sure that there will be ways to determine whether or not it is an altered audio clip just like it is possible to identify photoshop pictures. Whether it is imperfections, algorithmically induced patterns, meta data, etc.
As this election campaign has proved (yet again), people will believe what they want to believe. So doctored audio clips are not going to add or subtract anything to that equation.
Re: (Score:3, Interesting)
Re: (Score:1)
This sounds shopped.
I can tell from some of the vowels and from hearing quite a few shops in my time.
Re: (Score:2)
I shopped at a shop for photoshop so that I could shop some photos to display at the shop show.
Re: (Score:2)
Yep..this will be the politicians BEST friend....at least when they want to claim they didn't say it....
Sadly, this means likely even more revisionist history coming our way.
This is a tool they NEVER thought of in 1984....no need for double speak and re-writing the books, just change what people say....
Have a real-time portable version that people wear around their necks and automatically edits what they say.
No one will ever be offended again!
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
It's fine for Trump though. You'll always be able to spot the fake Trump stuff because in those, he'll use a complete sentence and finish the sentence without blurting out something about ISIS or getting distracted by how angry he is at Rosie O'Donnell in the middle of it.
Re: (Score:2)
NBC (Score:2, Troll)
I think NBC will be making use of this to accompany their film edits.
Re: What a service to humanity. (Score:3, Insightful)
Yes, what a service indeed. Now we finally will have the ability to set people up like in the movie Running Man.
Re: (Score:1)
"file this one under "things no one with a CONSCIENCE is asking for"
There, fixed that for you. There are definitely people looking/hoping for this kind of software, they simply are the useless husks of human garbage who think that lies, deceit & misdirection are perfectly viable means to achieving ones goals. There may be a few legitimate uses, but they are few, far between & easily solved by other actions. If this software is going to enter the commercial sphere there needs to be safeguards, in
Re: (Score:2)
who think that lies, deceit & misdirection are perfectly viable means to achieving ones goals.
You just described the human species.
We can do better, of course, but we don't.
Re: (Score:2)
Re: (Score:2)
He's not.
It only happens when people care about the goal more than the means.
Re:nope (Score:4, Insightful)
Hollywood's asking for it. They'll start making sure their contracts regarding perpetual use of likeness of actors can be used to leave actors out of payroll entirely on the next animated film. Especially low-budget direct to video sequels.
Re: (Score:2)
The Congress
http://www.imdb.com/title/tt1821641/?ref_=nv_sr_1
Robin Wright's character signs away rights to her likeness and voice and later on finds (after everyone has abandoned real life for a virtual existence) that her voice and likeness has attained cult following status and is used by many people as an avatar.
The book was a bit different (more of a psychedelic fever dream) and more political, but the mo
Re: (Score:2)
I doubt that any actor, on their agent's advice, would sign such a contract. It would mean income from one and only one project. IOW, the agent would miss out on future income as well as the actor. Besides, studios depend on the name to promote subsequent projects, so which actors of talent (or at least bankability) are going to sign away future income?
There might be a transition period where the A and B-listers who have sufficient clout will refuse to sign such contracts, so the studios will entice lesser-
Re: (Score:2)
I doubt that any actor, on their agent's advice, would sign such a contract.
Back when they signed it, they only imagined "likeness" to be pictures of their face. Future contracts might be examined more closely, but I was more referring to the ones already signed.
Re: (Score:2)
Re: (Score:2)
both for and against.
“Convictions are more dangerous foes of truth than lies.”
Friedrich Nietzsche
you will have those already wanting to believe screaming vindication, and those who don't want to believe arguing vast russian conspiracies. Ma
Re: (Score:2)
Re: (Score:1)
Your statement seems a little lopsided since most of the lies/conspiracy theories (at least in the presidential campaign) have been coming out of the Republican sphere (Hillary has a terminal illness, the press is plotting against us, Obama is a secret Muslim, etc). If such software becomes commonplace BOTH sides will abuse it, and any abusers on either side deserve SEVERE penalties when they do so.
Re: (Score:2)
Words != understanding, although it should improve things a little. I find it difficult to cope with some accents (e.g. Filipino, Indian/Pakistani), so I prefer to use live chat rather than telephone.