TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

They stole my voice with AI

524 点作者 sounds8 个月前

40 条评论

ryzvonusef8 个月前
Everyone has their own fears about AI, but my fears are especially chilling; what if AI was used to imitate a person saying something blasphemeous?<p>My country is already has blasphemy lynching mobs based on the slightest perceived insult, real or imagined. They will mob you, lynch you, burn your corpse, then distribute sweets while you family hide and issue video messages denouncing you and forgiving the mob.<p>And this was before AI was easy to access. You can say a lot of things about &#x27;oh backward countries&#x27; but this will not stay there, this will spread. You can&#x27;t just give a toddler a knife and then blame them for stabbing someone.<p>Has nothing to do with fame, with security, with copyright. This will get people killed. And we have no tools to control this.<p><a href="https:&#x2F;&#x2F;x.com&#x2F;search?q=blasphemy" rel="nofollow">https:&#x2F;&#x2F;x.com&#x2F;search?q=blasphemy</a><p>I fear the future.
评论 #41616361 未加载
评论 #41615766 未加载
评论 #41615622 未加载
评论 #41615588 未加载
评论 #41615602 未加载
评论 #41616093 未加载
评论 #41615834 未加载
评论 #41617853 未加载
评论 #41615810 未加载
评论 #41618723 未加载
评论 #41617325 未加载
评论 #41616081 未加载
评论 #41620164 未加载
评论 #41616499 未加载
评论 #41616188 未加载
评论 #41618657 未加载
评论 #41617842 未加载
评论 #41616446 未加载
评论 #41617592 未加载
评论 #41616061 未加载
评论 #41616385 未加载
评论 #41615736 未加载
评论 #41615662 未加载
评论 #41616437 未加载
ummonk8 个月前
I don&#x27;t see why using AI would get around Midler vs. Ford. If anything, there is even less of an argument to be made in your defense when you use AI to replicate a voice, instead of using another voice actor to replicate the voice.
评论 #41621546 未加载
评论 #41615041 未加载
评论 #41614880 未加载
wwweston8 个月前
I appreciate his pointer to precedent, but the truth is that while precedent is a start, we&#x27;re going to need to do work with principles beyond precedent. When tech introduces unprecedented capabilities, we will either figure out how to draw boundaries within which it (among other features of society) works for people, not against them, or we&#x27;ll let it lead us closer to a world in which the strong do what they will and the weak (or those just trying to keep a camry running) suffer what they must.
评论 #41614560 未加载
评论 #41614628 未加载
评论 #41616166 未加载
adityaathalye8 个月前
If LLMs are the ultimate remix machine, then is anyone with a RAG a digital DJ?<p>One can&#x27;t help but wonder what <i>theft</i> even means any more, when it comes to digital information. With the (lack of) legal precedent, it feels like the wild wild west of intellectual property and copyright law.<p>Like, if even a superstar like Scarlett Johansson can only write a pained letter about OpenAI&#x27;s hustle to mimic her &quot;Her&quot; persona, what can the comparatively garden-variety niche nerd do?<p>Like Geerling, feel equally sad &#x2F; angry &#x2F; frustrated, but merely say &quot;Please for the love of all that is good, be nice and follow an honour code.&quot;.
评论 #41615672 未加载
评论 #41618854 未加载
评论 #41615659 未加载
评论 #41615340 未加载
评论 #41615195 未加载
评论 #41615425 未加载
cranium8 个月前
(Obviously not a lawyer) Overlooking the AI part, isn&#x27;t it a gross misrepresentation of Jeff&#x27;s opinion or an unauthorized use of his image? By using his voice, it creates an implicit (fabricated) endorsement for their product and that feels very wrong. I&#x27;m sure laws exists to deal with these cases, since way before AI existed.
评论 #41615586 未加载
donatj8 个月前
Maybe I am crazy but I don&#x27;t really think it sounds that much like him. It&#x27;s a little similar but different. It&#x27;s slightly higher pitch, more nasal, and the intonation is a little different.
评论 #41614709 未加载
评论 #41614794 未加载
评论 #41615033 未加载
评论 #41614762 未加载
评论 #41614918 未加载
评论 #41618850 未加载
评论 #41615908 未加载
评论 #41617326 未加载
评论 #41616253 未加载
ei238 个月前
I’m a small tech YouTuber and I’ve also had contact with Elecrow. As far as I know, employees (not just at Elecrow) receive rewards, promotions, or commissions when they secure long term partnerships and video collaborations with YouTubers. Perhaps someone thought it would be clever clone Jeffs voice since his channel is quite popular in this field. This certainly isn&#x27;t great PR for Elecrow right now. I would also wonder if they will confess to that this was intentional...
XorNot8 个月前
The idea that stolen voice tones are going to matter at all is one of the shortest sighted bits of AI investment - powered by Hollywood &quot;never make anything new&quot; thinking.<p>In about 5 years AI voices will be bespoke and more pleasant to listen to then any real human: they&#x27;re not limited by vocal cord stress, can be altered at will, and can easily be calibrated by surveying user engagement.<p>Subtly tweaking voice output and monitoring engagement is going to be the way forward.
评论 #41614728 未加载
评论 #41614791 未加载
评论 #41614786 未加载
评论 #41614819 未加载
评论 #41614755 未加载
评论 #41629869 未加载
评论 #41616682 未加载
surfingdino8 个月前
It&#x27;s all fun and games until someone produces a recording of somebody else saying something incriminating and it will be used in court. This is the part of AI I hate.
评论 #41615233 未加载
评论 #41615979 未加载
评论 #41615460 未加载
thih98 个月前
We have 100s of tools that are about voice cloning - of course we’ll get content with cloned voices.<p>Same as it happens with unauthorized use of someone’s images. And platforms and their moderation teams have processes in place to report and remove that. Looks like we need something similar for voice.
singleshot_8 个月前
When you say that lawyers always cost a lot of money: I’d absolutely do this pro bono but more than likely you’re not in a state where I’m licensed.<p>You can absolutely positively find a free lawyer if your issue is interesting enough.<p>This is <i>the most interesting issue of our day</i>.
vonnik8 个月前
California banned several forms of deepfake and digital replicas without consent just days ago.<p><a href="https:&#x2F;&#x2F;techcrunch.com&#x2F;2024&#x2F;09&#x2F;19&#x2F;here-is-whats-illegal-under-californias-8-and-counting-new-ai-laws&#x2F;" rel="nofollow">https:&#x2F;&#x2F;techcrunch.com&#x2F;2024&#x2F;09&#x2F;19&#x2F;here-is-whats-illegal-unde...</a><p>Not sure if those laws apply to Jeff tho, as they concern porn, politics and employer contracts.
benterix8 个月前
Elecrow seems a Chinese company, right? In that case, I don&#x27;t expect any reply.
GaggiX8 个月前
&gt;I haven&#x27;t decided what to do.<p>Make a video, say what you think, get views, and probably put more pressure on Elecrow to respond.
评论 #41614566 未加载
评论 #41614851 未加载
mediumsmart8 个月前
It’s the Wild West and will be for some time but I agree, they should have the decency to use only voices of the dear departed. The library should be open source and hosted on GitHub. <i>the talking dead</i> seems like a good name for it. Obviously we will have to put it to a vote among the living.
评论 #41615166 未加载
评论 #41614929 未加载
cityzen8 个月前
Ex-Google CEO says successful AI startups can steal IP and hire lawyers to ‘clean up the mess’ &#x2F; “But if nobody uses your product, it doesn’t matter that you stole all the content,” Eric Schmidt said during a recent talk at Stanford that has been taken offline.<p>Since that guy was CEO of Google it’s all good right???<p><a href="https:&#x2F;&#x2F;www.theverge.com&#x2F;2024&#x2F;8&#x2F;14&#x2F;24220658&#x2F;google-eric-schmidt-stanford-talk-ai-startups-openai" rel="nofollow">https:&#x2F;&#x2F;www.theverge.com&#x2F;2024&#x2F;8&#x2F;14&#x2F;24220658&#x2F;google-eric-schm...</a>
评论 #41629917 未加载
at_a_remove8 个月前
More and more I am starting to wish I had gone ahead with the novel I had sketched out in the 1990s. The backdrop was a kind of post-imitative-AI collapse of trust in society, because it had become effortless to fake up, say, your least favorite political candidate talking about the merits of eating babies, so the various echo chambers bore a kind of ghastly fruit, each stance finding its own &quot;evidence&quot; for its beliefs, right down to the flat earth types. Paranoia runs rampant, and so on.<p>It looks like we&#x27;re heading in that direction.
评论 #41615267 未加载
paganel8 个月前
For what it&#x27;s worth this seems to be a thing, for example here&#x27;s a video promoting some batteries-thingie with the help of AI-voice based on a (famous, in some circles) podcast girl.<p>[1] <a href="https:&#x2F;&#x2F;old.reddit.com&#x2F;r&#x2F;redscarepod&#x2F;comments&#x2F;1fmiiwt&#x2F;which_one_of_you_did_this&#x2F;" rel="nofollow">https:&#x2F;&#x2F;old.reddit.com&#x2F;r&#x2F;redscarepod&#x2F;comments&#x2F;1fmiiwt&#x2F;which_...</a>
评论 #41616273 未加载
rldjbpin8 个月前
from the discourse here, the main pain point really is the accessibility to do something like this thanks to the new models.<p>IANAL and not sure about regional precedence on these topics, but there are plenty of ads where lookalikes or voice actors are used to use someone&#x27;s likeness. they are mostly in satire, but there is yet to be a case where there was a litigation over this or prior approval needed.<p>we have ai-based voice abuse in the political sphere, and where there was only one legislation for banning the use in voice calls for one country (<a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=39304736">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=39304736</a>), another country actively used the same underlying tech to aid their own rallies (<a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40532157">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=40532157</a>).<p>the tools are here to stay, but what is fair use needs to be defined more than ever.
评论 #41629764 未加载
sandreas8 个月前
This is exactly the reason why I&#x27;m not open sourcing a tool I developed where you can take an audio book together with an epub to build an ljspeech dataset and train a voice model.<p>Although it was not too hard to create I believe making it easier is something i don&#x27;t like to achieve...<p>I hate to say this but ruining a narrators existence with AI seems to get easier every day.
评论 #41615809 未加载
segmondy8 个月前
What if they had someone that sounded just like you and had the person do a voice over? What if they had someone that sounded like you, had the person give them sample and used AI to generate voice? What if the hired someone that could imitate your voice, then had the person give them sample and used AI to generate voice?
LegitShady8 个月前
I don&#x27;t know where you live, but where I live I believe this sort of thing meets all the required elements for fraud.
Corrado8 个月前
So, do we &quot;solve&quot; this by impersonating a voice from a very litigious company? Let&#x27;s say we clone Micky Mouse&#x27;s voice to say some blasphemous things. Does that bring the full weight of Disney down on this? Will that force a change? Would it be a good change?
评论 #41632081 未加载
eth0up8 个月前
My aunt is (supposedly) in her 90s, having left the US for Ecuador 10 or so years ago. We&#x27;ve remained in regular contact via phone over the years. Recently we went more than a few months without speaking.<p>She has&#x2F;had two numbers; magic jack and google. When I tried to call her, the magic jack was no longer in service and google said something about &quot;unavailable&quot;.<p>I reached out to my cousin (my aunt&#x27;s daughter) to inquire. I was told her number (and perhaps other things) had been &quot;hacked&quot;, whatever that means. She had recently broken her hip and was in a hospital recovering.<p>With this on my mind, I received a call (from the google number), strangely, while processing files with GPT. My skepticism was primed and ready, possibly making me paranoid. However, I did my due diligence and asked dozens of questions, mostly boring things that she typically wouldn&#x27;t have patience for. Sometimes she&#x27;d reply with a reasonable answer and sometimes not, which made it difficult to evaluate. Toward the end, I asked where she was. She said, with an awkward tempo &quot;I&#x27;m at home, in Cuenca&quot;, which I found odd because she&#x27;d normally just say she was at home, period. I then pressed her to tell me where she was before she returned home. She said she didn&#x27;t understand. I rephrased the question, stating that it was a simple inquiry, eg &quot;where were you before going home?&quot; She said &quot;this is getting too strange and confusing &quot; and killed the call.<p>I notified my cousin, telling her I thought something was suspicious, still cognizant of all the characteristics one would expect from a 90 year old recovering from a serious injury. My cousin might, technology wise, be in AOL territory.<p>About 5 days later, I received a call from my aunt, on the google line. This time,I was more passive and cautious, but again, asked dozens of boring questions to probe the situation. I was surprised by both her ability to answer certain questions and also her inability to answer some questions. I tried to ask questions on topics we&#x27;d never discussed, in case the line had been tapped for a long time and referencing was established by an imposter. I had begun to suspect I had been paranoid. But several aspects were burning me: 1) typing noises in the background 2) Shatneresque pauses for nearly every reply 3) refusal to answer some specific questions.<p>At the end of our apparent conversation, I asked her to do a very serious favor for me: send me a selfie, with one hand making the thumbs up gesture. She replied &quot;I&#x27;ll send you a photo of my passport &quot;. I replied &quot;that&#x27;s stupid, ridiculous and serves no purpose. Don&#x27;t do that. Understand? Do NOT send me a passport photo. I&#x27;m asking you something very important. Do exactly what I asked. Will you do this?&quot; Her reply: &quot;yes. What is your email address?&quot; This was odd. I told her she already knew and it&#x27;s the same one she&#x27;d had for years. She asked that I tell her anyway. Ok, 90 years old, traumatic injury, possible prescription drugs... &quot;It&#x27;s my full name @ xyzmail com&quot;. We killed the call.<p>I immediately called my cousin and told her of my suspicions, including some my aunt&#x27;s babbling about all her finances and accounts being inaccessible. She said that was strange because she just deposited 8k into her account. Meanwhile, a notification appears in the phone, an email from my aunt. It&#x27;s a photo of her passport.<p>Having no authority in this situation, but plenty well annoyed, I immediately jumped on a real computer and ran the photo through exiftool. The photograph was taken in 2023 and it was August of 2024. I then grabbed the geo coordinates (cryptically presented in exiftool) and with some effort, geolocated the image to right on top of her former residence, in Cuenca.<p>I still don&#x27;t know WTF is going on and my cousin thinks I&#x27;m a dingbat. But what I know for sure, is this is an age where such things are plausible enough and will soon be inevitable. The way I think may be deranged, but I truly don&#x27;t even know if my aunt still exists. But I can have a pretty compelling conversation, either with her, or something strongly resembling her, minus the Shatneresque pauses, typing noises and selective amnesia.
评论 #41617854 未加载
评论 #41617849 未加载
评论 #41618212 未加载
评论 #41616754 未加载
评论 #41618514 未加载
t0bia_s8 个月前
We should adopt and use to it. There will be more and more fake AI created content every day so we should be confrontend with it to learn how to react to it.<p>Regulating prolong adoption and take resources.
djoldman8 个月前
&gt; I remember when OpenAI practically cloned Scarlett Johanssen&#x27;s voice ...<p>I don&#x27;t have a dog in this fight but just to be clear, OpenAI has stated that they paid a voice actor to create the voice (&quot;Sky&quot;) that sounds like Scarlett Johanssen. There was no &quot;cloning&quot; or &quot;stealing&quot; (that they say).<p><a href="https:&#x2F;&#x2F;openai.com&#x2F;index&#x2F;how-the-voices-for-chatgpt-were-chosen&#x2F;" rel="nofollow">https:&#x2F;&#x2F;openai.com&#x2F;index&#x2F;how-the-voices-for-chatgpt-were-cho...</a>
评论 #41616733 未加载
评论 #41619060 未加载
4ndrewl8 个月前
Let&#x27;s just assume you can&#x27;t trust any ugc on the internet from now. It&#x27;s all done, but fun whilst it lasted.
veunes8 个月前
Investment in tools that can verify the authenticity of audio and video content is crucial
rishikeshs8 个月前
Slightly off topic, but what’s that logo at the bottom of his website?<p>Is that some sort of a coat of arms?
评论 #41615929 未加载
oehpr8 个月前
I want to ask and answer two of my own questions here:<p>1. Why clone Jeff&#x27;s voice?<p>When I was messing with stable diffusion using Automatic1111&#x27;s interface, I noticed it came with a big list of artists to add to the prompt to stylize the image in some way. There was a big row in the media about ai art reproducing artists work and many artists came forward feeling it was a personal attack. But... I mean the truth is more general than that. When I pressed a button to insert a random name into a prompt, my goal was not &quot;yes give me this person&#x27;s art for free&quot;, it was &quot;style this somehow&quot;.<p>I wasn&#x27;t personally interested in any particular artist, I honestly would have preferred a bunch of sliders.<p>Jeff here is clearly a good speaker. That&#x27;s a practiced talent and voice actors exist because it&#x27;s hard. Elecrow wanted a voice over and they wanted it to be as good as they could make it. Jeff is very good. So did they want Jeff?<p>I think what they really wanted was a good and cogent narration with the tenor of a person. Not a machine making noises that sound like english. If they had an easy way to get that, we wouldn&#x27;t be talking about it here.<p>2. What function does copyright serve?<p>Well. I think a reasonable argument would be that if people were able to reproduce your work for free, you would quickly find yourself without a monetary incentive to make more of it.<p>So. What happens if you combine answer 1 with answer 2?<p>I think it leads to: &quot;We should consider making it illegal to automatically reproduce the work of an artisan.&quot;, you know, the luddic argument. An argument that has been perceived to be, more or less, settled.<p>So it seems to me: That for individuals, harms matter, and for society, it doesn&#x27;t.
评论 #41634814 未加载
评论 #41620928 未加载
评论 #41624572 未加载
评论 #41629850 未加载
moffkalast8 个月前
Yeah it&#x27;s pretty much an inevitability that anyone who&#x27;s ever posted more than 10 seconds of their voice will have it stolen eventually if anyone has a motive to do it. That&#x27;s already all it takes to few shot a decent TTS _today_.<p>Most likely all existing youtubers will have complete voice and video digital clones made out of them. Then you can also tune an LLM on their scripts and it&#x27;ll respond in the same character as well.<p>In theory you could also bring back ones who are dead, which would be very interesting in a historical sense. Like if we had hundreds of hours of Napoleon talking in front of a camera, it would be trivial to recreate a digital version of him for anthropologic study, maybe even having various figures debate things with each other. That&#x27;s what historians a century later after we all die will be able to do with impunity.
swag3148 个月前
<a href="https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=IeTybKL1pM4" rel="nofollow">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=IeTybKL1pM4</a>
m3kw98 个月前
how do people know if its a very similar sounding voice, or identical?
评论 #41629781 未加载
znpy8 个月前
We’ve been in a post-truth world for T least ten years anyway.<p>We already had fake news and organizations willingly spread fake news.<p>We had clearly fake pictures and people believing that.<p>Flat-earthers, no-vax and whatever.<p>This is just another brick in the wall.
gyudin8 个月前
It&#x27;s not even close to his voice lmao, just has similar cadence.
golol8 个月前
&gt;I remember when OpenAI practically cloned Scarlett Johanssen&#x27;s voice...<p>There is absolutely zero evidence for this. I find it infuriating that this keeps being stated as a fact. So they go and hire a voice actor and clearly use her voice to train, but then they also scrape Scarlett Johansson from youtube and splice it into the training data to make the voice a bit more like hers? Really does that sound realistic?
评论 #41615244 未加载
scotty798 个月前
&gt; I remember when OpenAI practically cloned Scarlett Johanssen&#x27;s voice<p>Except that never happened and the voice belonged to a completely different voice actress and Scarlett Johanssen had exactly zero right to prevent this person from making money as a voice actress lending it to AI.<p>These complaints remind me a little bit of the story that a man complained that his photo was used to illustrate the article about how all hipsters look the same and it eventually turned out it wasn&#x27;t his photo.
评论 #41615531 未加载
评论 #41615663 未加载
cr3cr38 个月前
Initially I&#x27;d say well if you&#x27;re a public figure and upload your own voice online, of course this will happen. So its something to expect, however, this shouldn&#x27;t be a problem for Jeff to solve... instead it should be YouTube&#x27;s problem as they profit from the video monetization. Eventually they&#x27;ll have to have some kind of detection for all uploaded content.
评论 #41615022 未加载
carmackfan8 个月前
This whole argument rests on the absurd assumption that you can &quot;own&quot; a voice as if it&#x27;s property. Does this mean people can own the patterns of vibration in air? It&#x27;s completely nonsensical.
评论 #41614718 未加载
评论 #41614680 未加载
评论 #41614677 未加载
评论 #41615433 未加载
评论 #41618890 未加载
评论 #41614664 未加载
评论 #41614684 未加载
meiraleal8 个月前
It is like becoming meme famous: is up to you how to monetize it, nobody owes you nothing.
评论 #41614563 未加载
评论 #41614602 未加载
评论 #41614579 未加载