TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

AI-generated fake content could unleash a virtual arms race

106 pointsby kristintynskiover 5 years ago

22 comments

echelonover 5 years ago
These deep fake articles are becoming a meme. They mostly seem alarmist, and yet they&#x27;re not authored by people actually in the industry.<p>Deep fakes automate what deep pockets and state actors could already do with Photoshop and other professional tools. The world isn&#x27;t going to become a scary place because the barrier to entry got lower and the technology has been democratized. People are smart. Fakes will be detectable through entropy measures, corroboration, common sense, etc.<p>FWIW, I&#x27;ve been working on real time voice to voice style transfer.<p><a href="https:&#x2F;&#x2F;drive.google.com&#x2F;open?id=1zRvJEGJjTpKvvzel-J0agh3fKBn9aqGy" rel="nofollow">https:&#x2F;&#x2F;drive.google.com&#x2F;open?id=1zRvJEGJjTpKvvzel-J0agh3fKB...</a><p>There are already a few other (non-real time) players in this field.<p>I&#x27;m hoping to spin this up as a small social app or filter and sell it so I can fund my capital-intensive film making startup.<p>I think this tech <i>should</i> be widely available. Not only will it make people think and question more, but it&#x27;ll be fun too.<p>It&#x27;s also amusing (and terrifying) to see all the anti-1st Amendment legislation aimed at combating deep fakes. The truth is that there is nothing to fear except our freedoms being taken away.
评论 #21512559 未加载
评论 #21511752 未加载
评论 #21511724 未加载
评论 #21511671 未加载
评论 #21511947 未加载
评论 #21512331 未加载
评论 #21511813 未加载
评论 #21513407 未加载
评论 #21514294 未加载
评论 #21512579 未加载
评论 #21513247 未加载
blunteover 5 years ago
This pretty much describes the end of the internet as we know it. Even before AI generated &quot;content&quot;, the internet has become lower signal-to-noise as time has moved forward.<p>It is already the case that for many everyday searches I do, I am forced to be very creative in my search phrase in hopes of filtering out the garbage sites that manage to dominate the first results page.<p>Watching less tech-saavy people use computers (such as elder family) is enlightening and frightening. They either cannot tell real content from fake content, or worse they are satisfied with what they get from obviously suspicious sites.<p>Maybe my concerns of polluted websites are less relevant considering the general population is getting more of their &quot;information&quot; from within Facebook rather than even going to search engines (of which they use the default for their browser!).
评论 #21511795 未加载
评论 #21512835 未加载
评论 #21511936 未加载
Abishek_Muthianover 5 years ago
Considering video, audio are accepted as evidence in most courts without any independent verification; I&#x27;m seriously worried about the implications of deep fake on justice.<p>There is an urgent need gap[1] on detection of deep fakes.<p>[1]:<a href="https:&#x2F;&#x2F;needgap.com&#x2F;problems&#x2F;21-deep-fake-video-detection-fakenews-machinelearning" rel="nofollow">https:&#x2F;&#x2F;needgap.com&#x2F;problems&#x2F;21-deep-fake-video-detection-fa...</a>
评论 #21512522 未加载
lordgrenvilleover 5 years ago
We&#x27;ve had fake photographs for decades and it hasn&#x27;t seemed to make a big difference in politics. But I think that&#x27;s because in the past you had gatekeepers, like the editors and factcheckers of &quot;respectable&quot; publications, who would ascertain the legitimacy of a picture before using it. They&#x27;d make mistakes sometimes, but got it right 99% of the time.<p>Now news spreads horizontally through social media and group chats. It&#x27;s common to see, say, a clip purportedly of police brutality right now in country X, which is actually 7 years old and from country Y. Someone will correct it, someone will dispute the correction, whatever - the damage is done. So I don&#x27;t think deepfakes will move the needle much. The real damage is the end of gatekeeping, and that&#x27;s already happened.
评论 #21517460 未加载
YarickR2over 5 years ago
Well, this probably means end of unsigned content ; every line of text, every article, etc should be &#x2F; will be signed by living person&#x27;s key, or it will be heavily penalized in search engine output; governments will run keystores with citizens&#x27; keys, and content signatures will be checked against such keystores to ensure content authenticity (or lack thereof) . Time to reopen GPG , I guess.
joe_the_userover 5 years ago
I was experimenting with this stuff and you can too here [1]. It&#x27;s kind of impressive but not convincing. The main impression it gives is it doesn&#x27;t know what subjects affect which objects, what one kind of relation implies about another relation and so-forth. Still, it gives a sequence of words with a consistent &quot;feel&quot; which is impressive.<p>However, I would still only find it&#x27;s text convincing for producing ... a marketing blog since such things just seem like a contentless stream of buzzwords to begin with. If anything, it gives a certain idea of how marketing speech require something, a stream of words with certain feeling, but not real logic.<p>[1] <a href="https:&#x2F;&#x2F;talktotransformer.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;talktotransformer.com&#x2F;</a>
评论 #21512065 未加载
评论 #21511759 未加载
achowover 5 years ago
OTOH: I&#x27;m pretty excited that these technologies are maturing so that they can be harnessed for empowering common people, or workers in enterprises to make their content beautiful, simple &amp; into effective stories.<p>One example: Pentagon&#x27;s slide decks. <a href="https:&#x2F;&#x2F;archive.org&#x2F;details&#x2F;MilitaryIndustrialPowerpointComplex" rel="nofollow">https:&#x2F;&#x2F;archive.org&#x2F;details&#x2F;MilitaryIndustrialPowerpointComp...</a>
QuantumGoodover 5 years ago
The effects of an ever-higher velocity of fake news isn&#x27;t clear, but there is no &quot;solution&quot;.<p>Real news not believed, fake news believed has been an unsolved problem for a long time. For example, the history of medical advances show doctors not believing exceptionally solid science in many cases.<p>There are a number of quotes about progress along the lines of &quot;First they say it&#x27;s impossible, they they fight it, then they say they believed it all along&quot;.<p>This is a people problem and a media velocity problem going back to the famous quote &quot;A lie travels around the globe while the truth is putting on its shoes.&quot;<p>You can&#x27;t stop people from believing a lie after it has been released. Removing the lie doesn&#x27;t help. &quot;Reputable&quot; sources not repeating the lie doesn&#x27;t help.
this_was_postedover 5 years ago
We shouldn&#x27;t talk too much about our skepticism on this becoming problematic. Otherwise believable skeptic text can be generated by malicious actors through AI once it does become problematic so that they can drown out real concerns with virtual trolls.
shams93over 5 years ago
This has been true long before ai. Writing and journalism have always been weaponized. The opposite could be true in that it&#x27;s easier to recognize automated fake news than well crafted hand done human deception.
jon_akimboover 5 years ago
People very concerned about this should spend some time reading ${opposing political group} social media. As you&#x27;ll discover, people will believe what suits them. Veracity is of remarkably little interest to a remarkably high percentage of the population. Most people, and this is not an exaggeration, would sooner kill&#x2F;die than change their mind. And if that&#x27;s true, then consider the mental acrobatics individuals are willing to go through before they even reach that point.
zahrcover 5 years ago
I have personally yet to be convinced of AI generated media content (read articles, videos, photos) maybe the bias that I know that they are AI-generated, but to me it’s equivalent buying a cheap knockoff iPhone from China: it’ll work if you don’t really think about it, or do not know the difference.<p>We have to top-up education and teach media-awareness in school, while giving badly researched and generally toxic content the cold shoulder.
hertzdogover 5 years ago
I try to take a different direction. Let&#x27;s suppose some ai generated content is better than human created content (IMHO we are quite there). Let&#x27;s go further: maybe in the future we will trust again only some &quot;trusted sources&quot; (newspapers? HN?) while everything else will be not taken into account because the quality will be low (like some comments saying the source is not in the industry...).
评论 #21512096 未加载
greggman2over 5 years ago
I often wonder if Ranker, Thrillist, Collider, Vulture are all AI based. The seem to show up in every search
nightnightover 5 years ago
All tech demos without strong use cases yet. Machine-generated content, spinning content, etc. are black hat tactics employed for decades in order to game Google. Works (just look at what crap ranks high) but the foundation for new huge industries? No.
100011over 5 years ago
I am going to take the contrary opinion here. AI-generated fake content will inflate away the informational value transmitted by whatever it is trying to fake. It&#x27;s like &#x27;deep fakes&#x27;, they&#x27;ll just destroy trust to video.
seddinover 5 years ago
I might be wrong, but on some social networks as Reddit, many comments or shared links seem too weird, like if they were not real, and some posts that get resposted always end up with the same comments or similar words.
r0h1t4shover 5 years ago
Looks like this would be the new form of spam we will have to fight.
daxfohlover 5 years ago
How do we know this article was not generated by a bot?
unityByFreedomover 5 years ago
Doubtful. It&#x27;s easier to photoshop fake content and we haven&#x27;t seen that get out of control.
EGregover 5 years ago
Wow that AI-generated blog text actually made sense! The best I have ever seen. How did they do it?
HocusLocusover 5 years ago
muching virtual popcorn