TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Did a Human or a Computer Write This?

172 pointsby tomek_zemlaabout 10 years ago

33 comments

vonnikabout 10 years ago
Former reporter hear who has been in professional talks with a natural-language generation firm, dabbles in NLP, and has some insight into this process.<p>A lot of what machines churn out is based on templates that humans have created. Many of the things we read that are supposedly written by machines required major human intervention, and the application of strict constraints on the machine so that it wouldn&#x27;t screw up.<p>Number stories about baseball and the stock market are good for machines to write about. Most qualitative things aren&#x27;t, for the moment. Even Google&#x27;s results generating captions from images last November actually included a lot of variance. The algorithm was good at recognizing some things and not others.<p>To the commenters on this thread who criticize news organizations, I would simply ask: Do you consume your news for free? Do you believe that synthesizing complex events using multiple sources of data happens without cost? Do you believe that news organizations pay reporters much to write stories? Please reflect on your role in the news ecosystem.<p>Most readers today are free riders, and unwilling to subsidize quality journalism. That&#x27;s one reason why it&#x27;s dying.
评论 #9169200 未加载
评论 #9170442 未加载
评论 #9169975 未加载
评论 #9178323 未加载
评论 #9169581 未加载
joe_the_userabout 10 years ago
What does &quot;written by a computer&quot; even mean?<p>I mean, computer-written can be anything from filling in some blanks to rendering a formula by reverse-parsing. And suppose that an apparently fancy formula actually results in blank-filling-in most of the time?<p>Lots of professional writers are described as following a formula. Lots of writers and non-writers construct text using word-processors and even an occasional search-and-replace.<p>-- Oh, and add to that &quot;The Eliza Effect&quot;[1], in which it&#x27;s pretty easy for humans to ascribe greater meaning to some kinds of computer generated text than it really has.<p>[1] <a href="http://en.wikipedia.org/wiki/ELIZA_effect" rel="nofollow">http:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;ELIZA_effect</a>
评论 #9167274 未加载
hammerandtongsabout 10 years ago
There is a non-zero amount of reporting that would be improved by algorithmic and model driven story generation.<p>Quite a bit of reporting has become thinly veiled rewrites of press releases, what could be improved by an algorithm that actually had background context and a consistent model for a type of story like a simple preview of a coming game?<p>The amount of statistics in reporting that lacks any context for the numbers spewed out? Why couldn&#x27;t a machine do a better job in enforcing context for the numbers?<p>For example -- &quot;there is a %50 murder increase in the first six months of this year&quot; (common problem with human reporting) vs &quot;there is %50 murder increase from 2 in the first six months of last year to 3 in the first six months of this year, this is down from 20 in the previous year&quot; (an algorithm that automatically enforces context)?<p>I realize this is a complex topic but wow the average ;) news story is soooo bad that...
评论 #9167918 未加载
评论 #9167727 未加载
评论 #9167807 未加载
评论 #9170084 未加载
Udikabout 10 years ago
Completely meaningless. &quot;Written by a computer&quot; doesn&#x27;t really mean anything. What&#x27;s important it&#x27;s the breadth and variety of the content an algorithm can generate, its ability to choose the most relevant among its input data, and the amount of meaningless content that has to be discarded by a human supervisor before publishing.<p>Take fragment 6: “Tuesday was a great day for W. Roberts, as the junior pitcher threw a perfect game to carry Virginia to a 2-0 victory over George Washington at Davenport Field.”<p>Cool. And who told the computer it was a great day for him? Who told the computer he was playing? Who told it his game was &quot;perfect&quot;? This sentence can be written by a professional human journalist in about ten seconds, how long does it take to input in a computer the data that make up the story or to check among hundreds of possible variations for one that doesn&#x27;t contain obvious mistakes?<p>Or: “Kitty couldn’t fall asleep for a long time. Her nerves were strained as two tight strings, and even a glass of hot wine, that Vronsky made her drink, did not help her. Lying in bed she kept going over and over that monstrous scene at the meadow.”<p>Ok, it&#x27;s a novel, written by a computer. Now, everybody can write a software that produces one single novel: just store it as a single string in the program and print it out. The magic happens when the computer can write something that goes way beyond the data that was stored in it exactly for that purpose. So how many different novels can this program write? Does the result exceed considerably the effort of the programmers put in the program itself? Most probably not, otherwise we&#x27;d be talking of a general AI.
评论 #9168015 未加载
评论 #9167980 未加载
评论 #9168004 未加载
评论 #9168257 未加载
cowpigabout 10 years ago
I got 7&#x2F;10, but I think I would do better on prose with 3-4 sentences rather than a single one. Poetry is probably a bit tougher though.<p>I don&#x27;t find computer-generated snippets that impressive--I mean, a lot of it is just pumping out variations or markov-generated mix-and-matches of things humans wrote in the first place. More impressive would be passing the Turing Test :D
评论 #9167106 未加载
tdubhro1about 10 years ago
Leaving aside the gimmicks in some of these examples, it is a fact that when you need to communicate quantitative information machine generated text is a great solution. Our company builds analytics and dashboards for fund managers and traders (the people who manage most pension funds). Infographics and charts only go so far; eventually, the user has to extract the key information, or communicate it with a colleague, which means verbalizing.<p>[ShowHN:] We built our report generation system (in Haskell) that can create a custom report for every portfolio or market index, and can be tuned to the user&#x27;s risk profile. We&#x27;ve released a public version that anyone can use for free that covers most global indices and sectors:<p><a href="https://apps.otastech.com/morningreport?listtype=marketindex&amp;listid=11&amp;apikey=5AA46437DEDE6DC9C7ABCD56DF5CB&amp;search=true" rel="nofollow">https:&#x2F;&#x2F;apps.otastech.com&#x2F;morningreport?listtype=marketindex...</a><p>In our experience, the turns of phrase that initially give the impression that the text has been written by a human quite quickly become irritating noise. Our users need to absorb information quickly and accurately, and comprehension is aided by adhering to a standard structure and avoiding figurative language.
hurinabout 10 years ago
Some of these are clearly <i>computer-generated</i> in a way where the human has done most of the work. Take<p><i>“In truth, I’d love to build some verse for you<p>To churn such verse a billion times a day<p>So type a new concept for me to chew<p>I keep all waiting long, I hope you stay.”</i><p>Now I&#x27;m going to bet a generator algorithm does not actually comprehend the meaning of any that - most likely the generator aspect was filling in some blanks, or picking out one random phrase structure out of pre-coded structures.
评论 #9167935 未加载
netherabout 10 years ago
&quot;Hi&quot;<p>did a human or computer write this?
评论 #9167333 未加载
ridiculous_fishabout 10 years ago
Here&#x27;s a humorous failure mode of computer-authored articles. Zillow bought the real estate company Trulia. The website equities.com then shared its wisdom:<p><i>Trulia Inc (TRLA) established a new 52-week low yesterday, and could be a company to watch at the open. After opening at $0.00, Trulia Inc dropped to $0.00 for a new 52-week low.</i><p>The article goes on to speculate as to whether this is a buy or sell signal. It&#x27;s since been deleted but I put the text up here: <a href="http://pastebin.com/ihgWNVJU" rel="nofollow">http:&#x2F;&#x2F;pastebin.com&#x2F;ihgWNVJU</a>
hyperion2010about 10 years ago
I missed 3 because I have a low opinion of human punctuation. For sports and business or most things with numbers I assume that it is a computer because that is the kind of data that is reasonably easy to write domain specific sentence construction for. For poetry looking for whether there seems to be underlying meaning or intent that surfaces without excessive mental gymnastics also seems like a reasonable strat.
dkarapetyanabout 10 years ago
I missed 3. Some of these are getting pretty good but they probably chose the best examples. I&#x27;m guessing with a bit more context it would have been much easier to disambiguate.
jerfabout 10 years ago
For computer graphics, I have a standard that I use where instead of asking &quot;Is this rendering technology &#x27;realistic&#x27;?&quot;, as in, a binary question, I ask &quot;At what resolution is this render indistinguishable from reality?&quot; For instance, there&#x27;s a lot of car photos and architecture renderings that use that use certain expensive rendering techniques that look <i>great</i> even at 720p, but you start getting into 1080p or above and it once again becomes clear it&#x27;s a computer rendering. Other techniques may only be able to work up to 320x200 or something.<p>Similarly, telling whether a computer has written something or not is very challenging at this snippet size because there&#x27;s hardly any room for &quot;voice&quot; to shine through. I actually did pretty well, but to be honest I got more mileage out of a meta-heuristic (&quot;how is the author trying to fool me? ah, this one seems really, <i>really</i> human so it must be computer... yup...&quot;) than actual analysis of the text. I mean, drop those computer-generated sports sentences into the middle of a human sports column and you&#x27;re not going to pick them out specially... they&#x27;re facts. They fit. However, an entire column written like can be pretty obvious. I get some financial news from some Google Alerts on a couple of companies and it&#x27;s incredibly obvious that there are computer algorithms out there that can take the daily outcome for a stock, how the market did that day, and how the entire industry did that day, and spin that into several hundred words of completely and utterly <i>useless</i> speculation about &quot;why&quot; the stock did a certain thing. (Not that it hasn&#x27;t become clear to me just how shallow a lot of the &quot;free&quot; analysis is, but, well, in no way does outsourcing the shallow analysis job to a computer make it any better...!)<p>(One of them in particular that I&#x27;ve come to enjoy reading in an almost Dadaist sort of way really loves the phrase &quot;The bears had a field day with...&quot; as in, &quot;The bears had a field day with $STOCK as it dropped 0.01% in light trading.&quot;)<p>Increase the sample size and you&#x27;d probably get a better sense of whether or not it is fooling you. I was going to write &quot;and you might do better&quot;, but that&#x27;s not necessarily true... for instance, to be honest I&#x27;ve never been &quot;into&quot; poetry, I&#x27;ve even tried seriously a couple of times, just can&#x27;t do it, and I&#x27;m pretty sure the poetry-writing program could fool me for quite a few stanzas before I eventually caught on because, to me, it&#x27;s all the same. [1] I&#x27;d eventually guess more on meta-analysis like observing grammatical structures being repeated for what would not be a good reason.<p>[1]: Have I caveated this sufficiently that nobody will feel compelled to reply and explain to me just how objectively awesome poetry is? I&#x27;d say my thing is more music, but to be honest, a surprising number of &quot;human&quot; composers already sound pretty computer-y to me....
Guillaume86about 10 years ago
7&#x2F;8. Number 5 got me, but also helped me get the last ones correctly. I would probably got more errors if the answers were all given at the end.
评论 #9169353 未加载
adventuredabout 10 years ago
There are still far too many obvious tells here.<p>&quot;Apple’s holiday earnings for 2014 were record shattering.&quot;<p>An algorithm isn&#x27;t going to use the slightly unusual &quot;holiday earnings&quot; reference (it would have said X quarter or end of year perhaps), it&#x27;s also not going to understand (yet) that they were record shattering without human direction.<p>&quot;Benner had a good game at the plate for Hamilton A’s-Forcini. Benner went 2-3, drove in one and scored one run. Benner singled in the third inning and doubled in the fifth inning.&quot;<p>That&#x27;s maybe the easiest out of all of them. Repeating Benner that way over and over again, is nothing like how a sports writer would write.<p>Maybe another six to ten years of evolution, and it&#x27;ll be nearly impossible to tell the difference. It&#x27;s certainly a significant improvement over what you would have seen ten years ago in this sort of exercise.
评论 #9167991 未加载
评论 #9168014 未加载
eobabout 10 years ago
The Shakespeare sonnet wasn&#x27;t written by a computer. IIRC Nate just had a text editor with a type-ahead suggest box that was weighted by an n-gram lookup into your corpus of choice. It was up to the human to choose <i>which</i> word to use.
tomasienabout 10 years ago
The problem with this quiz, and so many like it, is a bunch of the passages were so badly written. A badly written passage could be a human or a computer, there&#x27;s no real way to distinguish that. There are 3-4 in here that are well constructed, 1 by a human and a couple by computers. For each, to me, it was obvious which wrote it. The rest I was like &quot;who knows, either a bad writer or a computer but it could be either&quot;.
TheSpiceIsLifeabout 10 years ago
There are at least three comments here sayings &quot;got x&#x2F;10&quot;<p>Every time I load the page I get the same eight enumerated questions.<p>Is there something going on here I&#x27;m not aware of?
评论 #9170668 未加载
demarqabout 10 years ago
Only got two wrong [bragging!], and both were sports commentary. but then again I&#x27;m not really a sports guy.<p>Either way that was impressive... I could imagine in the future your phone&#x2F;tablet scans your favourite websites and generates news stories for you to read, replacing traditional media. If you are into food you can have an entire newspaper generated about the goings on of food!
stretchwithmeabout 10 years ago
Are computers actually writing things? Or filling in a template covering an event that produces data that is expected?<p>I could write an app that fills out this template:<p>&quot;Wow, did you see that post on Hacker News? Got X number of views within Y minutes!&quot;<p>That&#x27;s not writing. The guy who made the template wrote most of it. The rest is plug and play.
GizaDogabout 10 years ago
Humans are computers so it does not matter.
arithmaabout 10 years ago
&quot;6&quot;<p>Was this number written by a human or a computer?<p>If you sift through a stream of mumbo jumbo written by a thousand chimps and selectively extract meaningful words, is it written by chimps or selected by humans.<p>That is just to say, an algorithm can&#x27;t be &quot;judged&quot; by single outputs, much less output selected by a human.
tek-cyb-orgabout 10 years ago
It was all written by humans. computers just do what humans want them to do. period.
jafingiabout 10 years ago
But, if the algorithm is written by a human, isn&#x27;t it a human writing the text?
评论 #9168087 未加载
joelrunyonabout 10 years ago
Would love this technology to auto-analyze politicians (or anyone&#x27;s statement) and be able to automatically &#x27;fact check&#x27; or reference them to keep them honest &amp; improve news quality.
backlavaabout 10 years ago
print &quot;This sentence was written by a computer.&quot;
yzhabout 10 years ago
6&#x2F;8. Got 5 and 6 wrong. I wonder what kind of errors are more often: treating a computer-generated text to be the work of a human, or vice versa?
getdavidhigginsabout 10 years ago
I brought up this scenario a few months ago with &#x27;content engines&#x27;, or &#x27;content as a service&#x27;. Natural Language Generation (NLG) is no trivial matter. The ones who have mastered algorithmic writing are the new gods of our time. Can you imagine not having to pay the team of writers at NYT? Exactly ― you can&#x27;t imagine: <a href="http://blog.higg.im/2014/03/14/percolate-content-marketing/" rel="nofollow">http:&#x2F;&#x2F;blog.higg.im&#x2F;2014&#x2F;03&#x2F;14&#x2F;percolate-content-marketing&#x2F;</a>
jimkriabout 10 years ago
This actually gives me a idea for an independent study I need to do to finish my computer science minor. It is basically what the article is about, an algorithm that I could use to write my papers. It could be for major papers or for a cover letter or even a blog post that I have to write for a class.<p>Does anyone have any thoughts on that?<p>I have not done any research on the topic of algorithms writing articles other than reading this article and the other article that is on the front page as well.
ricardobeatabout 10 years ago
Got 10&#x2F;10. I already knew about Quill so knew what to expect. The funny thing is that perfectly correct sentences are more likely to have been written by a computer than a human, it&#x27;s a pretty good signal.
评论 #9167995 未加载
Tyguy7about 10 years ago
I got 1 wrong. Those algorithms still need work.
weitzjabout 10 years ago
Ah. 9&#x2F;10. Failed nr. 3
评论 #9167877 未加载
评论 #9169553 未加载
hcarvalhoalvesabout 10 years ago
Surprised by the poetry.
daniel134about 10 years ago
Got 7&#x2F;8 correct!