538 is using the wrong metrics. For a movie to be truly, truly, <i>sublimely</i> bad, that badness needs to be recognized - people in some cases will want to watch it for its incredible badness. This means that there are going to be a disproportionate number of both 1 and 10 votes. And the winner based on this is - The Room. <a href="http://www.imdb.com/title/tt0368226/ratings?ref_=tt_ov_rt" rel="nofollow">http://www.imdb.com/title/tt0368226/ratings?ref_=tt_ov_rt</a>
The opposite effect, a bad movie being rated highly, also occurs. One example of this is with the film "The Oogieloves in the Big Balloon Adventure" (<a href="http://www.imdb.com/title/tt1520498" rel="nofollow">http://www.imdb.com/title/tt1520498</a>). This film was panned by critics on release and was a complete flop at the box office. Its IMDB rating languished until sometime last year when it began to rise. Around the same time, a bunch of poorly-worded unequivocally positive reviews showed up on the page, all following the same pattern (including one that appears to have been run through a translator and back). The rating made it up to 8.0, although it's since fallen to 7.6. If it's not the movie's production or marketing team involved in this clear manipulation, I don't know who it would be, as I can't see that this movie has any kind of cult following.
I feel like there's an assumption that this data is <i>erroneous</i> for this reason - I think that any reason in which a person gives a negative rating toward a film is valid, be it politically motivated or otherwise.<p>FiveThirtyEight has had a rough start so far so I may be more inclined to seek more nuance than I normally would as they've tended to be extraordinarily simplistic (Silver himself notwithstanding) to date.
I found it odd that the article makes note that 36,000 ratings come from outside the U.S. Maybe I am missing something but wouldn't it be expected that many of a Bollywood movie's ratings would come from outside the U.S.?
I would never have heard about this movie if it hadn't been so low rated. Perhaps they rather should have given in 5 stars, burying it in mediocrity?
Luckily, IMDB also shows Metacritic ratings next to their own user ratings. I take those into account before I make my decisions on what I'm going to rent/stream.<p>Far too often do you find a movie (usually a somewhat recent release) that's just flat out terrible despite having a > 7 score on IMDB (and usually a Metacritic score in the 30's or 40's)
Troll 2 used to be the worst-rated movie on IMDb until it became a cult favorite and garnered tons of 5-star ratings.<p>If you're interested, there's a really interesting documentary about Troll 2 called Best Worst Movie, which covers the film's production and cult following. After watching the documentary, Troll 2 becomes an enjoyable movie because you know all the crazy backstories to the actors and scenes.
<i>He was sentenced to life in prison for his crimes by the Bangladeshi International Crimes Tribunal. But many Bangladeshis found that sentence too lenient, and more than 100,000 of them gathered in Shahbag Square in the capital city of Dhaka to challenge it.</i><p>It's interesting that so many people gathered solely to express "we want this guy dead, not imprisoned." I wonder if there's more context?
Maybe a solution could be weighting the vote according to the user history: a user leaving a single vote on a single movie shouldn't be as influential as an user that voted on a wider range of movies over time
<i>Data gone Wrong</i><p>Did they start hanging out with the bad kids, take up cigarettes, drinking, gambling only to progress to crack and burglaries one of which ended with our Data shooting a home owner who returned unexpectedly?<p>I guess I don't understand what data is. I always thought it was a set of values. And I always thought that the problem when using data was in the interpretation, and that a prudent consumer of data would always be careful to distinguish between a random sample and self-selecting sample when drawing conclusions, and then would only state conclusions couched in the language of statistical inference.<p>Leaving aside the question of why I should give a fuck about this supposed outrage, why does the author expect there to be a strong correlation between movie quality and the ratings on a website devoted to providing entertainment by having users rate movies?<p>When <i>The Matrix</i> is purported to be better a better movie than <i>Lawrence of Arabia</i>, the problems of interpretation are systemic.
Years ago, when you could download roms from the mame website, I gave a strong up score to the Tron romset.<p>That tipped the romset into the spotlight - there were some leaderboards for highest recent activity and so on. Other people started downloading the romset and voting on it.<p>Suddenly this obscure romset was catapulted into most of the lists for "most active" and "best" etc.<p>I had rated the game honestly. I had fond memories playing the cab for a week on holiday in my youth. But I was surprised that so many other people felt the same, especially on the Mame platform where the game's controls made it tricky.<p>All my deliberate attempts at voting shennanigans failed miserably. (Although I haven't investigated MTurk or similar yet.)<p>I wish there was a site like Meatball wiki where people could share their vote-weighting methods.
For more information on the war, read the wikipedia article: <a href="http://en.wikipedia.org/wiki/Indo-Pakistani_War_of_1971" rel="nofollow">http://en.wikipedia.org/wiki/Indo-Pakistani_War_of_1971</a>
The archetypal 'bad' movie is "Plan 9 from Outer Space" [0], by Ed Wood. It holds that title mainly because of its production values.<p>This one has caused a stir on IMDB for reasons of moral integrity, or bending the truth. Rather odd, since this has been going on in films and similar media for a very long time.<p>"International Gorillay", a film from Pakistan depicting Salman Rushdie [1]. Coincidentally it was released a year or so after Rushdie's "The Satanic Verses" [2]. Ayatollah Ruhollah Khomeini [3] wanted Rushdie dead because of this novel. BTW Iranian films can be very good, like "Where is the Friend's Home?" [3].<p>[0] <a href="http://www.imdb.com/title/tt0052077/" rel="nofollow">http://www.imdb.com/title/tt0052077/</a>
[1] <a href="http://www.imdb.com/title/tt0251144/" rel="nofollow">http://www.imdb.com/title/tt0251144/</a>
[2] <a href="http://en.wikipedia.org/wiki/The_Satanic_Verses" rel="nofollow">http://en.wikipedia.org/wiki/The_Satanic_Verses</a>
[3] <a href="http://en.wikipedia.org/wiki/Ruhollah_Khomeini" rel="nofollow">http://en.wikipedia.org/wiki/Ruhollah_Khomeini</a>
[3] <a href="http://www.imdb.com/title/tt0093342/" rel="nofollow">http://www.imdb.com/title/tt0093342/</a>
IMDB ratings are bull. Lots of great movies, often even classics, rate around 6 on IMDB because the general public considers them "boring".<p>The only movies that escape from the IMDB average are a) decent movies that are loved by the masses, b) great movies the masses don't watch (being in black and white or not in English alone pretty much guarantees 2 bonus points) and c) movies everyone agrees on are total crap.
Contains the best author disclaimer I've seen:<p><i>Data analysis by Eugene Bialczak. Also, a disclaimer: the author wrote much of the IMDb Trivia App.</i>
It's not that the rating is inaccurate... it's that a huge population of people that don't usually rate movies on IMDB has suddenly entered the rating pool. Maybe the solution is to have country-specific ratings, so that my ratings are averaged with the ratings of my peers, rather than the ratings of people in entirely different cultures.
Any crowdsourced data can be easily manipulated by a well organized or large enough group. See the results of the naming poll for the Megyeri Bridge in Budapest in 2006. <a href="http://en.wikipedia.org/wiki/Megyeri_Bridge#Naming_poll" rel="nofollow">http://en.wikipedia.org/wiki/Megyeri_Bridge#Naming_poll</a>
A film I had the pleasure to work on, "Car 54: Where Are You?" has a rating of 2.4, and that was not due to any crowdsourced manipulation; people really hate the movie. I thought it was marginally worse than Police Academy 4, but most people apparently think it really sucks.
if you use imdb as a general indicator of a film's quality you're much better off entirely excluding the scores of films produced by india and turkey
"There are currently more than 235,000 films on IMDb, and ... not a single qualified movie besides “Gunday” rates worse than 1.8."<p>"The next lowest-rated movie on IMDb — 1.8 stars overall ..."<p>I am not sure what the writer means by a "qualified" movie, but this one does rate less than 1.8: <a href="http://www.imdb.com/title/tt2094870/" rel="nofollow">http://www.imdb.com/title/tt2094870/</a><p>It has votes from only 195 users as of this writing, though.
It just needs to be bicameral: one rating from critics and one rating by the public. Rotten Tomatoes does this, and I think it lends for a better overall result.
Justin Beiber's Believe now at 1.5, just saying, and I believe that happened more organically.
<a href="http://www.imdb.com/title/tt3165608/" rel="nofollow">http://www.imdb.com/title/tt3165608/</a>
I don't see how crowdsourcing is hurting here. In fact, I learned something new.<p>I'm thinking this movie otherwise gets forgotten in the trash bin of bad movies and the data would never tell you anything because it wouldn't exist.
Currently working on an approach that would avoid this type of gaming of rankings by changing the way we collect ratings:
<a href="https://aeolipyle.co/" rel="nofollow">https://aeolipyle.co/</a>
I don't understand this part: "91 percent of all reviewers gave it one star. The next lowest-rated movie on IMDb — 1.8 stars overall — has a more even distribution of ratings, with only 71 percent of reviewers giving it one star. The evidence suggests the push to down-vote “Gunday” was successful".<p>To me that's just stating the obvious. Of course if there is such a thing as a worst movie then it will have a higher percentage of 1 star votes than other movies. So I don't know how that's evidence for anything except that the movie seems to be bad.
hey, let the data speak for itself! ;)<p>seriously, i do take IMDB ratings into account, but i consider them unreliable at best. Inception, when it came out, was the best movie of all time for a while, according to IMDB users. enough said.