TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

How to lie without statistics edition

16 pointsby solutionyogialmost 9 years ago

3 comments

stdbrouwalmost 9 years ago
&gt; The predictor is probably not biased against any particular race - the race_factorAfrican-American:score_factorHigh term is not statistically significant. Or, as ProPublica puts it, it&#x27;s &quot;almost statistically significant&quot;.<p>This is not how you interpret p-values. Not attaining statistical significance (insofar as you think that that&#x27;s a good measurement to start with) means there isn&#x27;t sufficient evidence to confirm that a factor truly makes a difference. It is not proof that no racial bias is present -- to prove a negative with the same 95% confidence we expect elsewhere, the analysis would need to have 95% power to detect the bias if it did exist... and unfortunately it just so happens that interaction effects always have lower power for the same sample size than first-order effects.<p>The author also accuses ProPublica of cherry-picking numbers but then picks the one number from the entire article that is least convincing (one of the numbers on predictive accuracy of the algorithm for black vs. white people) and ignores the other statistics about predictive accuracy that are mentioned in the article.<p>Do I necessarily want to defend ProPublica here? I dunno, I haven&#x27;t gone through the analysis they did for the article in depth. I also like the author&#x27;s note that statistical models are often wonderful tools for reducing human biases and (in this case) reducing racism. But ultimately I do feel the author is being very hostile when ultimately his rebuttal is pretty feeble.
评论 #11773486 未加载
wodenokotoalmost 9 years ago
I&#x27;m still confused if race is a feature in the original model. More over, the offense and re-offense rate of black people is also tied to racial bias by the police.<p>If the police let more speeding white guys off with a warning than black (as a rate) then the bias is applied at the data level.
areyousurealmost 9 years ago
yummy: I&#x27;m commenting here because I can&#x27;t figure out how to comment on your blog. :(<p>As a potentially useful but minor correction: Sorelle, who you mention in your previous post, is a &quot;she&quot;.