One of my biggest fears about technology is how quickly and tirelessly machines can do things that, until now, we've expected limitations on.<p>For example, if I exceed the speed limit on a highway for just 5 seconds, I doubt anyone would notice. In fact, the law enforcement is pretty vague about speed limits at the moment.<p>If I leave my car in a parking lot for a minute without paying, I rely on the fact that a human watching isn't going to be that super efficient as to give me a ticket right away.<p>But that's only the beginning. There is so much information that a computer network can cross correlate about everyone, including probabilistic assessments about their identity, etc. This can of course be used by businesses (<a href="http://www.forbes.com/fdc/welcome_mjx.shtml" rel="nofollow">http://www.forbes.com/fdc/welcome_mjx.shtml</a>) or governments to try to do pre-crime (<a href="http://www.theverge.com/2014/2/19/5419854/the-minority-report-this-computer-predicts-crime-but-is-it-racist" rel="nofollow">http://www.theverge.com/2014/2/19/5419854/the-minority-repor...</a>).<p>But again, this is just the beginning. Right now we have a certain threshold for the quality of evidence against someone in a courtroom. With computers being able to come up with dozens of plausible "stories that will stick", anyone can be threatened as the jury (at least in the first few years) won't be able to tell the difference. We already have <a href="http://en.wikipedia.org/wiki/Parallel_construction" rel="nofollow">http://en.wikipedia.org/wiki/Parallel_construction</a> providing admissible evidence in court. With big-data software more sophisticated than <a href="https://www.palantir.com/" rel="nofollow">https://www.palantir.com/</a> , those with the machines on their side will have powerful legal weapons that they can wield against anyone.<p>But even this is just the beginning. We expect a certain quality of output from humans in all areas of life. Being able to match and surpass human output is one thing (<a href="http://www.popsci.com/article/technology/algorithm-recognizes-faces-better-people-can" rel="nofollow">http://www.popsci.com/article/technology/algorithm-recognize...</a>) ... but the relentless ability to continually search through a space towards a goal, and instantaneously leverage gains to produce more gains, may begin to overcome any strategic human systems, whether by individuals or entire countries. A computer network could figure out how to infiltrate a social network, topple a regime, completely dilute everyone's trust even in one another, and so forth. The smarter computers get, the more they will be able to overcome the systems we've set up including the biological systems of morality and trust from hundreds of thousands of years of evolution.<p>In fact if you think this is fantasy, consider that the NSA and other agencies already have rudimentary versions of this, that can only be made more powerful with big data crunching and bots: <a href="https://www.techdirt.com/articles/20140224/17054826340/new-snowden-doc-reveals-how-gchqnsa-use-internet-to-manipulate-deceive-destroy-reputations.shtml" rel="nofollow">https://www.techdirt.com/articles/20140224/17054826340/new-s...</a><p>So what's next for us as a species?