I kind of can't believe that both google and microsoft seem to have given in: We knew for quite some time (document leak this summer) that twitter was trying to make the search engines pay for access, but I would have hoped that Google and MS had more guts to not make such an agreement.<p>There are various reasons for that:<p>1) it sets a bad precedence. Up until now, all (significant) content was accessible to the search engines without barrier and to index the web, aside of general algorithmic improvements, no changes in the way how spiders work were needed.<p>2) I don't see why Twitter should decide who can and who can't access the content I made publically available (by tweeting). This should be open to anybody requiring the data.<p>2) The information in twitter, frankly, does not need to be exposed into Google as it IMHO does not contain enough original information. Twitter is about conversations and links to stuff that is in the search engines anyways and the conversations don't really provide that much added value.<p>3) Twitter gains as much (or even more - see above) from Engines indexing them as the engines gain from being able to index Twitter.<p>And lastly: In all other places of the internet that are indexed by search engines, I as the author can specify whether I want the content I create to be indexed or not (robots.txt, X-No-Archive-Headers and so on).<p>As far as I can see, there is no way to make my conversations not appear in Google or any other place - and yes: Conversations. Tweets are not always real content, but often times just bits and pieces of conversations.<p>In a perfect world:<p>1) there would be a standard on how to feed search engines (or any other interested party) with that content.<p>2) Twitter and other micro blogging services would adhere to said standard<p>3) Twitter and other micro blogging services would allow me as a user to chose whether my insignificant content is archived/indexed or not, preferably per tweet.