i would point out that robots.txt is optional you don't have to follow it. It would be easy enough for one of us to extract the text of each petition, with a simple spider, put it on a web site with links back to the original, and let google search that. The petitions are public documents for public consumption. Even if white house tried to sue it wouldn't be their content. it's the content of the person who created it. Otherwise they would be legally suggesting that they are petitioning themselves.... then again IANAL just a human capable of reasoning through things logically, which rarely has any bearing on lawsuits. ;)