Well, you can try it with:<p>wget -O- <a href="http://www.boutiques.com/robots.txt" rel="nofollow">http://www.boutiques.com/robots.txt</a> -U "Mozilla/5.0 (compatible; Googlebot/2.1; +<a href="http://www.google.com/bot.html)" rel="nofollow">http://www.google.com/bot.html)</a><p>and you get the same error.<p>I tried a couple of other bot user agent strings from <a href="http://www.useragentstring.com/" rel="nofollow">http://www.useragentstring.com/</a>, same result
they have NOINDEX, NOFOLLOW robots META tags that tell search engine crawlers to go away.<p>Maybe it's their way of playing nice with all of the merchants they are listing.