TE
科技回声
首页
24小时热榜
最新
最佳
问答
展示
工作
中文
GitHub
Twitter
首页
Tales - a block tolerant web scraper that runs on top of aws and rackspace
3 点
作者
calufa
超过 12 年前
1 comment
rachelbythebay
超过 12 年前
Collapse
>> Tales is design to scrape the web continuously, even when the domain being scraped blocks the scraper server ip; it goes around this problem by fail-overing to a new node (server).<p>And people wonder why the AWS machines get filtered.
评论 #5233740 未加载