TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

80Legs: A Web Crawler as a Service

25 pointsby johnrobertreedover 15 years ago

1 comment

timdorrover 15 years ago
<i>Our unique distributed architecture stitches together computers from all around the world to deliver exceptional crawling performance at an incredibly low cost.</i><p>Sounds like they've got a botnet :| Of course, I'm sure it's nowhere near as insidious. But are they piggybacking this on top of some other distributed computing platform or service? Can I contribute (and maybe get paid for my time)?<p>Edit: Do some basic research, Tim... <a href="http://gigaom.com/2009/05/14/80legs-cares-about-your-bandwidth-cap/" rel="nofollow">http://gigaom.com/2009/05/14/80legs-cares-about-your-bandwid...</a>