TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

A guide to Web scraping without getting blocked

7 pointsby ksahinalmost 6 years ago

1 comment

clashmeifyoucanalmost 6 years ago
While I don&#x27;t think scrapers have legal action taken against them unless they become a major pain for the company, faking User-Agent strings has been painted as spoofing by lawyers, <a href="https:&#x2F;&#x2F;stackoverflow.com&#x2F;a&#x2F;20926119&#x2F;9044659" rel="nofollow">https:&#x2F;&#x2F;stackoverflow.com&#x2F;a&#x2F;20926119&#x2F;9044659</a> (very old example).<p>I wonder if employing these methods worsen the legality (or the lack of it thereof) associated with scraping.