TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

A guide to Web scraping without getting blocked

7 点作者 ksahin将近 6 年前

1 comment

clashmeifyoucan将近 6 年前
While I don&#x27;t think scrapers have legal action taken against them unless they become a major pain for the company, faking User-Agent strings has been painted as spoofing by lawyers, <a href="https:&#x2F;&#x2F;stackoverflow.com&#x2F;a&#x2F;20926119&#x2F;9044659" rel="nofollow">https:&#x2F;&#x2F;stackoverflow.com&#x2F;a&#x2F;20926119&#x2F;9044659</a> (very old example).<p>I wonder if employing these methods worsen the legality (or the lack of it thereof) associated with scraping.