TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Block AI Scrapers with Anubis

2 点作者 namanyayg大约 2 个月前

1 comment

keyle大约 2 个月前
A key aspect<p><pre><code> [...] Anubis is implemented is that it triggers challenges for every request with a User-Agent containing &quot;Mozilla&quot;. Nearly all AI scrapers (and browsers) use a User-Agent string that includes &quot;Mozilla&quot; in it. This means that Anubis is able to block nearly all AI scrapers without any configuration. </code></pre> Seems like a little loosey-goosey approach, if all it takes is removing Mozilla from the User-Agent string, don&#x27;t you think that&#x27;ll be the first thing they do?
评论 #43431169 未加载