TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Scrapy needs to have sane defaults that do no harm

12 点作者 sagacity21 天前

1 comment

sph21 天前
Is there a pluggable fail2ban-like server for HTTP, to rate-limit and block with a 429 any rude bot?<p>Also, how come we haven&#x27;t yet designed a system of pluggable HTTP pipelines? If you have a custom web app, either you implement rate limiting by hand, or you set that up in your frontend nginx&#x2F;caddy&#x2F;apache&#x2F;etc. It would be much nicer if we had standardized composable HTTP server processes that either handle a request, or pass through to the next one. That way rate limiting would just be a matter of plugging a rate-limiter process just before your web app.<p>I guess I just miss having Elixir&#x27;s Plug system at the OS level.
评论 #43772849 未加载
评论 #43780868 未加载