TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

How to protect your DEV sites from crawlers

2 pointsby krunoabout 10 years ago

1 comment

karambahhabout 10 years ago
Something sometimes ignored, is that you can restrict access based on IP on Apache:<p><a href="http://httpd.apache.org/docs/2.2/mod/mod_authz_host.html#order" rel="nofollow">http:&#x2F;&#x2F;httpd.apache.org&#x2F;docs&#x2F;2.2&#x2F;mod&#x2F;mod_authz_host.html#ord...</a><p>Easy access for everyone, and more importantly REST APIs work out of the box, etc..