TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: How to protect against scraping?

5 pointsby paulborzaalmost 7 years ago
I own a website with lots of financial information in another country and from time to time I see a huge spike in traffic from certain IP addresses. I&#x27;m guessing they&#x27;re trying to scrape the information I provide. I then go and block these IP addresses manually by updating my nginx config to deny requests from those addresses. This works fairly okay, but requires manual intervention.<p>The website runs on Node and nginx sits in front of the Express app. Are there good Node packages, nginx best practices that can protect against scraping automatically?<p>Thanks in advance!

no comments

no comments