TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: Help Should I use web scraping/Bot? On Twitter, Facebook, instagram?

1 pointsby FussYouover 9 years ago
Guys, we are working on a startup where we need to take data from all the aforementioned websites, but we have decided not to spend on APIs so we took the free APIs. But we can't create a new account each time we are fetching data on new keywords. So now we are contemplating scraping. But all the big websites prohibit it (even though they themselves use it). Can you suggest any other method where we can fetch data without having to create users and have it run on the server 24*7. We will have to launch with 1000s of keywords and it could grow to an enormous number. Kindly guide us. Bless you!

no comments

no comments