TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: Do you scrape data? What do you use it for?

7 pointsby jmaccabeeabout 7 years ago
I&#x27;ve got a theory that in 2018, most people or companies can use web scraping tools to make some aspect of their lives easier.<p>For example, I wrote a script a few months back to scrape transit data and send me a text when the subway is delayed for my morning commute. Maybe you&#x27;re helping your company scrape competitor prices to know when they change?<p>So - are you scraping data today? As part of a hobby project or for professional purposes? What do you use it for? And if you don&#x27;t, why not?

2 comments

klezabout 7 years ago
I do scrape. We are making a sort of meta-search engine for long term car rental, so to bootstrap it we are scraping offer from various sites and directing users to the original websites to actually go through with the offer.<p>If anyone is interested in more detail, I can explain further.
评论 #16869542 未加载
xstartupabout 7 years ago
Ad scraping can be very profitable.<p>See: <a href="https:&#x2F;&#x2F;adplexity.com&#x2F;" rel="nofollow">https:&#x2F;&#x2F;adplexity.com&#x2F;</a>
评论 #16872611 未加载
评论 #16881394 未加载