TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Hacker_news_scraper

1 pointsby vstuartabout 5 years ago
hacker_news_scraper | https:&#x2F;&#x2F;github.com&#x2F;victoriastuart&#x2F;hacker_news_scraper<p>A Python 3 script for scraping the Hacker News feed, filtering that content by<p>* number of points, and&#x2F;or<p>* number of comments, and&#x2F;or<p>* excluding posts {dead | flagged | youtube | wikipedia | ...} according to a keywords list<p>Run via ~&#x2F;.bashrc alias or crontab.<p>Experimental code; I will monitor it locally (scheduled to run {06:00 | 18:00} daily, starting 2020-04-14) for bugs, etc.

1 comment

Etheryteabout 5 years ago
Not to discount your effort, but is there a benefit for scraping the data when HN offers an official API[1]? Does the API not expose all the data you need?<p>[1] <a href="https:&#x2F;&#x2F;github.com&#x2F;HackerNews&#x2F;API" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;HackerNews&#x2F;API</a>
评论 #22867805 未加载