TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: Scraping Reddit in python

1 pointsby xcodingover 8 years ago
How do yo scrape reddit?

3 comments

fhoffaover 8 years ago
Why do you want to scrape reddit?<p>If you want comments and posts, they are already shared.<p>For example, in BigQuery:<p><a href="https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;bigquery&#x2F;comments&#x2F;3cej2b&#x2F;17_billion_reddit_comments_loaded_on_bigquery&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;bigquery&#x2F;comments&#x2F;3cej2b&#x2F;17_billion...</a>
habitual_coderover 8 years ago
read the api documentation for reddit, follow the rules, use python+praw to make requests. Writing a script with BeautifulSoup or similar seems like a headache.
savethefutureover 8 years ago
You write a scrapper, you could use python. Beautiful Soup might be useful.