TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Ask HN: Django or Flask for a little Scraper Admin

1 pointsby ereckersabout 11 years ago
I&#x27;m a PHP developer, but the scraping tools I&#x27;ll need probably call for Python. Basically, what I&#x27;m looking to do is scrape a couple search engine APIs (Google, Bing, DDG) to grab 10 to 20 results. I&#x27;ll then crawl the results pulling page title, meta description, and snap a screenshot of a couple pages (home page for sure).<p>I&#x27;d like to use MySQL as a backend since that&#x27;s what I&#x27;m familiar with (PHP and Perl days). With this data I&#x27;d then want to output text files to be processed via PHP to be imported into a PHP based website&#x2F;app.<p>Basically, I&#x27;m thinking I should build this thing off of some framework and from what I&#x27;ve read Flask is a more lightweight framework than Django.<p>Basically, I want to jump in, but I want to know if one would be a better choice then the other, if they&#x27;re both comparable for this type of job, or if I&#x27;m even on the right track.

no comments

no comments