TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: Apify SDK – A scalable web crawling and scraping library for JavaScript

78 pointsby jancurnover 6 years ago

5 comments

jancurnover 6 years ago
Hey guys, today we’re showing HN a new open-source library that we have been working on for almost a year. It incorporates lessons learned from scraping of thousands of websites over the last 4 years. We figured there was no such universal library for JavaScript, while for example Python has one (<a href="https:&#x2F;&#x2F;scrapy.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;scrapy.org&#x2F;</a>). That wasn’t fair, because JavaScript is THE language of the web :)<p>Anyway, we hope you’ll give it a shot and we’re really looking forward to hear what you think about it. All feedback welcome!
rajangdavisover 6 years ago
I wish I could upvote this more. This solves a huge problem for me and will definitely be taking a peek at this over the weekend.<p>Thank you so much for making and sharing this!
darekkayover 6 years ago
Thanks, this looks solid, with a really extensive documentation. I will give it a try for my next crawling&#x2F;bot project :)
评论 #18064893 未加载
raitomover 6 years ago
This comes just in time when I needed to replace an old scraper!<p>Does it have to run on an instance or can we also use a serverless environnement?
评论 #18082494 未加载
pdxandiover 6 years ago
I&#x27;m a huge fan of Apify and look forward to exploring this new SDK. Thanks y&#x27;all.
评论 #18082720 未加载