TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: CoolQLCool – Turn Websites into GraphQL Accessible APIs

124 点作者 gavino超过 6 年前

13 条评论

lachenmayer超过 6 年前
I&#x27;ve previously written a very similar project called &quot;graphql-scraper&quot; (which is arguably a far less cool name...), you can check it out at <a href="http:&#x2F;&#x2F;github.com&#x2F;lachenmayer&#x2F;graphql-scraper" rel="nofollow">http:&#x2F;&#x2F;github.com&#x2F;lachenmayer&#x2F;graphql-scraper</a><p>It works very similarly, with only superficial differences under the hood (eg. I used jsdom, and this uses cheerio). The `waitForSelector` feature is very cool!<p>You can see a live demo of the HN example using graphql-scraper at <a href="https:&#x2F;&#x2F;graphqlbin.com&#x2F;v2&#x2F;lxNohP" rel="nofollow">https:&#x2F;&#x2F;graphqlbin.com&#x2F;v2&#x2F;lxNohP</a><p>This example is deployed on Glitch - you can easily spin up your own using <a href="https:&#x2F;&#x2F;github.com&#x2F;lachenmayer&#x2F;graphql-scraper-server" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;lachenmayer&#x2F;graphql-scraper-server</a> (with 1-click deploys to Heroku, Now &amp; Glitch)<p>Of course (as mentioned already) there is also <a href="https:&#x2F;&#x2F;github.com&#x2F;syrusakbary&#x2F;gdom" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;syrusakbary&#x2F;gdom</a> which uses Python+Graphene.
评论 #18718084 未加载
maio超过 6 年前
Nice! There is also similar project GDOM - <a href="https:&#x2F;&#x2F;github.com&#x2F;syrusakbary&#x2F;gdom" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;syrusakbary&#x2F;gdom</a> written in Python.
bryanrasmussen超过 6 年前
Are you planning to build anything on top of this - service,company? I was thinking it would be a good way to build an api for some projects I&#x27;ve been thinking of working on, although I would probably want to switch out cheerio for <a href="https:&#x2F;&#x2F;github.com&#x2F;intoli&#x2F;remote-browser&#x2F;" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;intoli&#x2F;remote-browser&#x2F;</a>
评论 #18718064 未加载
canadev超过 6 年前
This is a tangent but they link to a serverless deployment service where you upload your code as a function and they execute it. Pretty interesting.
pdxandi超过 6 年前
I&#x27;ve been looking for something like this! I&#x27;m trying to play around with it but can&#x27;t seem to get the selector right. How do I grab a table `td` by its nth selector (tried `td:nth-of-type(n)` to no avail)?
VMG超过 6 年前
Awesome name, awesome project!
conceptpad超过 6 年前
Great project! I can imagine this may greatly improve web certain classes of scraping. @gavino I&#x27;m curious what tooling and architecture you used to put this together?
评论 #18718185 未加载
simonhamp超过 6 年前
Didn’t Yahoo do something like this many years ago, effectively a SQL for web pages?
评论 #18722280 未加载
nurettin超过 6 年前
Not sure what to make of this. How does it handle throttling or captchas?
halfjew22超过 6 年前
If this is a community reference I’m going to be very happy.
评论 #18718067 未加载
jarjar12超过 6 年前
Sorry a dumb question. What are the use cases ? Thx
评论 #18715881 未加载
hokumguru超过 6 年前
This is very cool.
powerslacker超过 6 年前
Give this man an internet.