TE
科技回声
首页24小时热榜最新最佳问答展示工作
GitHubTwitter
首页

科技回声

基于 Next.js 构建的科技新闻平台,提供全球科技新闻和讨论内容。

GitHubTwitter

首页

首页最新最佳问答展示工作

资源链接

HackerNews API原版 HackerNewsNext.js

© 2025 科技回声. 版权所有。

Show HN: Webcrepe – SQL for the Internet

7 点作者 jmcminis超过 3 年前

1 comment

jmcminis超过 3 年前
I think there is a trend towards using SQL to do the T part of ELT. For example, see the rise in popularity of dbt. Analysts are often limited by the data that&#x27;s in the warehouse already. Instead of asking a data engineer or developer to do something so that more data gets pushed to the warehouse, I wanted to be able to pull it in myself.<p>Because of that, I&#x27;m starting an open source project, WebCrepe, to empower analysts to pull data directly into their databases using SQL. The idea is that we pair a database extension with a web app to enable searching the internet and pulling in structured data. It&#x27;s really early right now. I have a docker-compose file you can use to spin up a postgres database and the backend. I still need to write some better documentation on how to write queries but it&#x27;s basically using the advanced google search language.<p>I&#x27;m interested in analytics folks that have use cases I can build out and engineers interested in working on it. If there is any interest then I&#x27;ll write up better docs and build more functionality.
评论 #29874083 未加载