TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: Splitgraph DDN – Public PostgreSQL proxy to 40k+ datasets

30 pointsby mildbytealmost 5 years ago

4 comments

mritchie712almost 5 years ago
I&#x27;m getting:<p><pre><code> ERROR: Internal Splitgraph error CONTEXT: PL&#x2F;pgSQL function schema_controller.fatal(text) line 3 at RAISE </code></pre> When running:<p><pre><code> SELECT &quot;:id&quot;, &quot;vacancy_rates&quot; FROM &quot;brla-gov&#x2F;census-demographics-xsrb-mxqt:latest&quot;.&quot;census_demographics&quot; LIMIT 100;</code></pre>
评论 #24221988 未加载
评论 #24221912 未加载
rco8786almost 5 years ago
Whoa this seems incredibly cool and useful.
chatmastaalmost 5 years ago
Hi HN,<p>You may have seen our previous Show HN [1] for Splitgraph, a tool to build, query and share PostgreSQL database snapshots. Today we are launching our first iteration of the service we’re building around that core code.<p>We’re calling Splitgraph a “Data Delivery Network” (DDN). It’s an integrated data catalog and distributed SQL caching proxy, built on the PostgreSQL wire protocol, with value-adds like access control and query rewriting. It can forward SQL queries from existing SQL clients to live upstream data sources, or to versioned data snapshots known as &quot;data images&quot; (including JOINs across sources).<p>For example, the public instance at Splitgraph.com indexes 40k+ public datasets and lets you query them directly from your existing SQL client or BI tool, without needing to install anything else. You can also consume Splitgraph data through a REST API powered by PostgREST, and you can build data images with `sgr` and push them to Splitgraph (e.g. it’s really easy to import a CSV, turn it into an image, and push to Splitgraph).<p>The public endpoint is at `postgresql:&#x2F;&#x2F;data.splitgraph.com:5432&#x2F;ddn` and we provide instructions on getting credentials and connecting with a lot of popular clients like DBeaver&#x2F;psql&#x2F;pgcli&#x2F;Google Data Studio, as well as some sample queries (you can jump right in at www.splitgraph.com&#x2F;connect).<p>In the near future, we&#x27;re planning to add more pluggable upstream data sources to public&#x2F;self-hosted Splitgraph, letting it proxy to data warehouses (Snowflake, BigQuery, Redshift, etc.) and third-party SaaS APIs (Salesforce, Google Analytics, etc). As a proxy, we’re well positioned to add services on top like caching, granular access control, firewalling, query rewriting and scheduled queries. As a catalog, we have a natural UI to implement management of upstreams (e.g. sharing access to a table or view is as easy as clicking “share”).<p>We think there is demand for a data catalog, and we think combining it with a SQL access endpoint opens a lot of opportunities. In particular, we expect access control over disparate data sources to be a leading use case. Companies are rarely able to keep all their data in just one warehouse, for one reason or another, so adding an aggregation layer on top can make sense in some scenarios.<p>We have a blog post [2] where we detail our vision for it.<p>Hope you try it out and would love to hear any feedback!<p>If you think you could use Splitgraph at your company, we’re in the midst of developing a Private Cloud product and would love to talk. Reach out at miles@splitgraph.com (chatmasta on HN) and artjoms@splitgraph.com (mildbyte on HN).<p>[1] <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=23627066" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=23627066</a><p>[2] <a href="https:&#x2F;&#x2F;www.splitgraph.com&#x2F;blog&#x2F;data-delivery-network-launch" rel="nofollow">https:&#x2F;&#x2F;www.splitgraph.com&#x2F;blog&#x2F;data-delivery-network-launch</a>
评论 #24210819 未加载
mritchie712almost 5 years ago
How much does this cost?
评论 #24222067 未加载