TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Database Lab – Full-size staging databases as a service

137 pointsby stanslerover 5 years ago

11 comments

sandGorgonover 5 years ago
My advice - go all the way into RDS territory.<p>This is a killer feature. But it is hard to adopt it by itself, while being on RDS, which is what most people end up doing.<p>If you can build a management layer that gives better-than-RDS features ...while allowing me to BYOB my own cloud, you are on your way to win.
评论 #22272885 未加载
gavinrayover 5 years ago
Love the idea, but is this essentially then just a faster version of <i>pg_dump</i>?<p><pre><code> pg_dump -C -h remotehost -U remoteuser dbname | psql -h localhost -U localuser dbname</code></pre>
评论 #22271590 未加载
penagwinover 5 years ago
Question: Can this clone a database, but also apply certain operations to it?<p>I work at a small company, and currently we clone our production database to our dev machines for testing. However certain information in the database is sensitive and we don&#x27;t want to include it on our dev machines. (This specific sensitive data is also stored in an encrypted format and the key is not included, but we&#x27;d still prefer it not included).<p>Basically I&#x27;d like to be able to clone the database, and run some SQL to replace the data in some tables with some mock data. But I can&#x27;t think of an easy way to do this without cloning the database, starting a temporary one, run the sql, then clone it again - and distribute that final build to the devs.
评论 #22271474 未加载
评论 #22270335 未加载
评论 #22271020 未加载
u02sgbover 5 years ago
This looks like open source Delphix using Postgres. It even seems to be using ZFS under the hood.<p>Any comments from people using it? I designed a CI system using Delphix at an old client and it was awesome!
评论 #22271269 未加载
评论 #22270155 未加载
satyrneinover 5 years ago
Would it be practical to use this in an automated regression testing context to give each test its own copy of the database that it could mutate, check results, then throw away?
diminishover 5 years ago
This helps a lot in developing and testing for postgres.<p>Maybe that&#x27;s one of the tech which &quot;John Carmack&quot; meant when he said sophisticated tech is indistinguishable from magic.
评论 #22269792 未加载
francislavoieover 5 years ago
Does such a thing exist for MySQL? If so I&#x27;d appreciate a link. We have weekly snapshots that we use for development, but it would be amazing to have a way to reset&#x2F;throw away any changes quickly, especially to repeatedly test a specific use-case against some prod data.
veritas3241over 5 years ago
Snowflake does something similar since it&#x27;s a metadata store and cloning is mainly copying the metadata. It does scale with data volumes though so it doesn&#x27;t seem like it&#x27;s be as quick.<p>Really great idea here!
arithmaover 5 years ago
A bit tangential, but this reminded of an idea I had when I was learning about containerization and overlayfs. Would postgres work with data stored in an overlay and allow a similar workflow?
geoffbpover 5 years ago
What are people using these days for data sanitization? I.e. to remove PII data from dev snapshots
评论 #22275753 未加载
johnmarcusover 5 years ago
Is this just using zfs to copy the data directory? Why do o need a tool to do that?