Hey HN!<p>We are building *open source infrastructure for deploying customer-facing data pipelines.*<p>Here’s our repo <a href="https://github.com/pipebird/pipebird" rel="nofollow">https://github.com/pipebird/pipebird</a> and website <a href="https://pipebird.com/" rel="nofollow">https://pipebird.com/</a>.<p>Pipebird (YC W22) is designed to enable companies that generate important data to offer secure data pushes to their customers’ warehouses, directly from their products.<p>Our team was previously building in fintech, where we heard from many of our peers that their customers wanted data pushed directly to their warehouses. Customers wanted to bring data into their source of truth without having to maintain custom built pipelines or introduce security risks by contracting a third-party ETL/ELT provider.<p>After seeing Stripe <a href="https://stripe.com/data-pipeline" rel="nofollow">https://stripe.com/data-pipeline</a> and customer.io <a href="https://customer.io/data-warehouse" rel="nofollow">https://customer.io/data-warehouse</a> recently invest in building out their own native data sharing products, we realized that many SaaS companies could better support their customers and even generate additional revenue by offering native data pipelines.<p>Our goal with Pipebird is to make creating a reliable data pipeline as simple as pressing a button from a vendor's dashboard.<p>With the current iteration of the product, data can be selected from a number of sources (ex: Postgres, MySQL, CockroachDB, etc.), customers can configure pipelines and optionally apply transformations (like type casting), and data can be periodically synced directly to customers’ warehouses (ex: Snowflake). We’re actively adding sources/destinations and would appreciate any feature requests.<p>Here's a 2 min demo of the product <a href="https://www.loom.com/share/c7a7e4b4e57c4015b533fd754c510b2e" rel="nofollow">https://www.loom.com/share/c7a7e4b4e57c4015b533fd754c510b2e</a><p>Pipebird is open source (MIT license) so that any developer can use it. Our aim is to not charge individual developers - we make money selling paid plans that include features like multiple projects, user permissions, additional security features, managed infra, support, etc.<p>Give us a whirl: <a href="https://github.com/pipebird/pipebird" rel="nofollow">https://github.com/pipebird/pipebird</a>. We’d love your feedback and will be here to answer any questions!
Hey team, Charles here, co-founder of prequel.co (YC W21). We also help companies share data with their customers.<p>As someone who's been playing in the data sharing space, it's really exciting to see it get more attention!<p>All the best to y'all!
Looks useful! Do you have a way to validate that the data was copied correctly and entirely? If not, you might want to consider integrating data-diff for that - <a href="https://github.com/datafold/data-diff" rel="nofollow">https://github.com/datafold/data-diff</a>
Nice work! We're really proud of how the warehouse sync feature we built at Customer.io turned out. We had to do it all from scratch though!<p>Good luck with the next steps for Pipebird.
Hey folks<p>The product looks great. I had faced such situations in past with different tools.<p>You should make the PM and Dev community aware of this tool to get better leads and usecases.<p>Wish you best for the future.
I should mention that we're happy to do a white-gloved deployment for anyone that wants to test out what this would look like in their product - feel free to email hello@pipebird.com