TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Show HN: X to Elasticsearch Sync

36 pointsby sidiover 7 years ago

4 comments

alx_over 7 years ago
I did a bit of digging in the repository. And I didn&#x27;t like what I found.<p>First off, this project seems to be based on:<p><a href="https:&#x2F;&#x2F;github.com&#x2F;compose&#x2F;transporter" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;compose&#x2F;transporter</a><p>But of course every mention of transporter or compose.io was removed from repository, including original BSD-3 license. Which is clearly a violation of BSD-3 license terms.<p>Guys, this is not how open source works. You shouldn&#x27;t try to claim all the credit when your work is clearly a derivative of another work.<p>And this isn&#x27;t even the worst thing about the project. While it claims to be an open-source software, almost all of its functionality has been removed from the source code.<p>Thus as an open source software it&#x27;s completely useless. If you build it from source it probably does nothing, because syncing code is closed source.<p>Yeah, I know you can download pre-built executable. But I won&#x27;t ever be running some closed-source freeware&#x2F;commercial software in production.<p>No, thank you very much. Especially if aforementioned software was written by someone who completely lacks any notion of ethics.
评论 #15731619 未加载
评论 #15730503 未加载
BrentOzarover 7 years ago
I couldn&#x27;t figure this out in the documentation - how are you keeping the data up to date? Is there some kind of scheduled refresh that pulls all the data from the database periodically, or how are you detecting which rows changed?<p>In particular, how are you implementing this in, say, the MSSQL importer?<p>&gt; Adaptors may be able to track changes as they happen in source data. This &quot;tail&quot; capability allows a ABC to stay running and keep the sinks in sync.
评论 #15730322 未加载
sidiover 7 years ago
Hi HN, we created <i></i>ABC import<i></i> as a convenient way to sync data source to an Elasticsearch index. It does three things really well imho:<p>1. A small footprint process &#x2F; docker container that can index or sync your data source with ES that is operationally simple vs relying on application layer logic,<p>2. Supports on-the-fly transformations with Javascript, as well as configuration of mappings (so if you want to set a specific analyzer on your Text fields, or set type mappings),<p>3. Works with a wide variety of sources - Postgres, MySQL, SQL Server, MongoDB, JSON, CSV, Elasticsearch and more coming soon.
评论 #15729743 未加载
评论 #15729515 未加载
rpedelaover 7 years ago
Can this sync to any ES server or just appbase? All the examples in docs are for appbase targets.
评论 #15730345 未加载