TE
TechEcho
Home24h TopNewestBestAskShowJobs
GitHubTwitter
Home

TechEcho

A tech news platform built with Next.js, providing global tech news and discussions.

GitHubTwitter

Home

HomeNewestBestAskShowJobs

Resources

HackerNews APIOriginal HackerNewsNext.js

© 2025 TechEcho. All rights reserved.

Open Distro for Elasticsearch

321 pointsby jeffbarrabout 6 years ago

56 comments

dangabout 6 years ago
We merged the related threads. Here are the relevant blog posts:<p><a href="https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;opensource&#x2F;keeping-open-source-open-open-distro-for-elasticsearch&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;opensource&#x2F;keeping-open-source-...</a><p><a href="https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;aws&#x2F;new-open-distro-for-elasticsearch&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;aws&#x2F;new-open-distro-for-elastic...</a>
sciurusabout 6 years ago
AWS explains their rationale at <a href="https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;opensource&#x2F;keeping-open-source-open-open-distro-for-elasticsearch&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;opensource&#x2F;keeping-open-source-...</a> . Here&#x27;s a snippet&quot;<p>&quot; Unfortunately, since June 2018, we have witnessed significant intermingling of proprietary code into the code base. While an Apache 2.0 licensed download is still available, there is an extreme lack of clarity as to what customers who care about open source are getting and what they can depend on. For example, neither release notes nor documentation make it clear what is open source and what is proprietary. Enterprise developers may inadvertently apply a fix or enhancement to the proprietary source code. This is hard to track and govern, could lead to breach of license, and could lead to immediate termination of rights (for both proprietary free and paid). Individual code commits also increasingly contain both open source and proprietary code, making it very difficult for developers who want to only work on open source to contribute and participate. In addition, the innovation focus has shifted from furthering the open source distribution to making the proprietary distribution popular. This means that the majority of new Elasticsearch users are now, in fact, running proprietary software. We have discussed our concerns with Elastic, the maintainers of Elasticsearch, including offering to dedicate significant resources to help support a community-driven, non-intermingled version of Elasticsearch. They have made it clear that they intend to continue on their current path. &quot;
评论 #19361045 未加载
评论 #19360719 未加载
评论 #19361608 未加载
pauldixabout 6 years ago
This is a very surprising move from AWS. In the past they haven&#x27;t seemed to be willing to contribute to the OSS that they pick up and host. Even though they claim they&#x27;ll contribute changes upstream, I doubt that Elastic would accept changes that are competitive with their commercial offerings. So you effectively get a fork.<p>I think this is a win for the Elastic community as a whole, but presents a real problem for Elastic the company. And that begs the question of what happens to the Elastic community if there&#x27;s a real fork. And what happens if Elastic the company is very negatively impacted? Do we see a fracture of the community?<p>Looking even farther out, at this point does it make sense for any startup looking to create infrastructure software to open source it? If their project becomes successful, they&#x27;ll get eaten up by the hosting providers. It makes smaller scale open source more commercially viable because you won&#x27;t attract the attention of the providers that would come in a take your business.<p>Will be interesting to at least watch what early stage VC investment in open source companies looks like over the next 12-24 months. Will the open source pitch work for series A investments or will investors shy away?
评论 #19360591 未加载
评论 #19362654 未加载
评论 #19360238 未加载
评论 #19362773 未加载
评论 #19365046 未加载
weberc2about 6 years ago
&gt; Unfortunately, we are seeing other examples where open source maintainers are muddying the waters between the open source community and the proprietary code they create to monetize the open source.<p>As I understand it, Amazon took ElasticSearch and monetized it, therefore competing directly with Elastic (the company that develops ElasticSearch). Elastic felt Amazon was taking advantage of Elastic&#x27;s commitment to open source, and started developing new features under a proprietary license, but releasing them for free. The idea was to prevent their work from benefiting a competitor.<p>Basically in this blog post, Amazon is trying to make the case that they&#x27;re a Good Tech Company and Elastic are the Bad Guys or something. Generally I&#x27;m all for nuance and &quot;the truth is probably somewhere in the middle&quot;, but Elastic is the rare company that truly is committed to open source (at least at the current moment in history) and Amazon is, well, Amazon.
评论 #19364694 未加载
评论 #19365486 未加载
评论 #19364427 未加载
评论 #19364473 未加载
评论 #19366362 未加载
评论 #19364690 未加载
评论 #19366337 未加载
评论 #19364422 未加载
jchwabout 6 years ago
My personal, probably disagreeable opinion, but... The narrative that Amazon is somehow screwing over open source is getting old. I don&#x27;t really think anything is &#x27;screwing over open source&#x27;, but if it&#x27;s <i>anything</i>, it is the notion that we should severely restrict the licenses to ensure only the right people can monetize it. To me, the original spirit of open source is &quot;I don&#x27;t care what happens to this after I release it,&quot; like Linus releasing Linux so long ago. To that end, Amazon has certainly leveraged hundreds or thousands of FOSS projects over the years, but only a few have cried foul about it, and they happen to be startups releasing open source software.<p>I&#x27;m totally supportive of developers and their rights to release software under whatever license they feel appropriate, but if you release open source software, benefit from your software being open source, for probably years, and then someone else monetizes it... I&#x27;d argue you really ought to have seen that coming from the get-go. The license explicitly allowed it, it&#x27;s not a loop hole that nobody knew about, it&#x27;s absolutely intentional.<p>If people want to move over to shared source licenses like SSPL, or heck, even just close the source... that&#x27;s fine too. But please don&#x27;t try to call it open source or defending open source. It&#x27;s defending a profit model that stopped working. Totally reasonable thing to do, but it&#x27;s nothing to do with open source being corrupted.
评论 #19365335 未加载
评论 #19365717 未加载
评论 #19365906 未加载
评论 #19366092 未加载
评论 #19365540 未加载
评论 #19365731 未加载
评论 #19364975 未加载
praseodymabout 6 years ago
Last year Elastic opened up the source code of their commercial X-Pack offering: <a href="https:&#x2F;&#x2F;www.elastic.co&#x2F;blog&#x2F;doubling-down-on-open" rel="nofollow">https:&#x2F;&#x2F;www.elastic.co&#x2F;blog&#x2F;doubling-down-on-open</a>. This means that these components (security, alerting, etc.) are now available in the GitHub repository, but they are covered by the proprietary Elastic license instead of the Apache 2.0 license like the rest of the software. Some of the proprietary parts can be used for free, some need a paid commercial subscription. None of them are true open source (free as in freedom), though.<p>However, this is also when Elastic started muddying the waters (to quote the AWS blog post). Most of the new features across the Elastic stack that were added in the past couple of months (Index Lifecycle Management, APM UI, Infrastructure and Logs UI, Kibana multi-tenancy, Kibana Canvas) are <i>not</i> added to the Apache 2.0 codebase but are only available in the free-but-not-open version. These features can be used for free with the Basic subscription (no registration needed) but only under the terms of the Elastic license.<p>And this Elastic license is where AWS feels the pain. It clearly prohibits SaaS offerings:<p>&gt; You agree not to: [..] use Elastic Software Object Code for providing time-sharing services, any software-as-a-service, service bureau services or as part of an application services provider or other service offering (collectively, &quot;SaaS Offering&quot;) [..]<p>(from <a href="https:&#x2F;&#x2F;github.com&#x2F;elastic&#x2F;elasticsearch&#x2F;blob&#x2F;6.6&#x2F;licenses&#x2F;ELASTIC-LICENSE.txt" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;elastic&#x2F;elasticsearch&#x2F;blob&#x2F;6.6&#x2F;licenses&#x2F;E...</a>)<p>The license is very similar to moves that MongoDB and Redis made recently. Only Elastic is just now doubling down on adding new (and highly demanded) features to their proprietary offering.
评论 #19362728 未加载
评论 #19363360 未加载
评论 #19363004 未加载
评论 #19362735 未加载
Mizzaabout 6 years ago
This is an interesting new &quot;threat&quot; to the &quot;open core&quot; business model. ES makes proprietary extensions to support their FOSS core product - then a tech behemoth clones these features for their own hosted service, but makes them Free as well. Good for the consumer, but bad for the company that originally created the core FOSS technology and best for Amazon.<p>Have there been any examples of this happening before?
评论 #19360242 未加载
评论 #19359918 未加载
评论 #19361007 未加载
评论 #19360723 未加载
HillRatabout 6 years ago
Definitely creates a new risk model for hybrid OSS-Enterprise software: build something attractive enough for the big players to co-opt and they might just, ah, fork you up. Now Elastic either accepts pull requests that create clean OSS versions of their pay-locked functionality, or they accept the existence of a feature-plus “Amazon Elasticsearch” fork in the market. While I give Cockcroft all the credit in the world (remembering him from his Sun days), this is still a tough spot for Elastic to be in. (More discussion in the Twitters: <a href="https:&#x2F;&#x2F;mobile.twitter.com&#x2F;_msw_&#x2F;status&#x2F;1105260461149151232" rel="nofollow">https:&#x2F;&#x2F;mobile.twitter.com&#x2F;_msw_&#x2F;status&#x2F;1105260461149151232</a>)
评论 #19364548 未加载
评论 #19365102 未加载
sailfastabout 6 years ago
As an active developer and maintainer of a cluster, I strongly disapprove of this move by AWS.<p>By forking on an earlier instance of the codebase for ES and Kibana they&#x27;re not only creating an open source version of the code but also attempting a fork of the community - plugin developers, user groups, etc. It&#x27;s extremely frustrating. EDIT: If folks actively building plugins have felt pain here because of decisions by Elastic, then my view on this point changes considerably, obviously.<p>I find it very hard to believe there was no compromise to be had here between the current Elastic roadmap for their product and their previous work.<p>How is this good for users of the current tools? How does this help create better capabilities on a common platform? Will this encourage users to build businesses on elasticsearch open source elements?<p>I&#x27;m not sure where the community ends up after this, so I&#x27;m not sure I can support by using AWS&#x27; elasticsearch tools.
评论 #19361234 未加载
评论 #19361528 未加载
评论 #19361583 未加载
spectre256about 6 years ago
I run a company that offers consulting and hosted services around a 100% open core (<a href="https:&#x2F;&#x2F;geocode.earth" rel="nofollow">https:&#x2F;&#x2F;geocode.earth</a>, shameless plug).<p>As someone who has a very strong desire to continue to be able to make a living while making open source software, I&#x27;ve been thinking long and hard about all the possible paths to take while maintaining open-source software as a job that pays the bills enough to run at least a small business.<p>Some paths and possible outcomes are:<p>- Open-core: Make most code pure open source, and then save some good stuff for pure proprietary. The lines are not _too_ blurred here, but this can get annoying. (Elastic&#x27;s X-Pack was _super_ annoying to deal with back in the 2.x days). Risks: you have to balance crippling the core versus building compelling proprietary features. You have to add additional complexity into both codebases to deal with a clean delineation. Amazon (or other bigco) can re-implement open-source replacements for your proprietary parts.<p>- Source-available: This in my mind includes any of the recent Redis Labs style licenses. Pros: more convenient from a setup perspective. Cons: Incredible legal risk for your users (compliance is harder). Uncertainty as all these licensees are new and possibly one-offs. Currently, there is a lack of goodwill around these licenses. Amazon can re-implement your entire interface (like with Mongo).<p>- All open source: Simple, clean, but Amazon can just take all your code and replace you, right?<p>It&#x27;s possible to assume that all scenarios end poorly, but I really don&#x27;t think so.<p>Take any famous chef. They probably have published a cookbook with recipes for many, if not all of their most popular dishes. People still eat at their restaurants for at least the following reasons:<p>- They want to experience the dish from the actual chef&#x27;s establishment. Whether it&#x27;s to be sure they&#x27;re getting the real deal or simply for the image aspects of the experience, it&#x27;s still worth it.<p>- They know that the chef is always experimenting and pushing new things that aren&#x27;t _yet_ in a cookbook, and they want to try it.<p>Bringing this back to software, I am confident Elastic still has a reputation of being able to build a better Elasticsearch hosted service than AWS (in my experience, Elastic&#x27;s is far superior). I also am confident that Elastic will continue to innovate using their proven experience building search products in the future, and that&#x27;s a good reason to use their products or software over AWS.<p>I believe that if you want to make money in open source you should do it by having valuable experience with some particular open source software that others are willing to pay for, not by building legal barriers to others doing the same thing. That&#x27;s what I plan to do for my business and I believe Elastic can and will do it too.<p>My hope is that in a few years after all these &quot;clever&quot; attempts to build moats around open source have proven futile, people will go back to good old-fashioned experience leading the way. But maybe I shouldn&#x27;t hold my breath.
评论 #19365032 未加载
mcescalanteabout 6 years ago
I recently decided to experiment with ES and prefer to evaluate things with Apache 2.0 licensing if available, even if I may pay for to license it at a later time. Elasticsearch Still maintains -oss suffixed docker images and builds that are true Apache 2.0. You can read more about this here: <a href="https:&#x2F;&#x2F;www.elastic.co&#x2F;products&#x2F;x-pack&#x2F;open" rel="nofollow">https:&#x2F;&#x2F;www.elastic.co&#x2F;products&#x2F;x-pack&#x2F;open</a><p>I jotted down instructions to run the docker containers based on a few different solutions from different places: <a href="https:&#x2F;&#x2F;gist.github.com&#x2F;mcescalante&#x2F;6be03751c820677cf0f15c7b864fa23a" rel="nofollow">https:&#x2F;&#x2F;gist.github.com&#x2F;mcescalante&#x2F;6be03751c820677cf0f15c7b...</a><p>I&#x27;m sharing this because I got the vibe from the linked post in the comments and the overall marketing of &quot;Open Distro for ES&quot; that Elasticsearch was &#x27;not open anymore&#x27; and had just discovered the Apache 2.0 builds within the last week.
kristoff_itabout 6 years ago
&quot;The maintainers of open source projects have the responsibility of keeping the source destination open to everyone and not changing the rules midstream.&quot;<p>Since when is anybody entitled to any free software. Projects can do what they want with their code, and while free software (the Stallman kind) is nice, if projects cite you as the main reason for their change of direction, you are intellectually dishonest if you just blame them for not being willing to do volunteer work (for you) anymore.<p>This, to me, looks like an abusive &quot;look what you made me do&quot;.
评论 #19360907 未加载
jake_morrisonabout 6 years ago
Basically Amazon screwing Elastic. Take their code and monetize it, not giving anything back. When Elastic changed their license to prevent it, Amazon forks it.<p>It&#x27;s the biggest risk to open source right now. They are following the strategy of &quot;commoditize the complementary good&quot;. Since Amazon makes money selling machine cycles, they want the software to be free.
评论 #19364602 未加载
评论 #19364562 未加载
评论 #19364564 未加载
评论 #19364827 未加载
评论 #19364569 未加载
评论 #19364687 未加载
评论 #19364686 未加载
评论 #19365502 未加载
评论 #19364841 未加载
devheadabout 6 years ago
Hosted ES by AWS is a good solution to regret later in life.<p>They have minimal tooling, poor change management, poor logging, inability to address broken state and no support what so ever for a service you paid for. I won&#x27;t go back to their hosted ES.<p>Edit: spelling
评论 #19363014 未加载
gtsteveabout 6 years ago
For further reading, this is also mentioned in the AWS blog: <a href="https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;aws&#x2F;new-open-distro-for-elasticsearch&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aws.amazon.com&#x2F;blogs&#x2F;aws&#x2F;new-open-distro-for-elastic...</a>
评论 #19360206 未加载
评论 #19359874 未加载
fredstedabout 6 years ago
I think a fork&#x2F;distro of ES was bound to happen.<p>As a heavy ES user, I&#x27;ve looked into getting a license to access the so-called X-Pack features, most of which are very basic and should belong in the OSS distribution anyways. Lots of those features are now available as plugins, but until now there&#x27;s been no overall solution for getting the missing features.<p>After an almost two hour long phone call, we kind of got the pricing in a roundabout way from the salesperson; tens of thousands of dollars per year for a small cluster. We REALLY wanted to get this, which is why we dealt with the sales process, but there was just no way to justify that to our management.
david_pabout 6 years ago
For those curious:<p>- the website is copyrighted to Amazon Web Services<p>- all commits in the github repositories are made by AWS staff.
评论 #19360659 未加载
hardwaresoftonabout 6 years ago
If you&#x27;re looking for options in the search space:<p>- <a href="https:&#x2F;&#x2F;github.com&#x2F;toshi-search&#x2F;Toshi" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;toshi-search&#x2F;Toshi</a><p>- <a href="https:&#x2F;&#x2F;github.com&#x2F;tantivy-search&#x2F;tantivy" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;tantivy-search&#x2F;tantivy</a> (more like lucene)<p>- <a href="https:&#x2F;&#x2F;github.com&#x2F;blevesearch&#x2F;bleve" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;blevesearch&#x2F;bleve</a>
all_usernamesabout 6 years ago
Title isn&#x27;t quite right: &quot;As was the case with Java and OpenJDK, our intention is not to fork Elasticsearch, and we will be making contributions back to the Apache 2.0-licensed Elasticsearch upstream project as we develop add-on enhancements to the base open source software.&quot;
评论 #19364595 未加载
cnjabout 6 years ago
It looks like Amazon and Elastic have maneuvered themselves into a lose-lose situation.<p>Amazon has to invest into an Open-Source fork, probably won&#x27;t benefit from some of the feature development Elastic will be doing, and won&#x27;t get any help running their ES-as-a-Service.<p>Elastic won&#x27;t see any revenue of the AWS ES-as-a-Service, and has lost a lot of goodwill with (potential) customers.<p>I think they could have reached a compromise where AWS makes sure a share of their revenue from their ES-as-a-Service ends up at Elastic, and Elastic recommends and supports ES-as-a-Service for their customers who are on AWS.<p>But these are apparently not the times for compromise, so we end up in a situation that is worse for AWS, Elastic and everyone in the wider community.
rooam-devabout 6 years ago
IMHO using &quot;open&quot; is just strategy to attract devs and companies that are looking for FOSS solutions, but in reality it&#x27;s just another way to vendor lock-in. I hope i am wrong.<p>Honest question, besides not paying licenses, is there any technical reason to do this?
评论 #19360116 未加载
评论 #19360827 未加载
评论 #19360104 未加载
jerracabout 6 years ago
I like seeing a, hopefully, solid OSS implementation of security for ES. I understand the companies need to make money and pay developers, but I&#x27;ve never been very comfortable with them keeping the security features out of the OSS version.
jmartricanabout 6 years ago
As I long time user of ES I applaud Amazon&#x27;s effort here. ES is not new and it is missing basic functionality.
jillesvangurpabout 6 years ago
I&#x27;m a long time Elasticsearch user (from before 1.0). I&#x27;ve also used Solr and I&#x27;ve built some lucene based search solutions before that as early as 2003. I&#x27;m also a customer of their hosted elastic cloud and I know several people inside that company; both former colleagues and through meetups. They do awesome stuff technically and it&#x27;s a great product to use.<p>In short, I think Amazon doing this is a good thing. I&#x27;ve had the pleasure of using their hosted solution and I can&#x27;t recommend it with a straight face. Key management features in the API are blocked and upgrades are a pain in the ass (as in, not supported). Support and documentation is minimal. It&#x27;s not terrible but you get a much better bang for buck by using Elastic cloud. Self hosting is not something I recommend you do until you need to. It&#x27;s a PITA and requires a non trivial amount of devops by someone who knows what they are doing to do it right. Rarely worth the price and hassle unless you need to run this at petabyte scale on custom hardware.<p>First, lets look at what this is not. This is not a fork of Elasticsearch or Kibana. If you go to the github account associated with this website, you&#x27;ll see that this is simply Amazon publishing the source of plugins they use in their hosted solutions. The readme of those plugins basically instructs you to download the appropriate version of Elasticsearch from Elastic.<p>Second, I was there when Shay Banon announced the licensing changes at Elastic ON in early 2018. At the time I already thought this was a somewhat unfortunate move as it muddles the water in terms what is and isn&#x27;t open source. Technically what they announced was shared source for things that were previously closed source. Which is better than nothing but not ideal. The whole thing was designed to get more people to try this out than was the case when you needed to get a license before you could play with it. It&#x27;s basically a form of shareware.<p>We use Elastic Cloud, it seems all the cool stuff they talk about is mostly off limits to their basic tier users astill nd requires quite a bit of skill to get started with. I appreciate that they are trying to upsell this stuff but I seem to be doing fine with just the standard OSS features (and I know they are OSS because this is what I used before elastic cloud as well). I could switch back to self hosted and not lose much (other than convenience).<p>Third, I think the Elasticsearch ecosystem benefits from having outside contributors; especially from big corporate entities like Amazon. Their history is literally bootstrapping off Apache Lucene as a small group of developers and consultants. They employ core committers and one of the co-founders is a core committer as well (I worked with him before Elastic happened). They&#x27;ve been working together with the Solr people on improving Lucene for the past six years and have made some awesome improvements. Lucene sees regular contributions from academics as well. It&#x27;s a healthy project and it is core to what Elasticsearch does. IMHO this is something they need to nurture and keep and something that is core to their culture.<p>The plugin ecosystem around Elasticsearch is where the action is commercially. They&#x27;ve built a lot of cool stuff around Elasticsearch that adds a lot of value. That too sees a lot of outside innovation. So, Amazon publishing some plugins is great. Also, given that they use it at scale, they probably have a thing or two to say about how to improve Elasticsearch and probably should be regularly creating pull requests, creating issues, etc. That&#x27;s a good thing. Anything blocking that would be a bad thing<p>In short, Elasticsearch created a big mess by mixing open and closed source and people are working around them. Instead of fighting that, they should double down of being open source at their core and benefit from this rather than attempting to fight it. I&#x27;d recommend them to 1) re-create and market their community edition, 2) actively considering offering support for Amazon customers and other people using their technology but outside of their bubble (e.g. Graylog). Work with the community instead of against it. Everybody wins.
kureikainabout 6 years ago
Is this some kind of AWS is trying to cleanup their reputation in ES? Their offer of ES is super weird. THe data node is only support 2 AZs, instead of 3. They also require using the IAM for authentication(you sign the request with access+secret keys) in other words, hard to simply `curl` it.<p>So if they added this, maybe they will eventually bring these into AWS ES offer, so that they can do the thing that X-Pack offer - because we cannot install plugins on AWS ES yet.
评论 #19364642 未加载
brataoabout 6 years ago
If someone is looking for a third opensource alternative to Elastic Search, I highly recommend <a href="http:&#x2F;&#x2F;vespa.ai" rel="nofollow">http:&#x2F;&#x2F;vespa.ai</a> We migrated from ES, and it is truly next-gen compared to ES
评论 #19417806 未加载
评论 #19365189 未加载
otisgabout 6 years ago
WDYT: Would it have been better for AWS to initiate Open Distro for ES as part of e.g. Apache Software Foundation, whose mantra is &quot;community over code&quot;?<p>(or if not ASF for some reason, then Eclipse or CNCF for example)
评论 #19363051 未加载
cikabout 6 years ago
I couldn&#x27;t be happier about this. We build on Elastic today - and there are several features that we&#x27;ve written into our codebase from scratch, that are available in commercial Elastic only. Quite frankly if there&#x27;s a community that once again &quot;open&quot;, and that we can even contribute some of our technology to with everyone benefiting - I&#x27;ll be pretty thrilled.<p>In tomorrow&#x27;s test I&#x27;m going to throw ~3 billion messages at Elastic 6.x and then immediately stand this up over the same database... Time to see what happens :)
评论 #19368538 未加载
sidiabout 6 years ago
This is a good project to happen, and kudos to AWS for doing this! However, like some in the thread, I suspect AWS has been building this for a while for their own product and Elastic&#x27;s license change may have influenced the decision to open-source.<p>Getting a good out-of-the-box granular security has been a long overdue pain point with ElasticSearch, there have been good alternatives for the other problems it is replicating.<p>1.) ElastAlert - <a href="https:&#x2F;&#x2F;github.com&#x2F;yelp&#x2F;elastalert" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;yelp&#x2F;elastalert</a> for alerting, 2.) ElasticSearch SQL - <a href="https:&#x2F;&#x2F;github.com&#x2F;NLPchina&#x2F;elasticsearch-sql" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;NLPchina&#x2F;elasticsearch-sql</a> for writing SQL queries.<p>Would very much like to hear from OP why these weren&#x27;t contributed to instead of creating another alternative.<p>We&#x27;ve been working on a similar project in Golang and now well may be as good a day to open-source and put it out there: <a href="https:&#x2F;&#x2F;github.com&#x2F;appbaseio&#x2F;arc" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;appbaseio&#x2F;arc</a>. It&#x27;s an extremely light-weight API gateway for ElasticSearch that at the core comes with an out-of-the-box security system based on users and permissions (set granular ACLs, Rate Limits, TTL) inspired from a proprietary security system we built over the past year - <a href="https:&#x2F;&#x2F;appbase.io&#x2F;features&#x2F;security&#x2F;" rel="nofollow">https:&#x2F;&#x2F;appbase.io&#x2F;features&#x2F;security&#x2F;</a>.
评论 #19361393 未加载
jahewsonabout 6 years ago
Who is acting in the best interest of the open source community, Elastic or AWS?
评论 #19362128 未加载
评论 #19362917 未加载
评论 #19365094 未加载
eric_babout 6 years ago
I dunno if I&#x27;d be long $ESTC at this point. Elastic took $162 million in venture funding before IPOing. In the last year their Operating Income was -$43 million. A lot of that is sales&#x2F;marketing related, but at some point they need to make a profit. This open distro is certainly not going to help.<p>As someone who&#x27;s worked at many big corps on Elasticsearch installs, I&#x27;ve been worried about them pushing away from OSS for some time. Many big corps want some of these &quot;Enterprise&quot; grade features Open Distro is offering, and if Elastic doesn&#x27;t already have a foothold in them, I wager they&#x27;ll be using this instead of paying.<p>As an aside, how come people still think these Open Source&#x2F;Core commercial businesses are viable? We&#x27;ve seen time and again that once commercialization occurs, the OSS stuff goes right out the window. (RedHat, Docker, MongoDB, Sentry etc)
评论 #19360997 未加载
speedplaneabout 6 years ago
Pure software open source projects should not accept VC money and expect to stay purely open source for long.
patwolfabout 6 years ago
I was always surprised one of the cloud providers didn&#x27;t release a cloud-native full-text search service. A lot of projects could benefit by a simple text search service. I always found Elasticsearch to be a little clunky and found myself wishing there was an alternative. While I don&#x27;t like to be locked into a cloud vendor, having a simple text search service might be enough to sway me towards a particular vendor, even if it&#x27;s proprietary.<p>Amazon&#x27;s Elasticsearch service does simplify installation and management, but honestly I wish it were even simpler. I don&#x27;t want to even think about CPU&#x2F;memory sizing or the number of shards.
评论 #19364706 未加载
评论 #19365961 未加载
itaifrenkelabout 6 years ago
Amazon is forcing elastic to make money from their hosted offering, instead of their proprietary x-pack modules. Professional Services don’t scale as software do (compare AWS with Rackspace) - so I’m ignoring that income stream for now. Basically, they are trying to force Elastic into the AWS red ocean. Elastic, in response, would have to make a technology leap in order to best solve their customers problems. Examples include: Integrated data prediction, anomaly detections, clustering (online machine learning). Seamless multi region cluster deployment (with some consistency guarantee)...
mosselmanabout 6 years ago
&#x27;Distro&#x27; makes it sound like a linux-distribution with, in this case, Elasticsearch installed on it. From what I read on the page and on the aws blog this is not the case though?
评论 #19359781 未加载
评论 #19359957 未加载
评论 #19359835 未加载
评论 #19359787 未加载
olavggabout 6 years ago
Question, can I checkout the code from Github and build it with .&#x2F;gradlew assemble as Apache License 2 or do I need to delete some modules before doing that?
otisgabout 6 years ago
My Twitter followers include a lot of Elasticsearch and Solr users. It will be interesting to see what they think of this from their POV as users... <a href="https:&#x2F;&#x2F;twitter.com&#x2F;otisg&#x2F;status&#x2F;1105146138921979905" rel="nofollow">https:&#x2F;&#x2F;twitter.com&#x2F;otisg&#x2F;status&#x2F;1105146138921979905</a>
dmanabout 6 years ago
The cloud that creates an Itunes like solution for OSS, creating a business model for OSS and earning the respect of developers will make bank like Apple did. Am hoping for one of the cloud players to adopt this strategy.<p>Disclaimer: Views expressed above are my own and do not reflect any opinions from my employer.
评论 #19365801 未加载
all_blue_chucksabout 6 years ago
ITT: people shocked by the fact that open source licensing really is open source.
评论 #19364931 未加载
unethical_banabout 6 years ago
I notice that ODFE (as I am trying to make the acronym a &quot;thing&quot;) is packaged for Docker and RPM. It would be nice if they provided the plugins&#x2F;extensions separately, or otherwise had build-from-source instructions.
javadevmtlabout 6 years ago
P.s: I think people are confused. This isn&#x27;t a fork? Basically AWS should have came out and said. &quot;Hey folks we created brand spanking new OSS plugins with sepcific funxtionality for Elastic&quot; and you can use them!
bd103dallabout 6 years ago
Found this perspective interesting: <a href="https:&#x2F;&#x2F;thenewstack.io&#x2F;what-the-fork-amazon&#x2F;" rel="nofollow">https:&#x2F;&#x2F;thenewstack.io&#x2F;what-the-fork-amazon&#x2F;</a>
drkrababout 6 years ago
How is elastic (the company) going to make a business going forward? I would expect that selling these enterprise add-ons (or similar ones) is a significant part of their revenue.
评论 #19359997 未加载
a012about 6 years ago
What do they use for Alerting? IIRC Alerting with Elasticsearch 6 is available on Enterprise edition, not OSS. And what the OS under it actually?
评论 #19359958 未加载
评论 #19359923 未加载
ignoramousabout 6 years ago
I see this as a net positive (<a href="https:&#x2F;&#x2F;xkcd.com&#x2F;927&#x2F;" rel="nofollow">https:&#x2F;&#x2F;xkcd.com&#x2F;927&#x2F;</a> notwithstanding): Elastic.co, imo, has iron-grip (in terms of licensing and features that it builds) on XPack and Elasticsearch. This incredible technology that rode on OSS wave is increasingly controlled by a for-profit organization that also acts like one. This is very similar to how Google dealt with numerous forks of Android by essentially moving key pieces to GooglePlayServices and other closed-source apps in addition to responding with shutting out manufacturers and SoC providers that weren&#x27;t OHA signatories [0][1]. Amazon felt the burnt of that [2].<p>Apart from including&#x2F;forking other community plugin projects (elasticsearch-sql, SearchGuardSSL) in open-distro [3], AWS seems to be investing to make this more &quot;cloud-native&quot;, as well: This observation comes from PerformanceAnalyzer (released) and IndexStateManagement (request-for-comment).<p>- IndexStateManagement [4] is simply &quot;never send a human to do a machine&#x27;s job&quot; automation of common yet frequent tasks required to keep elasticsearch humming along. If used in conjunction with AWS&#x27;s&#x2F;GCP&#x27;s&#x2F;Azure&#x27;s managed-cloud offering, this feature might be an amazing sell for a lot of enterprises that want to set up things and have them running with as few dev-ops&#x2F;engs as they can.<p>- PerformanceAnalyzer [5] could track multiple signals from servers running open-distro and may perform reactionary actions to either shed load, throttle requests, shift workload and so on, something similar to what MeltWater did [6].<p>[0] <a href="https:&#x2F;&#x2F;arstechnica.com&#x2F;gadgets&#x2F;2018&#x2F;07&#x2F;googles-iron-grip-on-android-controlling-open-source-by-any-means-necessary&#x2F;" rel="nofollow">https:&#x2F;&#x2F;arstechnica.com&#x2F;gadgets&#x2F;2018&#x2F;07&#x2F;googles-iron-grip-on...</a><p>[1] <a href="https:&#x2F;&#x2F;techcrunch.com&#x2F;2009&#x2F;12&#x2F;22&#x2F;google-open-when-convenient&#x2F;" rel="nofollow">https:&#x2F;&#x2F;techcrunch.com&#x2F;2009&#x2F;12&#x2F;22&#x2F;google-open-when-convenien...</a><p>[2] <a href="https:&#x2F;&#x2F;www.theguardian.com&#x2F;technology&#x2F;2013&#x2F;oct&#x2F;16&#x2F;amazon-set-to-launch-htc-built-smartphone" rel="nofollow">https:&#x2F;&#x2F;www.theguardian.com&#x2F;technology&#x2F;2013&#x2F;oct&#x2F;16&#x2F;amazon-se...</a><p>[3] <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=19361234" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=19361234</a><p>[4] <a href="https:&#x2F;&#x2F;github.com&#x2F;opendistro-for-elasticsearch&#x2F;index-management&#x2F;blob&#x2F;master&#x2F;RFC.md" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;opendistro-for-elasticsearch&#x2F;index-manage...</a><p>[5] <a href="https:&#x2F;&#x2F;opendistro.github.io&#x2F;for-elasticsearch-docs&#x2F;docs&#x2F;pa&#x2F;reference&#x2F;" rel="nofollow">https:&#x2F;&#x2F;opendistro.github.io&#x2F;for-elasticsearch-docs&#x2F;docs&#x2F;pa&#x2F;...</a><p>[6] <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=18413862" rel="nofollow">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=18413862</a>
评论 #19362167 未加载
评论 #19365109 未加载
ggmabout 6 years ago
I currently run stuff in elastic. I am now thinking that postgres:JSON may be better for me.
bd103dallabout 6 years ago
Found this perspective interesting around COSS vs FOSS: <a href="https:&#x2F;&#x2F;thenewstack.io&#x2F;what-the-fork-amazon&#x2F;" rel="nofollow">https:&#x2F;&#x2F;thenewstack.io&#x2F;what-the-fork-amazon&#x2F;</a>
anth_anmabout 6 years ago
Hot take, the future of open source is just massive companies sponsoring projects to get free dev hours.<p>You can try to fight it, but if Amazon wants your project they will either take the code or build a compatible API. There is no defense, IP rights only favour proprietary software.
oustaabout 6 years ago
Well what about enterprise support? When customers buy an enterprise solution at elastic they get support right? what would entitle them to move to this offering.
评论 #19364302 未加载
oustaabout 6 years ago
It is hosted on AWS as a service hence not open source.
james_s_taylerabout 6 years ago
The whole Amazon takes an open source product and monetizes it almost reminds me in a way of someone getting rich off an asset flip on the unity store. Just a big, giant, corporate version.
viburnumabout 6 years ago
OK this sounds like bullshit. Can somebody explain what&#x27;s going on?
评论 #19364405 未加载
oldpondabout 6 years ago
I find it very ironic that AWS is behind this. Whenever I buy books from Amazon I am amazed at their broken search engines. Just search a topic on Amazon and then try to sort the results. LOL.
评论 #19361137 未加载
hguhghuffabout 6 years ago
In the old days, big companies spent gazillions to buy companies when they wanted to add their software to their product lineup.<p>Amazon just takes it regards of whether or not the original developer is happy or hostile.<p>This is going to redefine open source.
评论 #19364917 未加载
评论 #19364676 未加载
评论 #19364671 未加载
softwarelimitsabout 6 years ago
Dear Ladies and Gentlemen, it would be of extraordinary interest to I believe many people in our industries if anybody with some production experience on the topic would like to write a short comparison &quot;Elasticsearch vs. Solr&quot;, thank you very much for your attention!
评论 #19360133 未加载
评论 #19360283 未加载
评论 #19360145 未加载
评论 #19360078 未加载
jawnsabout 6 years ago
&gt; At AWS, we believe that maintainers of an open source project have a responsibility to ensure that the primary open source distribution remains open and free of proprietary code so that the community can build on the project freely, and the distribution does not advantage any one company over another.<p>Sections like this make me wonder if customers should demand that these announcements be delivered on video, rather than in print, so we can see whether the spokesperson can say it with a straight face.